Bomb disposal experts have warned members of the public who find suspect objects not to touch them in case they explode.
The warning comes after a man carried an 28lb two-foot aircraft rocket to Middlesbrough Police Station last week because he had seen children playing with it.
Over 100 officers, prisoners the neighbouring magistrates' court and library along with nearby residents had to be evacuated.
It turned out to be a dummy but the Army said moving a live bomb could detonate it, potentially killing or maiming those nearby.
Army spokesman John Salisbury-Baker said it was impossible to say where hand grenades, anti aircraft missiles, unexploded bombs and mines left over from the two world wars could turn up.
"They can crop up in ornamental flower beds and only be unearthed after a heavy rainfall when the topsoil is moved.. It is surprising where things end up," said Mr Salisbury-Baker.
"The police and bomb squad would rather people contacted them rather than risk setting it off.
"It doesn't matter if they end up being duds, they are not going to be angry, it is better being careful than being dead."
Mr Salisbury-Baker said these days the army only test their weapons on special sites away from the public and that records are taken off what ammunition is used.
He added: "Today we are very careful and we know what we are using and whether something has gone missing but sixty years ago during the fog of war we might not have been so careful.
"From time to time to we get very big ones that failed to go off during the German bombing raids that will be washed up on the sea shore."
The same caution should be adopted when members of the public find suspicious packages in public places because of the threat of global terrorism.
Sergeant John Blake, of Cleveland Police, supported the army's advice, adding: "The public should be extra vigilant during these times where there is a heightened terrorist threat.
"There is not need to panic but it is something we should all be aware of and people should stay alert."
Comments: Our rules
We want our comments to be a lively and valuable part of our community - a place where readers can debate and engage with the most important local issues. The ability to comment on our stories is a privilege, not a right, however, and that privilege may be withdrawn if it is abused or misused.
Please report any comments that break our rules.
Read the rules hereComments are closed on this article