If you are of retirement age or have a disability many states have enacted laws which protect you from intimidation and threats of violence. The threat doesn't have to be spoken. If someone has, in all honesty, caused you to be afraid when you were acting well within your rights, then you were probably intimidated. You may be able to file a restraining order against them. However, if you initiated threatening behavior towards them, they may have reacted in self defense.

A goon or thug may not be a young person, either. There are a lot of aging leftist and liberal goons who will get in your face, yell, threaten, or intimidate you if you oppose their point of view. Watching the anti Measure 8 protest in California, this crowd obviously got out of control with its anger and left many people feeling threatened.

Check the laws in your state. In my state there is a form that can be filed that is similar to a restraining order. There is also mention, on the state website, of the possibility of monetary damage awards, but with the caveat that filing a complaint, without an attorney's advice, might negate an award. Use your own judgement.