Being physically fit will enable you to feel more confident overall, but especially when it comes to how well you think you could defend yourself. Consider a defense class of some kind. Try anything from karate or kickboxing to a workout routine or dancing to your favorite music. Eating well-balanced meals can help you maintain the energy you’ll need for all that activity, as well as keep your body healthier for a good night’s sleep.

Getting to know your neighbors is also a step in the right direction. Extend yourself to (friendly) neighbors you already know and make an effort to get to know those (friendly neighbors) you don’t know. Get to know your neighbors’ routine and share yours where appropriate.

It may surprise you to find out you live next door to or down the street from the nosiest woman on earth. While this would bother others, someone in your position might just sleep better knowing there is someone in the neighborhood who has no problem calling the cops for every little noise.

Be kind to yourself. You have this fear for a reason. It doesn't matter if the reason is because of an experience or a self-imposed belief with no basis in fact. You feel it - therefore it's real. You've given yourself permission to be fearful - now give yourself permission to do something with it. Find a counselor, get a dog, take a defense class, get active, and talk with your local law enforcement.

Put the same amount of time and effort into abating the fear as you have into feeling the fear. In time, you'll feel less fearful and more empowered.