I am sorry to say you can't guarantee "safe"
Here is an article from just today about a cruise chip passenger stabbed in St. Lucia in broad daylight.
At least the locals stepped in to help the lad and her friend.
Taxi drivers are generally safe. But you should stay away from isolated "low income" neighborhoods where other people cannot see you. Stick to well-populated tourist areas.