From what I remember you can take a taxi or a water taxi and yes you’re safe. Anything can happen anywhere any time but I'm pretty sure you have nothing to worry about.
It was just us two girls also, we took a water taxi to the area and walked a very short distance. Not sure there called water taxi but that pretty much what they are. Have a nice trip the Atlantis was great!