Sorry you didn't like Bermuda. It's too bad you didn't cruise Celebrity. You would have been docked at St. Georges for two days and then Hamilton (which is the capitol and center of town) for three days.
When I booked my cruise I took the ports into consideration. I did my research and decided I didn't want to be docked at the wharf because I heard it was no big deal and that's why I chose Celebrity. Celebrity was the only cruise line that docked at those piers.
We bought the ferry/bus 3-day pass and went to the wharf that way, the ferry ride is great because you get to see Bermuda by sea which is beautiful and the bus was fun to ride to see the interior sections.
I do hope you went to Horseshoe beach.
Don't give up on Bermuda, maybe consider Celebrity next.
PS: I wish Celebrity had a newer ship going to Bermuda though. I enjoy the newer ships than the older ones. Although the Horizon's dining fare and service was five star!