Debbie, for a first experience, I would cruise out of NY, Boston or Philadelphia. You get to spend most of 4 days in Bermuda and that includes overnights. We cruised there twice before doing this land vacation.
Jack, on our first visit it rained for most of our stop. It did not stop us from having a great time and wanting to go back. I find the locals to be extraordinarily happy and friendly. Sorry your experience was not the same.