You can do as you wish. Stay on board or go ashore. It's up to you.
Staying on board can be a very enjoyable day. The pools aren't crowded nor are the restaurants. You can have a nice and relaxing day on the ship.
There are a couple of Caribbean ports that, if it's just my wife and I, that I just stay on the ship.