Hi there Maggieiam, when you say some caves, are you thinking of the Caves of Drach, if so they are about 40 miles away from the port of Palma & the journey would take over an hour each way - a bit of a risk.
They are certainly worth seeing, even if you are whisked around them at quite a rate, and the music recital down by the lake is wonderful - make sure you take one of the boat rides to the exit, they are just so peaceful.
If you are thinking of other caves, then let me know & I'll see if I can offer any advice.
Alan & Katrina
Last Cruise: Queen Victoria November 2014
Next: Minerva April 2015
Golden, Grand(2), Caribbean, Sea(4+1 aborted)
Adonia(4+2), Arcadia, Artemis(2), Aurora(5), Azura(2), Oceana(3), Oriana(11), Ventura(2), Victoria(5)
QM2(2), QE2(9), QV(6), QE, Caronia(2), Minerva II, Fred.Olsen(8), NCL Jade, =X= Eclipse, HAL Ryndam, Aza.Journey