Hi there Maggieiam, when you say some caves, are you thinking of the Caves of Drach, if so they are about 40 miles away from the port of Palma & the journey would take over an hour each way - a bit of a risk.
They are certainly worth seeing, even if you are whisked around them at quite a rate, and the music recital down by the lake is wonderful - make sure you take one of the boat rides to the exit, they are just so peaceful.
If you are thinking of other caves, then let me know & I'll see if I can offer any advice.
Alan & Katrina
Last: Queen Victoria January 2016
Next: P&O Oriana X614 August 2016
Golden, Grand(2), Caribbean, Royal, Sea(4+1 aborted)
Adonia(4+2), Arcadia, Artemis(2), Aurora(5), Azura(2), Britannia, Oceana(3), Oriana(12), Ventura(2), Victoria(5)
QM2(2), QE2(9), QV(7), QE, Caronia(2), Minerva, Minerva II, Fred.Olsen(8), NCL Jade, =X= Eclipse, HAL Ryndam, Aza.Journey