I vote "worth it." Was initially reluctant too but now we do it at least once per voyage and no regrets.
As a personal observation, the experience can vary by ship. "Serenade" in Oct. was nowhere near as enjoyable as the dining we had on the "Radiance" the month prior. Still worth the cost for the fine dining tho.