From what I recall, the drinks are the same price as elsewhere on the ship, but they are huge. This is one place where the drink price is about right :-) The ice cream floats are about $3 or so.
BTW: JR's is packed! During normal meal times, expect to wait. It is fairly small, and very popular.