If it is a baby on formula then the best would be powdered and bring a case of bottled water on board for it, since even though the ships do very good at desalinization there probably would still be a bit too much salt to use the tap water. I'm sure that this is what at least some parents have done.
Caribbean Trip Reports
Star Princess 2005, Sun Princess 2005
Caribbean Princess 2006, MSC Lirica 2006 , NCL Pearl 2007, Majesty of the Seas 2008, Carnival Destiny 2008, MSC Lirica 2009, Carnival Valor 2009,Carnival Legend 2010, Carnival Liberty 2010,Carnival Fantsay 2011,Carnival Valor Feb 2012, MSC Poesia Dec 2012, MSC Poesia April 2013, Carnival Legend Nov 2013, MSC DIVINA Jan 2014, MSC Divina Oct 2014