Again, that's why I sail on Celebrity. We may lose the poopy diaper crowd, but we gain the adult crowd!
As far as cruising with your children, most of the kids are in the children's groups all day. That's not spending time with them.
The kid at 2 or 3 years old remembers NOTHING about the vacation. I used to live in Orlando and the poor little tiny kids that got dragged thru the heat at Disney World screaming, crying or asleep would make your skin crawl! There are alot of great vacations that would be more appropriate for an infant or toddler than a cruise.