You're not alone in feeling that way. I know people do it all the time and feel very comfortable with it, and for them it's great. My uncle and his wife have done it several times with their daughter and they are fine with it. But I can't do it. Not only do I not feel comfortable leaving them behind while I venture off into unknown territory, but I brought them along for a reason....I want them to experience new places and things with us. That's just me, like I said, I know that many people are fine with it. Do what makes you feel comfortable.