What's wrong with looking a little rumpled?
A sport coat falls out eventually and you can pack so the shirt collars remain intact. Other than that, who cares? My Lands End/Target wardrobe looks fine after being stuffed in a bag.
The dresses my wife packs look fine, I guess. Granted her bag is just slightly smaller than her closet. Clothes from Tilley and Megellan pack particularly well. Think her duty black dress comes from them.
Stuff your clothes in a duffle bag and adopt a confident, casual, comfortable, well traveled (worn) up yours attitude.