I DO notice the Cruise Director, and whether or not he is personable or annoying. Most of them are OK, some stand out, and I still remember two particular Assistant Cruise Directors who were extremely annoying and obnoxious.
That goes for the CD's staff as well. Some of them have made my ship experience so much better for their efforts in Trivia and games, while others have been duds.
So yes, the Cruise Staff does make a difference to me!