Hi, I have been there twice. The first time did not enjoy it so much ,but I think that it was because it felt intimidating due to the french language. What I learned is that if you at least try the people are more friendly. Say Bonjour instead of hello. They usually know that you don't speak french and will speak english, but at least it shows an attempt at their culture.
The second time we had a great time. We walked around town and then caught the ferry over to Pointe du Bout ( sounds like pointa day boo). A local told us about it. It is a short ferry ride 10-15 minutes. It is a beautiful pennisula with beaches, shops ,restaurants,etc. We spent the rest of the day there and it was great. The ferry dock is right in town. Be friendly and people will be friendly back. Have fun!!