My husband is Canadian and I'm English. We disembarked Ruby Princess on a Weekend. We had a 10:00 am flight and had no issues whatsoever. It didn't take us any longer than anyone else. We did do self disembarkation though (Took our own bags off)
I can't see there being a problem with the time of your flight.