That would actually a very cool way to see Victoria. I have been lucky enough to spend several days there.
Many ships just do a "technical" stop there with the dock miles away from downtown and they don't arrive until 6:00 PM (then the lines for the bus take 30 minutes.)
But if you ever get a day there it is a beautiful place with a lot to see.
I am the editor, but I also speculate, ask questions and play devil's advocate. I reserve the right to change my mind.