I'm from Victoria too.
We take our daugters down to Ogden point to gaze at the cruise ships on occasion when they are in town, either from the parking lot or from the Breakwater. The kids don't appreciate them as much as I do.
I remember taking a cruise out of Seattle and spending the night in Victoria a few years back. What a weird feeling to wake up in your home town, look out the window and see the sites you've grown up with all your life!
. Then to get off the ship and go home (to drop off goods we bought across the border ;-).
We are taking our first family cruise in March 2011.