The gardens are lit at night and quite nice to view.
If you opted to have dinner on board, I would go and check out Government St, the Empress Hotel, the Legislative building. There are also a lot of really good restaurants if you want something different than the ship offers. There's a lot to do in Victoria.