If you stay the night before in a hotel near the Old port of Qc city, you will at least be able to walk around Old Quebec which is fabulous. You will also be able to visit the Chateau Frontenac. If you want to see more of Qc city, you will need that extra day.