I have lived within 4 hours of Quebec City for 47 years and this is the first time I have ever gone north of Montreal. It was fun. I did notice a lot of empty places exactly where you did, however I can't compare it to a previous visit. For the record, we drove south to Quebec and not north, as we came back from NB around the top of Maine. What a long boring drive. HFS.
Bookmarks