I also have a Kilroy for fishing locally. I'd never take it to the BW or Q.

As for canoe, we like to travel on those trips...so Kevlar or other lightweight is important. Carrying aluminum or royalex isn't much fun. If it was just you, I'd say solo all the way and probably paddle with a kayak paddle since you're used to it. Bell Magic, Wenonah advantage, and many more. How soon will you be taking the little ones on paddle trips? You could get a used solo for now and then in a few years you'll have a better idea if you like the solo or want to buy a bigger boat to include them.