As long as your child will wear a life vest and keep it on then it doesn't really matter how young they are.  We've taken our kids out canoe camping in the Boundary Waters and Quetico since they were babies.  Packing out diapers is a bummer but they loved sitting in the canoe watching the scenery go by and sleeping in the tent.

Happy Paddling,