Of course the biggest thing is physical condition rather than height/brawn but that was not your question. The only place I see a big advantage to height is when big steps are required.  Such as stepping over that log without unloading or walking in 2 foot deep spongy moss. On well established portages I don’t see any advantage to being tall.  In the canoe a shorter person would fit better and create a more stable load.