I first started taking these trips with my brother in law. He liked to fish and so did I. Everything went ok, then my sons  came along one year. They love to fish too and were catching way more than my B-in-L. The weather was rough for a few days and towards the end of the trip he started in with unrelenting insults of my sons (in their face and getting very personal), focusing mostly on one of my sons. The other son defended his brother and so did I, then things deteriorated from there. We were actually considering leaving him with a canoe and the 3 of us would paddle out on our own in the other. But we sucked it up and finished the trip since he didn't really have much of a clue how to get out on his own and if he when he did make it out, he'd have no car to return home. Leaving him there by himself probably would have caused serious family problems on the wifes side. I've been going with one or both of my sons ever since, when they can make it. He has never been invited again.