I don't think anyone should leave anything behind.  It's a matter of respect imo.  All my stuff is in my control.  Either with me, or on my site, or the next load on the portage.

Respect for the land.  I don't leave anything for the wind & wave to turn into litter.

Respect for others.  In a wilderness area people are usually looking to enjoy what appears to be clear & clean vistas.  "Appears" because there are lots of places where 100yds from the shore is a clear-cut that can't be seen from the lake.