I don't ever begrudge anyone for taking any campsite regardless of whether or not the site is appropriately sized for their group.  They got there first.  That's all there is to it.  

I try not to camp near others, but if the best available site on the lake I choose to stay at is near another occupied site, so be it.  I pick my nightly destination lakes for a good reason so there's little chance I will move on unless there's simply no choice.

Whether solo or group, I don't travel with noisy people so I don't worry about me or my group disrupting the other at all with noise issues.  

Visually, it is what it is.  My mug is ugly and they'll just have to deal with it as best they can.  When they picked their site close to another campsite, they had to know that it was possible for the other site to get selected.  If having other campers within view offends them, then they did a poor job of campsite selection and that's their problem, not mine.