That is a clever idea.  I have been using a separate mount for my Garmin unit and one for my fish finder.  I could probably get away with swapping them, which I had not considered.  My Garmin is currently rigged up with a similar clamp on system as yours, but my fish finder is rigged with a u bolt mount, not permanent, but it takes a bit more effort to remove.