Good point.  Actually, one of the cardinal rules for backpackers canisters is to make sure there is no fabric or handle of any kind on it that would allow a bear to drag it away.  They are also made in a size that the bear can't pick up.  They will sometimes play a little "bear soccer" with them before they give up, though.

I try to avoid putting them near vertical drops or rivers for this reason.