KeySmasher
Farmhand
Case in point, you made it so that holding RMB no longer picks up the crab pots if the action started out as collecting from them. Lets shift all right-click actions into categories such that you are either collecting from machines (crab pots included), harvesting crops (which may use the scythe as needed), configuring an item (such as sign images and coop/barn animal door state), and shaking trees. This way, we don't run into an issue collecting jelly with a tool selected and accidentally changing a picture sign near by to hold the image of that tool. Releasing the RMB would allow a new action category to be initiated depending on the first use of the RMB when pressed again. I know of no actions that require holding the LMB so everything we do with that which doesn't involve a UI (like fishing) should still work as a single click and not require action categories.