Maybe just have a limit of everything (panning, fishing bubbles, forage, artifact spots etc.) to always at least being in range.
After reading all this, i decided to set the Deluxe Grabber Redux(Global setting) mod to also get panning spots.
I have seen some nearby panning spots i couldn't reach, while one that was 10-ish tiles away, and surely unreachable for fishing rod on lvl 10 Fishing, COULD be reached.
I just didn't know it was this common o_O So screw it, mod it is.
Would be more fun to be able to use my Pan, though. So hoping for an update to fix this thing, at some point.