pirates cove fishing bug

I (yes I'm slow) just figured out how to get to pirates cove. I decided to do some fishing while waiting for the pirates to show up. They showed up at 8 p.m. (while I was reeling in a fish) and kicked me out of the cave. I was still reeling in the fish on the outside of the cave with no pole...