Windows Game runs poorly, Only on stardew valley

Skipy2004

Newcomer
For some reason, my Stardew Valley drops down to 20 fps and runs very choppy. This only happens on Stardew Valley and I can't seem to find a resolution, I've tried everything online and nothing helps. I was able to play smoothly after a day of waiting hoping it would fix, but then like 2 hours later it got down to 20 fps again and everything went downhill from there. I'd like to know how to exactly fix it if there is a way so it doesn't happen again and so I can play.
Pictures below show FPS differences in games (FPS in the top left)
 

Attachments

Top