iPhone player here.
When I first started playing, I had some trouble too, though by your description I feel as though you're having more trouble than I did. Or at least, you're more frustrated.
As others mentioned, you can get improved rods, tackle, and fishing buff foods. But at this point, I only ever break out the bobbers and food buffs when I'm going after the legendary fish now. I very seldom lose a "normal" fish anymore - maybe an occasional octopus, but that's about it.
I wonder if your technique may need tweaking. Thinking back to when I first started playing, I didn't fully understand the mechanics behind the minigame. For whatever reason, I used to think that each tap moved the bar up a set amount. So if I needed to move the bar a lot at once, I tapped the screen a bunch of times in rapid succession: tap tap tap tap tap tap tap tap tap. I think it was at least a year through my first farm that I realized that I could "hold" my tap to do move the bar more. But if you do that, you can be susceptible to the fish diving back down the meter and lose it if you don't release your tap quick enough. So I've found kind of a happy medium - about half-second pushes can give me a quicker rise in the meter, but enough flexibility to release the bar back downward if necessary. I use that most of the time, and mix in longer holds and quick taps as necessary.
And of course, persistence is key. Fishing is nowhere near as difficult as completing Prairie King, if you ask me. Keep at it, and good luck!