Using the training rod is a great start because it makes the green box bigger. It will get bigger with each level you gain for fishing (the training rod sets it to level 5).
Try fishing at the lake in front of the mine. It has some of the easiest fish in the game. Carps really don't move much so you can usually catch them without doing anything.
You only need to worry about the green box moving up and down. Each click on the controller moves it up a little bit, and while you don't click it moves down. You'll have to find a balance of clicking, don't hold the button down.
Once you get to level three, you can also make or buy crab pots. Place them in the ocean or any other body of water and put bait in, and then harvest then every day to get some fishing experience.
Once you reach level six, you can buy an iridium fishing rod where you can attach bait and a tackle. There are lots of tackles you can make and some make fishing a lot easier.