Sounds like something is going on with your right controller joystick, it might be registering as only slight downward movement and so only showing up in games that are more sensitive to that.
First off, go to your system settings on your switch, scroll down to "controllers and sensors", and select "calibrate control sticks". Follow the instructions and it will basically reset what your switch reads as the "at rest" placement of your joystick, which it is currently reading as being pushed slightly downward.
Hopefully that fixes it, and if not, or it fixes it temporarily then starts up again, then that sounds like you've got "joycon drift", which is a known hardware issue, and you can google for resources on that.
(I do hope that it was only your first joycon that had the joystick issue and it just messed with the calibration reading on the second, making this a quick fix; it would suck if your replacement immediately had joycon drift.)
One other thing you can also check is to make sure that the base of the joystick is clean and there isn't anything physically causing it to stick downward, sometimes dust or sweat or whatever can congregate there and you gotta carefully clean it out.
Hope this helps!!