Yes they aren't identical situations, but you'll notice in your diagram that there is a downward force acting on the fish called "gravity", which is the point I was making - that gravity is acting on fish and humans regardless of what upward forces are also present.
In the second case, gravity acts on you even when you are going up, in fact it is what slows you down and then makes you start to fall.