Good point mate, so you need to get atleast one number right? That would stop the AFK risk.
You could use a progress bar - which takes longer the less numbers you get, same fish cool down period applies. The more numbers you get the faster you reel in, meaning you get to the next fish faster.