Dude what the fuck are you talking about? He is talking about troops not his personal strength.
"Getting stronger" is a weasel phrase. You could get 5% stronger, or you could get hundreds/thousands of times stronger. It is quite clear, if Kaido got stronger, it would only be slightly. He was already a grown ass man. He wasn't in Rox.