Another thing: The fact that Oimo and Kashi call Gaban a legendary figure equal to Roger and Rayleigh at the same time as Gaban is getting ready to fight Luffy, reinforces the idea that it was a statement about power level
It's clear as day, they're saying Roger, Rayleigh and Gaban were equally powerful