So by the sounds of it Luffy was using only base and the second he goes G5, Gaban realizes he stands no chance
If he wasn't using ACoC while in base then it's truly over for Gaban, that ACoC-less base Luffy is like a YC3, YC2 at best, complete fodder tier