So there is the timelimit situation.
The WG and navy have 10 minutes until they can stop Vegapunk's broadcast.
Now the question is, are the other 4 Gorosei immediately summoned or is it a while until they truly arrive? If so, I can see Luffy fighting Kizaru and Saturn until they arrive.