Your masters were terrified of angering Kaido
Gorosei are politicians.
Kizaru was unfazed and asking Akainu if he should go to Wano with knowledge of Big Mom and Kaido being there.
Yonko are not untouchable.
Gorosei talking about not angering Kaido is Oda's cheap way to introduce politics into OP world.
If Marines wanted, they could jump each Yonko one after another.
No fucking Yonko stops 4 Admirals



