I didn't notice this before but it looks like Sanji and Jinbei were somewhere else when Kizaru attacked the last couple of chapters.
One of them should have stayed with the weaklings and Vegapunk for protection.
I keep saying this and I know Oda doesn't want anyone interrupting his Luffy vs Kizaru jerk-fest, but this is lazy writing.