Onigashima is literally the only situation where Kaido switching off his COO makes no fucking sense, knowing both that there were foreign pirates in Wano looking to start up trouble, and having BM in his palace, whom, like he himself admitted, should never be trusted.
The party should've had Kaido paranoid and looking for threats actively.