He
literally said no such thing.
Nowhere in Kaido's mind is he fathoming losing in a 1vs1 or a group battle against anyone here.
He said he wouldn't go of his own free will.
Luffy beating him, Luffy's army destroying Kaido's army, and liberating Wano fully/ destroying Kaido's factories will make Kaido's further plans completely untennable, unless you think Kaido has time as a 50 year old to rebuild from scratch something that literally took him 20 years to build, after losing everything... to try to compete with someone who is 19 , who will have beaten him 1vs1, who has a better growth rate, with a better army, with Nico Robin and the majority of the poneglyphs.
Kaido for pirate King in 2041