Perhaps(my though) he really is using it when people who give him a extrem battle, like other top tiers. He accept Luffy power and show him his power. Pretty sure he would not be that reckless against Primebeard or Roger,would try to dodge the attacks.
Against the Scabbards and Supernova he let him attack himself, he kinda allow it(you remember when he even legit scream to Luffy,Law and Kid to show their power). Kaido is a fight junkie,test and see it someone can give him a good battle.
And yeah, with or without the CP0 member,he was winning anways.
At top he could even have awakened power as trumpcard.