I agree.
Whenever Zoro put his bandana on, the fight didn't really conclude until he won, whereas fights that happened without it could conclude either way without Zoro having to win:
Braham, Ryuma and Monet lost.
Kuma didn't.
Enel, Lucci, and Kizaru didn't.
Killer, Hawkins, and Apoo lost...