Either way, Zoro is implying that it is even more out of Mihawk's character to not follow someone like Buggy than someone like Crocodile, who himself did not back down from even Whitebeard. If you wanna try to argue that Crocodile & Mihawk are on the same level, then be my guest