I dont know, im not saying he should or shouldnt
Oda just seems to not highlight it so haa01 is right at minimum, Zoro doesn't feel some overwhelming sense of shame getting defeated by opponents he doesnt consider swordsman
Replace shame with the right word and same question remains.
? He wouldnt lose to sanji and has beaten non swordsmen before.
My point is - losing is a no-go for Zoro, doesnt matter if one is a swordsman or not.
He literally spelled it out in King fight, winning at all costs.
Once context is understood in Enel and Kizaru case, it is clear why defeat in those cases is not a loss in Zoro's mind.
Big Mom is a swordsman, she is 50% responsible for his defeat on rooftop and he still doesnt consider that a loss...