You are right. He doesn't show any interest in women and that's simply because he's too much into becoming a Top Tier in this verse. The man is so determined to become the WSS that he doesn't care about anything else, similar to Luffy in that aspect I'd say.
But, and this important here, in Zoro's case Oda shows us all the time how much of an alpha male he is everytime he has an interaction with women. He's cold and mean-ish towards them and that's exactly what drives women crazy.
And he doesn't even simp, mind you. No heart eyes, nosebleeds or fancy meals neither.
He's a natural born chick magnet.