Wait, if Kozaburo was actually a pirate, and if Zoro's from Wano, then it's possible he returned to Wano after Zoro's birth and smuggled him back to Shimotsuki village without anyone knowing it. I can totally see Yasuie being the one who saved the infant Zoro and helped him escape with Kozaburo.