We know Koshiro was situated in East Blue at least 22 years ago, which is a year after Shusui was stolen from Wano. Maybe he left to go retrieve it? Or maybe because Wano was getting worse from the lost of Shusui, he left to raise his family in one of the founded villages of the Shimotsuki. Perhaps his wife was even pregnant with Kuina at the time.