I think this was one of the rare smart writing decisions post Time Skip.
Otherwise, the SHs would need to make a detour just to deliver Zoro to Mihawk so they can duel, and then move on from that island to their next adventure.
This way, Mihawk was incorporated into a crew that will sooner or later encounter the SHs so that Z vs M can happen semi-naturally.