Everyone literally needs to leave GV before it happens, not just Dragon.
We know from the Film Red Companion book that when Roger found Shanks, the island was still technically around as they left.
It is highly likely the only people left on the island were WG members anyway, not including Marines (i.e. Garp). At that point, it would only make sense to activate it.