You know, Wano opened with Luffy being sucked into a whirlpool.
Maybe Elbaph has underwater cave systems Kidd and his crew got sucked into? Caves too small for giants to fit into or get stuck in, but that normal size humans could end up in.
I've made a lot of theories about Kidd being below the underworld. Maybe he got there from the ocean.