I guess he’s somewhere in elbaf, maybe in the opposite side of the island since it looks to be huge.
Maybe thats the reason why Oda is just focusing on a few places in elbaf. Right now the island feels empty so maybe Oda doesn’t want to show more of the island until later