In my opinion the journey would only feel "complete" if the crew goes to Lodestar somehow. Unlike Elbaf, there isn't any plotlines connecting to Lodestar right now. And since he doesn't seem to be at Elbaf considering that he isn't with Shanks, I'm gonna go out on a limb and say the crew will encounter him at Lodestar