Logically I'm with you but this is Oda dude. Logic is something that Oda has never heard of about.
This really isn't something Oda stumbles with man. Not forgetting plot points and making story points fit together logically is what makes usually makes One Piece as good as it is, and its why people like Oda as a writer. Its also why most of us still read it after all this time, because we are waiting for answers to things he consistently reminds us of and doesn't forget about (Will of D, Void Century, Vegapunk, Kuma, Dragon, One Piece, etc etc etc)
Now, there are plenty of things you can hate him for, namely oversexualization of female characters and characterization in general (Toki...), or just straight up missing the mark on certain plotlines or things that he does (like Luffy's PIS or random shonen powerups), but actual plot holes are not one of them. His worldbuilding might honestly be one of the best in the industry.
He's normally extremely good at keeping every plot point in check and addressing them by the end of an arc. Oden being here actually introduces something nobody even was expecting or wanted because never was implied to have survived or sent to the future.
This would actually be Oda's first major plot hole because its not really something you can logically explain. Oden tells her to send the scabbards 20 years into the future in his posthumous letter to her. Thats when she finds out about the prophecy (and then rips up the letter), after his death. So she logically woudn't have sent him to the future before this. It also has been explained that she can only send people forward too. And if its someone else with her fruit that knows how to use it better anyway, Oden would have been dead already to begin with. There literally is no decent way to explain him being alive.
Edit: And just to prove my point, Wano alone has made a ton of old connections to Punk Hazard. The Numbers. Vegapunks experimentation on Kaido to produce Momo's fruit. The man made Dragons. The Gigantification projects. He doesn't forget plot points or create significant plot holes in his series.
He even somehow has managed to fit Oden's flashback carefully in the timeline of Roger and Whitebeards own pasts this deep in the story. People really don't understand probably how hard it was for Oda to actually make sure all the timeline stuff worked in that flashback.