This is definitely true, really feels like Oda was setting something up with this but didn't follow through.
Another thing imo is this scene
I love this scene because it's an otherwise comedic side character calling Luffy out for what he did.
And while Luffy's cause is sympathetic Hannyabal is 100% justified and he also ends up being proven right when BB takes advantage of it.
Could've led to something really interesting, maybe even caused Luffy to question his dream of being a pirate after seeing what BB and his bunch were like imo.
Really shows how forced Oden was that Oda had to rewrite Luffy to react like that.