Having 5-6 more chapters fight with them is a complete waste of time, if the fights end up being really quick like 3 chapters then I'm fine with this. You need to realize that we still have so many other fights to focus on such as Zoro vs King, Sanji vs Queen, Inu vs Jack, Neko vs Perospero, Killer vs Hawkins, X Drake vs Apoo, Raizo vs Fukurokuju, Kid and Law vs Big Mom, and the rematch fight against Kaido.
On top of all those fights we still need to see the four remaining Numbers, we need to see Orochi again, we need to see the rest of the BMP, we need to see Kaido's backstory, and finally we need to see Momo and Luffy going back to the roof of Onigashima.
Having a dozen more chapters focused on the rematch fights against the Tobi Roppo imo is a waste of time as there are so many other stuff that Oda needs to focus on, the only Tobi Roppo I have no problem seeing return is Who's Who, Sasaki, and Page One but mainly Page One.
You should also realize that some people want to see Oda move on and not drag this arc even longer.