It would be even worse for that to happen with Usopp and Elbaf. Wano was never centralized as an arc required to move Zoros dream forward, like Elbaf has been for Usopp. We expected it with Zoro and Wano, because of the nature of Wano Country, and Zoros connection to characters from there. With Usopp, Oda has hammered it into the ground that Elbaf is detrimental to his dream. If he gets sidelined, then that would be unforgivable.