Pretty much. Its just so Imu can't intervene directly into any other arc and completely flip the table at some random point. Lol. After this he will definitely be at least out of commission for a while, so Oda can write without having to account for him pulling up.
As far as BB goes, there will 100% be a confrontation, just I highly doubt it will be soon. I've said this before, but in order for BB to take advantage of him being weakened post-Elbaf like some want, he would have had to write BB extremely out of character and launching an all or nothing final assault on Marie Jois......BEFORE the events of Elbaf even started. Despite BB having multiple plot threads that make more sense for him to be following up on, like using Garp as leverage to NEGOTIATE with the WG (like he wanted to do with Koby) or to hunt down the Ancient Weapons (which he was literally just about to learn about last time we saw him). It just doesn't make any sense for him to rush like that, with no way of knowing Imu would be vulnerable.
And even when their confrontation inevitably happens, I highly doubt it will be before other people have had a chance at Imu first, to wear him down (in true BB fashion). Also also, I don't believe for one second thwt Oda won't use the Empty Throne and the throne room itself as a set piece for at least the BEGINNING of a fight. Seriously, if you really think about it, does anyone believe that Oda would miss the chance to have Luffy barge into the throne room with Imu sitting atop it?