Until now, the best course of action was maintaining the balance of power, however fragile it might have been. If Shanks went after Teach, even if he won, it would leave him vulnerable to another Yonko attack, creating a vicious cycle of power play that would've erupted into total chaos.