So I don't know why Perospero would leave his crew behind like this. He probably didn't leave on good terms with them either. So I see no reason why he should do it alone. Why should the BM pirates just wait and do nothing anymore? They should just follow Perospero and come to Wano like they wanted to do....