Because Nobody gave a shit about Yamato's retarded hissy fits while Drake being a spy was a big deal that endangered the entire crew?
Everyone in the Beast Pirates treated Yamato like "Pretend it's not there" and Who's Who and Sasaki wouldn't listen to anyone but Kaido about getting involved with her