Okay so let's lay this out
Tower A
- Control Room
- Communications
- Man Made Diamonds
- Artificial Humans
Luffy, Shaka, Atlas, Robin, Chopper were on Floor 2
Nami, Edison, Brooke on Floor 3
Zoro, Lucci, Kaku were in the control room
S-Hawk and S-Bear attacked this location
Tower B
Sanji, Jimbei, Stussy are here
No vegapunk in this tower
No Seraphim attack
Tower C
Franky, Ussop, Lilith, York, Pythagoras are here
S-snake took out York.
York
Lilith
Shaka
These 3 have directly attempted to command the seraphim and failed.
Assuming only the Vegapunk that gave the initial order can cancel said order, that would mean it's none of these 3.