I would've loved if Oda had defined that the Raid Suit needs some kind of power source, and it needs to be recharged inside the can after using it for a while.
With this choice, it would make sense why Sanji can't use it right now, because he already used it going invisible, walking around inside the dome, and then saving Momo and getting hit by King. It would also make sense why he had to take it off for that group spread. It needs to recharge.
It would also make it a lot more fun of a power up, because it has a downside, it having a time limit. Just like G4 has a time limit and makes Luffy not able to use Haki, and how Enma keeps sucking Zoro's haki and can make him really tired really quickly.
But now, for all we know Sanji just decided to take off the suit because he doesn't like it, and now he's running from these women and getting captured a second time, without a trap this time, just because he doesn't want to use the suit.