You took Oda's bait. The Fleet Admiral of the Marines cannot be a SWORD member, unless you are saying that the Fleet Admiral, by definition of the SWORD unit, has resigned from the command structure of the Marines to act on his own?
That being said, Akainu more or less still has command over SWORD.