Yeah, but they were genuinely panicking over lot of things, because they didn't have the power to do anything about them. They even started to search for Pluton to stop the Great Era of Pirates.
If they had been strong like someone here thinks, that would not make any sense. They could just move with Admiral and destroy Xebec, Roger or BB.
They may be figures, but they will be the Rev's enemies; in fact, in 6vs1 they couldn't even capture Sabo.