The powers of the Gorosei don't seem to be a secret at all if random Marines give such an announcement like people not looking at Saturn. So they are essentially part of the scaling when talking about Yonko and admirals as the WG's highest military force. Especially since they are named warriors and are willing to step into battle.