He didnt allow them to fight the big guys early because they would out shine condom.
Now there are plenty fighters for everyone and condom will probably fight some god tier enemy. Even if we add Kid, Coby, Sabo, Law there is space to fit in Zoro and Sanji or even fucking Helmeppo lmao.
Space to fit them all in? No there isn't any.
You add Zoro and the Cook with Kidd, Coby, Sabo, and Law, you got 6. Heck, you got 7 if you add Luffy.
There are only 1 Fleet Admiral and 3 Admirals, total of 4. As we know, 7 is larger than 4, so it's Luffy, Law, Kidd, and Sabo. This means not all 7 of them will have this space you claim.
Same with the Gorosei. Just Luffy, Law, Kidd, Sabo, and Koby already make up the 5 to beat them. Again, not all 7 of them will have this space you claim.
And this without even bringing up Helmeppo.
I don't know where you got this idea about crew outshining Condom this or that. We ain't talking about outshinin' anybody.