Fuji was also massively restraining himself in Dressrosa, just sheer association with Ryokugyu neg diffing the characters he has should prove that (along with Aokiji negging Jozu and such), even a half serious Fujitora should’ve obliterated Luffy and Zoro at Dressrosa.
But the point of Fuji’s character is that he is a Tiger stalking in the bushes, not a raging bull like Ryokugyu who doesn’t pull his punches so to speak.
Like I said Ryokugyu has top tier CoA on top of pretty nasty root Hax so offensively he is top tier, but Fuji’s gravity and meteors and shit with no Haki involve massively outclass tree roots.