If he was on the rooftop instead of Big Mom, Luffy would have beat him already. He’s weaker than the Admirals (with the exception of maybe Fujitora), which Luffy was near the same level as (probably on the same level really), when he first stood on the rooftop.