Cap. He trained with the fruit longer than he has been without the fruit. So this so called disadvantage is gone. No need bringing it up. Now that he has perfect control of said recoil he naturally has more speed and stamina because of said fruit. He is lighter. Which means he is faster. He is also rubber which means he can condense and increase his muscle for stronger attacks on impact. Because he is rubber bullets and regular impact punches not assisted by haki or some other means cannot affect him. His elasticity gives him reach he would under no normal circumstance acquire. So there is zero comparison to a luffy with a fruit and luffy that would be stripped of his fruit. He would literally drop 3 to 4 tiers lower becuase he would not have the speed, the longevity in battle, the endurance nor the destructive capabilities he would have if not assisted with the fruit. Advance ryo/futuresight/COC won't make up the difference since he Is fighting people that has these things while still being stronger than him at these categories while also having devil fruit abilities of their own.
If you strip luffy right now of his devil fruit he is getting defeated by sanji. He losses speed (no g2 or g4) plus his base speed decreases. He loses reach (and has zero long ranged attacks besides using his fruit), loses the ability to semi fly (because of g4), loses longevity and endurance (was enhanced by the gomu gomu no me as stated), loses destruction ability (no gear 3 assisted punches, no fast gattlimg punches or red hawk punches since his rubbery body with haki enables him to use it. Hell even regular gomu gomu luffys punches increase because of him applying hardening to his rubber body thay causes vulcanization as stated by raliegh).