It does matter if you want to throw out what Katakuri himself viewed as an unfair advantage as a reason to why a fair fight between Luffy vs Katakuri would go down differently.
Luffy was drugged+stabbed, Katakuri was just stabbed, so Katakuri didn't properly even that up anyway.