Fights aren't a 50/50 thing where it ends with both sides looking evenly matched. This isn't Ring of Honor.
Either Imu has to be weaker or Luffy does. But even then...is it so bad for him to actually fight with others for once? As I know people here complain he hogs the spotlight. Now here's something new.