You are good at imagination but wrong at maths.
If Imu can instantly snap 1 gorosei out of existence, it would only require 5 seconds to snap 5 goroseis out of his way. Now imagine zoro in place of that base nusjuro guy who he fought equally. 3 swords hell even 100 swords wont do any difference. There are levels...