Infact this point makes your argument worse. Against Kuma zoro had broken ribs and sustained damage from oars/moriah
And against oars he had a previous fight with ryuuma in which he extremely fatigued.
And against oars he had a previous fight with ryuuma in which he extremely fatigued.
To say nothing suggests he can only use it when he is at his limits from taking heavy damage is false.