I dunno, we're really veering into plot convenient incompetence if the Holy Knights have been able to teleport around this whole time as well. At that point you'd have Imu, the Gorosei with their busted abilities and the Holy Knights who seem to have AT LEAST two Top Tiers in Garling and his son.
Why have the events of the story even transpired if this is what they've had all alongm