To some extent it is, but I remember the same argument was used talking about Fujitora's sword : "if he had a great blade and a Saijo in particular, Zoro would have said something". We know how that turned out to be, mostly because Oda doesn't care.
Anyway, if I have to find a lifeline here, it's that none of the scrabbards could see Aramaki up close in human form.