That's definitely not how team Zoro defines a swordsman. The core of the argument has always been "If someone fights with a sword predominantly, then he's a swordsman." They never actually called someone a swordsman solely because they carry a sword around. As a matter of fact, almost no one calls Kizaru a swordsman despite his skills. The number of people who call Big Mom a swordsman is almost nonexistent.
Now, there are times when people use the point of someone always carrying a sword as a reason to justify someone as a swordsman. But it's usually one of many reasons they use to prove their point, and never the sole reason for calling someone a swordsman.
Fujitora, for example, is called swordsman because:
- He is called a blind swordsman in the official materials.
- His character is based on a famous swordsman.
- He always channels his attacks via his sword and named his fighting style after his sword.
- And of course, he always carries his sword with him.
As you can see, it's one of many reasons people use to justify the fact that he is a swordsman. But hates being haters, only focus on the weakest arguments that Z-gang makes and use them as a weapon to denigrate the entire argument.
The recent revelations change absolutely nothing in regards to the swordsman arguments. Yes, you can't call someone a swordsman just because he carries a sword around or because he uses it in combat. The way of the sword must be his/her primary method of fighting for someone to be referred to as a swordsman.