1. Hatchan wasn't even shown carrying Swords & he can fight Hand to Hand & also shoot Ink & yet he calls himself 2nd Strongest Swordsman in Fishmen Island
2. Mr.1 uses Devil Fruit instead of Sword & yet Zoro called him Swordsman
3. Hyouzou is Strongest Swordsman in Fishmen Island & yet he uses Poison
4. Ohm had a Dog to help him & his weapon change Form & he used Traps & yet he is a Swordsman
5. Cabaji is a Swordsman even though he uses lot of Tricks during Combat
6. Brook is not a Swordsman because he have other Powers thanks to his DF?
7. Shiryu is not Swordsman now because he can turn Invisible?
8. Fujitora is called Swordsman even though he have Gravity DF
9. Inurashi & his Musketeers are not Swordsmen because they have Sulong & Electro?
10. Kawamatsu is not a Swordsman because he can Sumo Wrestle too?
11. Kaku said he is a Swordsman even though he had a DF & Rokushiki
These are just few Examples, stop complicating things, anyone who "Rely" on Sword & Swordsmanship to fight is a Swordsman
Shanks, Cabaji, Hatchan, Law, Killer, Brook, Shiryu, Hyouzou, Cracker, Fujitora, Inurashi, Kawamatsu, Onigumo, Diamante, Smoothie, Streusen, Ohm, Kaku, Chaka & Pell ... etc are all Swordsmen
The Character who carry a Sword & aren't Swordsmen are Characters like Big Mom where Napoleon is just another Homie she uses similar to Zeus & Prometheus, she doesn't lose any of her power without Napoleon, she only loses some Versatility just like Kizaru who can create a Light Sword & Caesar with his Gas Sword .... etc