WB didn't had a sword that's why he wasn't a swordman.
Shanks has only his sword. He is a swordsman.
Fujitora has a sword and a DF. But he is also a swordsman.
Big Mom is a gag but is a swordswoman.
Kizaru is debatable since his sword comes from his DF. But I would still consider him swordsman.
King was a swordsman.
Marco was a swordsman on cover pages and anything else but he didn't used a sword on his main manga panels. So I wouldn't consider him a swordsman.