I can't accept it because once again, story doesn't portray Roger as a primarily swordsman. He has never been hinted at to be a swordsman before.
He has never been introduced as a swordsman. He was never mentioned to be the WSS despite clearly being the portrayed as the greatest pirate(PK) while only having Whitebeard as his equal. Luffy himself said the WSS needs to stay at the PK's side
So i just think people must sometimes try thinking outside of the box instead of labelling everyone they see holding a sword as a swordsman. I look more as an overall perspective, on what makes sense in Oda's story, how he portrays his characters than simply looking at who is holding a sword