I think Rayleigh , but maybe he wasn't formally the WSS , he didn't have a black blade like past WSS ( Ryuma ) current
( Mihawk ) future ( Zoro )
i don't think Roger was a Swordsman , he held a gun , with his another arm that he also could've controlled Advanced Conqueror with , this is why i think Shanks is a Swordsman because he has 1 arm which he held Gryphon with , besides Mihawk challenged him anyway , why would Mihawk challenge someone who's not a Swordsman
( Mihawk ) future ( Zoro )
i don't think Roger was a Swordsman , he held a gun , with his another arm that he also could've controlled Advanced Conqueror with , this is why i think Shanks is a Swordsman because he has 1 arm which he held Gryphon with , besides Mihawk challenged him anyway , why would Mihawk challenge someone who's not a Swordsman