Mihawk's vivre card says he was the WSS before Roger's death
Exactly, after losing his arm and realizing that he would never be able to beat Mihawk in that situation, he gives up the idea of being the strongest and seeks power in other ways, such as political influence, the literal definition of what an emperor is.