My thoughts:
Normally I'd say it's a toss up, as all of those top tier swordsmen rely on the same abilities to even be this strong in the first place. BUT...
there's likely something that made Roger more powerful than Rayleigh, the same guy who most likely is near that swordsman max aswell.
Same way Roger could handle Primebeard, whose portrayal shits on anyone and his abilities prolly aswell.
So imo we've roughly got three options:
1. The baseline:
It's a give or take scenario, where all have virtually the same abilities at max, but stuff like a black blade or a move like Ashura really makes the difference, ergo EoS Zoro + Mihawk > Rayleigh/Oden for sure and normally Roger aswell
2. There will be gradations in CoC power, as Roger and WB seemed to have unmatched ambition, means PK CoC could be > Yonk/Admiral CoC in a sense, whereas everyone besides guys like EoS Luffy, Primebeard and Roger fall under the second category, thus Roger > Rayleigh for example has an easy explanation.
3. There's more to CoC than still meets the eye. Perhaps a decent defense tech, which goes tough on certain DF abilities, thus Luffy's CoC spec and it's the reason to how Roger could handle Primebeard.
I think option1 as the baseline is definitely true and therefore EoS Zoro and Mihawk > Oden/Rayleigh, but Roger likely just had stronger CoC power (option 2) and imo there's still a CoC based defense tech coming (option 3) that counters those op AoE heavy s-class DF effects and environmental awakenings (Quakes, BM's homies, flowing mochi, ever white, parasite, admirals' awakening..), which would go hard on them, but not on guys like Roger, EoS Luffy (& Shanks), thus making him overall more powerful, especially cause he's also able to use the non touching CoC coat, thus rendering the extra durability from a black blade for example useless, as that supreme quality blade does not even make contact.
But that's obv a lot of headcanon and certainly only my personal opinion.