Neither Rayleigh nor Gaban can match Roger's fame, nobody can yet but plenty can match his power.
Shanks/Mihawk is tricky, so I wont go deeper into that one. But Gaban? Are you kidding me? You don't get compared to the GOAT just because some nobodies said something. Man has to build his CV over many portrayals/feats and chapters - then we can talk.