Mihawk's story is pretty weird when I think about it.
He is currently at the peak, holding the World Strongest Swordsman title. Yet he acts like he is one retired grandpa, who used to have that title in the past. He lives alone in remote island, only with a bunch of monkeys, living as a farmer etc.
"But it's because he is THAT strong that nobody dares to challenge him anymore."
Except the story doesn't portray him that way. If that was the case, most swordsmen characters, including the ones in Wano, would either pissed his pants or acting like a fan boys with star eyes upon hearing his name. Yet we know that is not the case here.