"As if I'd want to settle things with a man with only one arm."
This line implies that the score wasn't settled between these two. If anything, it implies that Mihawk is lagging behind Shanks in wins and thats why he would be the one settling things.