Its a combination of:
1) the statement of superiority.
2)Shanks only using a sword in Film Red
3)The insanely high bounty
4)The fact that its higher then the leader of cross guild(meaning not inflated by man power, territory, or resources"
that put an end to any serious debate around Shanks vs Mihawk.