The top 4 (emperors) are the main contenders, those beneath are heavily involved for their own motives, meaning everyone in the list wants to shape the world in their own way, and their goals will intersect. Kuzan teamed up with Teach because he felt that it will benefit his own goals.
Meanwhile Mihawk has no goals or ambitions at all regarding supremacy or greatness..