This is where I disagree I suppose, but it's not a problem. I won't necessarily be proven correct, but to me Luffy's opponents must be determined plot wise first, not CoC wise. Being a conqueror doesn't imply you are obliged to fight off another conqueror, it depends on circumstances.