Actually shanks (maybe some others yonkou fans), sanji fans, law and kidd fans, luffy fans all together.
Why because ? They don't want zoro to reach yonkou lvl because it's a shame for them. For others they don't want because they are not sure if they will ever reach that level. Simple.