Luffy knows people the best and can even feel if they have bad intent as seen with Yamato - which is most likely connected to CoO. Zoro ofc can't, so he don't understand Luffy's decision.
What coincidence that the other person who also can feel peoples real intent and is specialized in CoO didn't disagree with Luffy's decision.