Some people are not smart. Some think that he doesnt use haki with his DJ.... dude, his leg is black, Oda cant draw haki on his leg when it is already black?
The only instance that for me, he didnt use haki was vs Vergo. Why? Because they barely got in the new world, they didnt knew how strong were the people there, Zoro even mocked Luffy for that reason.