He said he is not going to take easy on Yamato and he doesn't seem at all to went all out against Luffy. He was disappointed of Luffy for some reason, because he couldn't went all out.
It's obvious that he won't do it.
The same said Mihawk against Luffy and in the next chapter he was only testing him.
This is a WB vs Ace.