Fujitora literally allowed Luffy to recover 3 days before chasing him and then regretted blinding himself because he wants to see Luffy's kind face, why would he neg him when he obviously wants the kid to live from the first chapter of dressrosa?
Wujitora's only weakness is being too kind and considerate, this is why you brute yankers keep the downplay while he has been restraining himself. Cowards