Kaido busted up his alliance, turned his best friend/first mate into a failed Devil Fruit user who has all the negative effects but none of the positive, jailed him, and had him tortured to have his spirit broken for who knows how many weeks. Not as heavy as Law's reasoning for wanting Doffy taken out, but a solid one for wanting revenge, none the less.