People forget that the Holy Knights still are World Nobles, and that means they're still arrogant, lazy sociopaths. You'll get the occasional WN who has that spark of their ancestor like Shamrock or Doflamingo, but you can't tell me the majority of them ever suffered actual tough training.