Judge is a really good character
At least i imagine him like a far more complex character, who still loves Sora, wrote the comic strip in which the hero has her name in her memory and, even if he wants to blame Sanji for Sora's death, he knows everything is his fault but, with the heaviness of his ancestors' dream on him, he can't accept to abandon his fate and be a complete loser, someone who lost even the only son capable of loving because of his foolishness
He is just full of regrets
Or perhaps Seth is right