Honestly, I wish he didn't have Haoshoku. It is a far greater achievement to become the best without being born with as great a Advantage as Haoshoku.
This thing of being born with all possible powers and destined for their deeds only takes the person's merit and is something for Luffy, who is the protagonist.
Garp and Roger who fought as equals, Garp without haoshoku only makes him more worthy and admirable character.