There's concept of people genuinely being a good person but in wrong setting
Herald is just doing what he can to improve the well being of his country and race. He wants the giants to be treated just like the humans of the world. Not some demonic monster as those giants stereotypes.
That's why he's not joining Xebec and even willing to oppose him. Because he's reinforcing those harmful stereotypes.