I feel like if Hiyori's words weren't portrayed as inspiring and empowering (literally coinciding with/passed down to kids in school), I wouldn't mind as much.
It would simply be Wano people being awful and Luffy being neutral to such affairs after liberating another nation. Fine but Hiyori is making a "valiant" declaration after defeating her oppressor and stating he's inherently terrible for being a member of his family as though they weren't also persecuted. It's just baffling.
Oda can have characters hate and discriminate but some nuance would be nice like during Fishman Island with Fisher Tiger's dilemma and turmoil regarding humans.