VP said in this chapter that he doesnt know who was right or not, which means the CDs who are murderers, slave owners and rapists will be on Luffys side when its all set and done.
What a conclusion to jump to lol.
What Vegapunk said echoes what Rayleigh said about the strawhats maybe coming to a different conclusion. Clearly the story told by the Poneglyphs presents some kind of conundrum. But what if it's not a moral one like you assume?
@Moewu made a great connection earlier - Dory and Brogy. They just came back into the story, and like Joyboy and Imu their fight has been going on for centuries, with the origins of it forgotten. It turns out what they're fighting over is not a moral conflict but something very trivial: Which one of them is bigger. This matches lots of rivalries in the series; Luffy and Blackbeard first disagree over cherry pies. Buggy and Shanks fight over which Pole is the coldest. So what if Joyboy and Imu's "conflicting ideas" that they fought over were similarly trivial? What if it's so dumb only Luffy would have the answer? What if that answer is the childish dream that made Shanks cry?
THINK!