Yeah but what did Roger really do? Xebec was the one who started everything. Without him and this Imu encounter, Roger probably wouldn’t have even begun searching for the One Piece. The other Yonko were likely inspired by the GV incident too, Big Mom/Kaido was also searching for the poneglyphs later on in their lives. Both she and Kaido also shared the goal of toppling the World Government.
Xebec set everything in motion. Roger can’t surpass him in either character or piracy. Strength-wise, he has like 4 other equals to boot lol. I know for damn sure that Oda will never have Roger beat Xebec, Garp or WB lol. He couldn’t be any clearer with Garp’s portrayal in this flashback. At this point, Roger’s just not that special anymore.