From what we have actually seen, Rocks mostly targeted corrupt towns and just defended himself against opps like the marines. He has never been shown killing completely innocent people. Dudes like Whitebeard, Gloriosa, and Stussy also helped him “destroy a country” lol. Narrated crimes do not carry much weight, since the same sources claim Roger wiped out militaries over petty insults and even killed Squard’s crew.
The one time we saw Rocks attack a town, the context made it clear that the place was corrupt, and even then Xebec himself was not shown personally killing anyone. The worst thing he has done is beat up Loki, and even that came with the understanding that Loki was strong enough to take it and survive. The average World Government agent was shown to be more ruthless, and heartless than Xebec in the same chapter that narrated his “crew’s crimes”. Oda is not even being subtle in showing that contrast.