Roger's bloodline was feared so much that the World Government eradicated fucking pregnant women and babies in order to try and put a stop to it. That makes him by far and above the most feared person the WG has ever come across.
Imagine fearing a single man so badly, that you kill pregnant women and babies in hopes of stopping this man's bloodline.