I think a lot of people have a skewed perception of Boros because his fight in the anime is shortened.
In the manga, Saitama literally thinks “this is almost a real fight!” while going at it with Boros.
I honestly don’t see any of these guys going past mid diff with him.