We don't have enough information about who fought whom, but on the day after the battle, Big Mom is seen literally unscathed, with some random pirates who are members highlighting the fact that there were mutual confrontations between team members. Although Roger and Garp are strong, they were not highlighted as the main reason for the fall of the Rocks. It was always the mutual hatred between team members, the lack of cooperation among them, and possible betrayals.