Dude. Blackbeard brought with him two commanders (Vasco Shot and Devon) and they were both turned into stone. What are you talking about? Who are the "Blackbeard pirates" who would back up Blackbeard against Rayleigh? Rayleigh effectively had more man power with Amazon Lily and Hancock (who you call "traumatized" because it suits your bias, when even Blackbeard himself was hesitant to let her go acknowledging her power is troublesome), even the Marines and Seraphim were targeting Blackbeard.
I honestly am baffled. Blackbeard was alone with his only two commanders present turned into stone (not that those commanders would make a difference even if not petrified) and somehow you turned it into "Rayleigh would have to fight the entire blackbeard pirates while Hancock would be too traumatized to fight".