I mean ignoring the fact that he made them aware of where Robin is(they kinda knew she's on the island they just didn't know where she is)
He Lured Robin into a trap she couldn't have survived without Brook being there, just look at her state after the fight, add it with Brook helping her with...