The Vice Admirals don't look fazed one bit, what an exaggeration in the full summary. Though I'm not gonna act like kicking the Gorosei out of their zoan states and sending them back isn't a huge deal, this might be linked to Imu, the Gorosei themselves looked unbothered. Almost seems like Imu being shaken up threw them all off. Imu is the one shaking and shit on the ground, it's possible this instability caused them to lose their link or w.e.