Ohh okay I get you now, yeah I agree all together they take him, but why would Law be worried about Jack finding out their identity when Hawkins, who he let go, ALREADY knows, and knew Luffy and Zoro identity long ago.
It makes more sense that because it is now a calamity coming, he is more worried, and he get's worried easily anyhow.