It wasn't hostile towards the straw hats and giants, just like Shanks' Haki wasn't hostile towards the scabbards and Momo. And how exactly is it an L for Shanks that Pirate Jesus' Haki was greater? Fraudhawk isn't even relevant in this discussion.
Also, TCB =/= Viz. Not that it matters though.