Jack was already injured prior to fighting them after him and his crew defeated the entirety of the Sulong Minks, and then proceeded to fight Duke and Neko in his mammoth form for some god unknown reason. Would he have still lost if he was fresh, and using hybrid? Maybe, but it wouldn't have been anywhere near as easy.