Oda knows how to make SHs struggle or get clowned or nerfed.
He could have many ways to nerf luffy like sea stone cuffs.
And, we actually don't know how strong these seraphims are but one thing for sure that seraphims shouldn't be underestimated after all they replaced warlords like Boa, kuma, Doffy and Mihawk