No.
Rayleigh didn't say haki is a power that
only in every single human being. He just say haki is a power that in every single human being.
It's a different thing.
And it's prove that "haki is a power that
only in every single human being" is clearly wrong when people can infuse his haki into
non-living thing like sword.
Then it destroy your argument. Your L.