In JKK, human with no curse energy is granted physical strength. In OP, the only drawback is just about swimming, which seems irrelevant.
Should OP grant something for non devil fruit users. e.g. they can unlock special type of Haki. What do you think?