Yes.
I would agree with this. In fact, I have made posts about this subject myself.
I will describe my own point of view on it as well. I'll just need to type it up.
Giants = high amounts of Haki (high willpower)
Dwarves = low amounts of Haki (low willpower)
Third Eye Tribe = Observation Haki Affinity: Sight Type (specialty willpower)
Snake Neck Tribe = Armament Haki Affinity: Neck Type (specialty willpower)
Long Arm Tribe = Armament Haki Affinity: Arm Type (specialty willpower)
Long Leg Tribe = Armament Haki Affinity: Leg Type (specialty willpower)
Fishmen Tribe = Environmental Haki Affinity: Sea Type (specialty willpower)
Mink Tribe = Environmental Haki Affinity: Land Type (specialty willpower)
Aviary Tribes = Environmental Haki Affinity: Sky Type (specialty willpower)
The berserkers can be put into there, too, but they're along the lines of a giant with rage.
Note: Previously, Luffy would turn tiny like a dwarf when he ran out of Gear 3rd, and during Gear 3rd he had Giant body parts.