In my Opinion this whole Numbers and Flying Six stuff is arranged otherwise than you mentioned.
I guess it is more like that:
1. Kaido
/ | \
2. King _______ 3. Queen _______ 4. Jack
/ | \
2.1 The Numbers_______________3.1 Flying Six __________________4.1 Gifters