Saul confirmed before that not all Giants come from Elbaf,
It would make perfect sense if there are many Giant Lands & They are all Connected somehow,
My guess would be Nine just like Nine Realms
Seeing how Thousand Sunny disappeared, it must be work of Bifrost Bridge-like Power,
It's likely that SHs were captured by Man With Burn Scar, his Whirlpools send people to those Nine Lands,
Making him this Arc's Heimdall and possibly it's Main Villain
Actually, in every Kingdom SHs Visited, there is always a Conflict between Rightful Ruler (Wapol, Cobra, Gan Fall, Neptune, Doffy ... etc) and Warrior who opposes this Ruler (Dalton, Koza, Wyper, Hody, Kyros, Kin'emon ... etc)
If Loki is gonna play the Role of Character who should inherit the Throne or keep it if He already did, then according to Norse Mythology & Ragnarok, Loki's Enemy is Heimdall
This Chapter's Sun God could possibly be One of Holy Knights, who when Dragon talked about them were drawn to have Nine Current Members (Not counting Garling who is like their Spandam), so it matches with Nine Realms & it makes perfect sense that guy in middle wants to rule Asgard-Equivalent in Elbaf as He is our man with burn scar/heimdall figure
As for why that Holy Knight is big, it has something to do with Elbaf, as the size of creatures there is always commented on, something or someone can make others grow in size (The idea was even suggested this very same Chapter) and Odin in Norse Myth should be capable of such feat