I don't think the timeline quite works out for that.
I'm using this as a guide:
https://thelibraryofohara.com/the-one-piece-timeline/
Shanks is on Elbaph 14 years ago meeting with Scopper. That's the same year that Ginny was kidnapped. MAYBE Shanks just left Mariejois as Ginny got taken in. So, they might have passed by each other. But, I wouldn't count on that.
Shanks most likely left Mariejois a while before meeting up with Scopper on Elbaph. Note that he has his scars in this chapter. That means Blackbeard has already fought Shanks. Supposedly well before Blackbeard got his Devil Fruit, since that only happened 3 years ago. Artur puts this fight somewhere between 19 and 13 years ago.
One major sticking point in all this is if Shanks is allowed to come and go as he pleases in and out of Mariejois or not. They let him in for a while. But, we really don't know for how long. And once he choose to leave, I feel like they would have treated him like Doflamingo's family and not allowed him to come back.
So, I think the Shanks timeline works out to something like this (My estimations in bold):
1485 (39 Years Ago)-Shanks is born.
1486 (38 Years Ago)-A 1 year old Shanks is found by Roger.
Around 1486 to 1497 (38 to 27 Years Ago)-A 1 to 12 year old Shanks gets the straw hat from Roger. We've never actually seen the scene where Roger hands off the straw hat to Shanks. But, we see that Shanks has it during a flashback fighting with Buggy in Chapter 19.
1500 (24 Years Ago)-A 15 year old Shanks witnesses Roger's execution. He has a falling out with Buggy.
Around 1500-1502 (24 to 22 Years Ago)-Shanks likely returns to Marejois. Then leaves. This feels like the most natural point in his timeline to have tried to rejoin Mariejois. So, Shanks was likely only on Mariejois for 2 years over 20 years ago.
1502 (22 Years Ago)-A 17 year old Shanks recruits Yasopp.
1505 (19 Years Ago)-A 20 year old Shanks finds baby Uta.
Around 1505 to 1510 (19 to 14 Years Ago)-A 20-something Shanks gets his scars from a 20-something Blackbeard with no Devil Fruit. No exact date.
1510 (14 Years Ago)-A 25 year old Shanks meets with Scopper on Elbaph. He likely fights Loki after King Harald's death.
1511 (13 Years Ago)-A 26 year old Shanks steals the Gum-Gum Fruit from a Marine ship with Who's Who guarding it.
1512 (12 Years Ago)-A 27 year old Shanks leaves Uta behind on Elegia.
1512 (12 Years Ago)-A 27 year old Shanks loses the Gum-Gum Fruit when Luffy eats it. Shanks loses his arm. Shanks gives Luffy his straw hat.
1512 (12 Years Ago)-A 27 year old Shanks meets with Rayleigh and tells him about Luffy.
This is possibly the end of Shanks' "reunion tour" with the former Roger Pirates, which may have begun with talking with Scopper on Elbaph.
1518 (6 Years Ago)-A 33 year old Shanks becomes a Yonko.
Possibly as a result of imprisoning Loki around the same time.
1522 (2 Years Ago/Pre Time Skip)-A 37 year old Shanks meets with Whitebeard to talk about Ace going after Blackbeard.
There's actually only a fairly narrow amount of time where Shanks could have possibly been on Mariejois. Assuming he's not allowed to come and go as he pleases, at least in the "Celestial Dragon residential areas".
It's POSSIBLE that Shanks briefly met Ginny while meeting with the Gorosei or Garling and Shamrock. But, I don't know if we should count on that. Shanks is pretty busy stealing the Gum-Gum Fruit, hunting Loki, and raising Uta around that same timeframe. And Bonney is born the same year that Luffy eats the Gum-Gum Fruit. Ginny was captured 14 years ago, and Bonney was born 12 years ago. That's only a 2 year window. It's POSSIBLE that Shanks is able to travel all that distance, since he does seem to have access to some sort of fast travel system, if his fight with Kaido happening right before showing up on Marineford is any indication. But, it still feels pretty tight.
It feels pretty unlikely to me. But, I guess time will tell.
Now, as for Shanks knowing Ginny's "husband" and Kuma, that both seems pretty likely. Shanks does get around. I'm just not sure Shanks would have been in Mariejois at the exact 2 year window when Ginny was there.