It was never implied once that GV had anything to do with the Void Century or the lore of the series, yes it’s a big battle but not that different from your modern day Dressrosa, Enies Lobby, Alabasta and so on.
Unlike Luffy, who’s the main character, other pirates don’t constantly get into big fight events on a daily basis, so if Ennies Lobby were to happen in Roger’s era, it would be a big deal too