Maybe Harald decided to side with Rocks on GV and is the one who fought Garp if Oda plans for Roger vs Rocks to be a 1 vs 1? We saw Harald attacking a WG ship last chapter because they were holding slaves, maybe he did the same witnessing the hunting game.