The man is 55 years old, of course he fucked.
How is that surprising? It's not that surprising that at some point in his life, he either got married or had a lover.
Even if Hibari isn't Akainu's daughter, I'm still pretty sure he has or had a wife or lover.