I dunno what you're tagging me for, but if it's for an insult, that is not how that is intended. He doesn't actually hate you, he simply doesn't appreciate that you're unwilling to work as part of a team. His reaction is more of a informal way of suggesting that your current attitude to this is obtrusive. The way he's phrasing it clearly isn't coming from a place of anger.