To be honest, the revelation that Naruto was Minato's son did some damage to some of the characters. Hiruzen in particular, who knew it all yet did little to help Naruto as he grew up. Though I understand, he was the Hokage and couldn't focus all his efforts on him, he could've still told an anbu to help raise him and even tell them that Naruto was Minato's kid as a way to make them more open about raising him. And considering he's a jinchuriki, it makes it more imperative.
I think this goes back to the fact the 4th Hokage was never intended to be Naruto's father, therefore Naruto wasn't to have some big shot father.
That said, Kakashi was pretty fair towards Naruto compared to others at the start. He didn't want Sakura or Sasuke to neglect him for who he was during their formative days, and encouraged teamwork among them. While he spent more time with Sasuke later on, that was because he and Sasuke knew what it meant to lose people you care for. Trying to lead Sasuke down a better path and not let hatred get the better of him. Plus Jiraiya specifically told him he'd look after Naruto and he should focus on Sasuke.