You mean when you're deemed mentally unfit? Then that should extend to 'at home'. With an individual who is of sound ability to own a gun goes outside with it illegally, then that is a calculated risk; allowing someone who has clear psychological issues to have a gun at home is not.
We cannot infringe on freedom in favour of "protection". It is nothing but authoritarianism. Besides, those who mean you harm will always find a way, weapon prohibition or no.