It's not that.
It's the fact you can even have one when really your meant to be a roving traveler traversing the wastes from settlement to settlement on your quest to find your father.
It's unnecessary, and dare I say it Oblivion-Like, even though yes I know it didn't have housing.