I fairly like this idea. It would stop Matty from coming and doing weird things. On a more serious note, it would be easier instead of kicking/banning everyone when a player only wants the housing to be private for a certain amount of time then unbanning everyone afterwards.
Even for a RP aspect, RPers notice when there are 15 people on someone's housing instantly when realistically, would have no idea who is where so by having this suggestion, it would be an improvement and help out.