Affordable housing is vanishing. Are these landlords to blame?