Retz has seen the growth in demand for homes first-hand as a builder. But he said affordability is putting a cap on it.