Confidence in housing market wanes significantly