Victims of alleged housing scheme are burning mad