A scaled-down labour inspectorate will leave vulnerable workers at the mercy of ‘unscrupulous employers’