Thousands of lawyers set to desert Conservatives if Grayling stays