Concerns raised over jury removal plans