Dominic Raab 'not worried' about losing seat in general election