Conservative MP Owen Paterson claims that people on the tube are 'telling him to just get on with Brexit'