Tory minister suggests drop in overseas student numbers is down to 'uncertainty' with Brexit