Brexit uncertainty will 'weigh on growth'