Gordon Brown says defeat in Brexit vote could oust May