Vince Cable: Brexit voters long for 'a world where passports were blue, faces were white and the map was coloured imperial pink'