Boris Johnson says people should focus less on 'symbols'