Foreign Office minister Mark Field has come under fire after video footage showed him physically removing a climate change protester from a dinner at Mansion House.