Iain Duncan Smith claims that 'the vast majority want to get out now even if they voted Remain'