Iain Duncan Smith says EU leaders privately agree that migrants should not be given immediate access to the benefits system.