Andrea Leadsom says it was made 'very clear' that Brexit might cost people their jobs