Former Bank of England governor: Brexit negotiations are "not going in the way that we might hope"