Jonathan Ashworth: 'We're in negotiations with the prime minister. They're not getting very far… the prime minister isn't prepared to compromise'