Keir Starmer defends Labour’s refusal to vote for single market, insisting battle could not be won