Unelected peer says it's often not worth hanging around the vote in the Lords