House of Lords member Robert Hayward said that "nobody" who succeeds Prime Minister Boris Johnson as Tory leader will seek to rejoin the European Union.