A 93-year-old man, nicknamed 'the oldest gay in the village', has received an apology letter from the Home Office after being convicted of gross indecency with a man in 1974.