Seven years after winning a competition to become town crier of Chatteris, Lawrence Weetman has been asked to stand down.