A group of travellers have moved onto Ely rugby pitch, forcing a summer playscheme that was scheduled to take place there into King’s School.