Post Office Minister clashes with families affected by the scandal