Tory minister suggests Christmas quiz wasn't party because there was 'no alcohol'