'It's not a party, it's colleagues getting together': Tory MPs deny dinner with PM is 'party'