Tory minister says they 'only came to Government in December' despite being in power for the last 10 years