Minister of State for External Affairs V Muraleedharan has said that urban naxals, anarchists and atheists are going to the Sabarimala temple in guise of devotees.