One asylum seeker who returned to the city said the premises in Crooksling was not fit for “animals”.
"There's no excuse for what the Government has done."
That's according to Baltinglass Cllr Gerry O' Neill, who said the Government was "wrong" to bus asylum seekers to Crooksling on the Kildare border.
He said locals are not in confrontation with refugees, but that a cohort of people turned up recently to start trouble.
He said conditions at the building are "not suitable for anyone".
"We have a beautiful site here, with over 40 acres of land. It was used as a facility for the sick and elderly of the area. It was a referral hospital from Naas."
He said what is happening at the site now is just "pure vandalism" by the Government.
A number of asylum seekers are back at a camp on Mount Street in Dublin after leaving the site.
Yesterday, the Department of Integration said around 130 people were staying in tents in Crooksling after they were moved over the weekend.
However, a number of others have returned to the city centre.
One asylum seeker who returned to the city said the premises in Crooksling was not fit for “animals”.
“On our first impression, we saw how miserable the situation was,” he said.
“It is not available to animals – we have nothing there."
“There is nothing there ready to use... we decided to go back to Dublin at once.”

New Appeals System For Asylum Seekers Comes Into Effect
Bord Bia Review Published In Light Of Controversy Surrounding Brazilian Beef Importation
KCC Report Reveals North Vs South Divide In Kildare
Kildare TD Highlights Difficulties Faced By Wheelchair Users In Curragh School
"A Fall Every Week" : Mayor Of Naas Calls For Alterations To Kilcullen Road
Local TD Accepts Data Centres Are A "Particular Issue" In Ireland
Kildare Dog Shortlisted For Bravest Pet Award
Kildare Senior Football Team vs Kerry