One asylum seeker who returned to the city said the premises in Crooksling was not fit for “animals”.
"There's no excuse for what the Government has done."
That's according to Baltinglass Cllr Gerry O' Neill, who said the Government was "wrong" to bus asylum seekers to Crooksling on the Kildare border.
He said locals are not in confrontation with refugees, but that a cohort of people turned up recently to start trouble.
He said conditions at the building are "not suitable for anyone".
"We have a beautiful site here, with over 40 acres of land. It was used as a facility for the sick and elderly of the area. It was a referral hospital from Naas."
He said what is happening at the site now is just "pure vandalism" by the Government.
A number of asylum seekers are back at a camp on Mount Street in Dublin after leaving the site.
Yesterday, the Department of Integration said around 130 people were staying in tents in Crooksling after they were moved over the weekend.
However, a number of others have returned to the city centre.
One asylum seeker who returned to the city said the premises in Crooksling was not fit for “animals”.
“On our first impression, we saw how miserable the situation was,” he said.
“It is not available to animals – we have nothing there."
“There is nothing there ready to use... we decided to go back to Dublin at once.”

Kildare Drugs Arrest
Man Arrested After €400,000 Worth Of Drugs Seized In Kildare
22 People Arrested For Driving Under The Influence Since Yesterday
Health Minister Meeting With Kill-Based Contractors BAM, Amidst Concerns Of Further Delays To New Children's Hospital
Relay For Life Officially Launched In Newbridge On Wednesday Night
Celbridge Facing 300+ Year Wait For New Homes Based On Current Building Rates
Kfm Obituary Notices
Much-Loved Clongowes Staff Member Fiona Doyle Retires After 22 Years