He said three staff have retired and around eight staff have left in the past 18 months.
OPW Minister Kevin Boxer Moran has claimed that OPW staff are being "bullied" at Castletown House.
He said he examined a letter given to him by staff members.
He said the letter handed to him outlined how staff feel and he "can't believe" some of the aspects staff highlighted.
He said staff said they are being filmed going to work or if they "go for a drink at night" they are being bullied or contacted and that they don't "feel safe".
He said three staff have retired and around eight staff have left in the past 18 months.
He said he has received a letter from the Irish Wheelchair Association outlining concerns about accessibilty on Lime Avenue.
He said "all OPW sites" are shared entry and "work extremely well".
Speaking on national radio, he said putting traffic control on the avenue at a cost of €10,000 per week is not "practical".

New Figures Reveal How Parts Of Kildare Rank Among Worst In State For GP Coverage
Tomorrow Marks 25 Years Since Naas Man Trevor Deely Went Missing As Gardai Issue Appeal
Rent Hike Fears For Students As Lawless’s Department Weighs Change Sought By Private Operators
Taxi Driver Protest Suspended Pending Outcome Of Talks
Lights Could Make Anti-Social Behaviour Worse: Council Says No To Security Lighting At Kilcock Playground
BREAKING: Green Light For €1.3bn Drainage Scheme Serving Kildare After Court Agreement
Kildare Man Nigel Cullen Awarded With National Bravery Award After Saving Young Man From House Fire
Council Diverts €17K Carbury Castle Resoration Funding To Christmas Lights - Maynooth Gets Lion's Share