An IRS worker in Massachusetts whose behavior caught the attention of Homeland Security was wearing tinfoil on his head when police arrested him and seized his guns, The Lowell Sun reported Thursday.

A judge ordered 46-year-old Roland Moore to give up his weapons and comply with mental health treatment Wednesday, according to the newspaper. He had recently met with IRS officials and a psychiatrist to discuss his mental health issues, court documents show.

Moore reportedly wore tinfoil under his cap when he encountered Tewksbury police Wednesday. They got a warrant later in the day to search his home where they found the guns, according to the Sun. It added that Homeland Security officials discovered days earlier his firearms license had been suspended after he was arrested in a 2009 assault case.

His current status at the IRS is unclear. Moore is due back in court in January.