A Republican congressman who was confronted on the floor Friday night by House Democratic Leader Nancy Pelosi over his immigration comments told Fox News that the former speaker was "visibly shaken" during the encounter -- but said he's "not going to put up with this."

Pelosi lashed out at Rep. Tom Marino, R-Pa., after he accused Democrats of neglecting the immigration issue when they controlled the White House and Congress in 2009 and 2010.

She could be seen walking over to him and pointing her finger at him -- he later said Pelosi called him "insignificant."

Speaking to Fox News on Monday, Marino offered additional details.

"She came up to me wagging her finger and saying that I was a liar, a liar, and I simply said, 'No, I do my research -- I have my facts straight, perhaps you should try that,'"  he said.

Marino said Pelosi was trying to belittle him.

"I'm a former prosecutor ... and I've been threatened by drug dealers and organized crime and murderers, and this was a walk in the park," he said. "I'm not going to put up with this. I don't talk to people like this."

He added: "I'm having one of the wealthiest people in Congress say that I'm inconsequential and I'm not important."

After the two lawmakers' dust-up, the House voted late Friday on a Republican-authored $700 million package addressing the border crisis -- one that almost every Democrat opposed and that President Obama vowed to veto should it ever reach his desk.

Pelosi spokeswoman Evangeline George told The Hill after the confrontation that Pelosi "just wanted to remind the congressman that House Democrats had the courage to pass the DREAM Act -- and have the courage to stand up for what the American people want: bipartisan, comprehensive immigration reform."

She said that Pelosi accepted Marino's apology. A Marino staffer later denied that report.