This is a RUSH transcript from "The O'Reilly Factor," May 29, 2013. This copy may not be in its final form and may be updated.
Watch "The O'Reilly Factor" weeknights at 8 p.m. and 11 p.m. ET!
BILL O'REILLY: With us now to discuss those situations is the former Republican vice presidential candidate, Congressman Paul Ryan. Let's start with the IRS because you're on the House Ways and Means Committee. So you're going to be investigating this.
REP. PAUL RYAN (R), WISCONSIN: Yes, that's right.
O'REILLY: All right, what's going to happen going forward.
RYAN: Ok there are four things we know right now. Number one we know that they targeted people based on their political beliefs not just Tea Party groups but religious groups as well that were conservative in nature.
Number two, we know that they were intimidating and harassing donors to these conservative groups.
Number three, we know that the IRS leaked sensitive taxpayer information which was then used publicly to harass donors.
And number four we already know that the IRS mislead Congress.
O'REILLY: All right. But you don't know who exactly did it -- that's what you've got to find out.
RYAN: So our investigators started last week interviewing and doing depositions. So our investigators are interviewing low level IRS employees. We are working our way through the system.
RYAN: And we're starting to get the documents. We've requested thousands and thousands of documents which are now starting to come to the Ways and Means Committee and we're starting to pore through those documents.
O'REILLY: So they have to give you those documents.
RYAN: They have to give us those documents. We will subpoena them if they don't.
RYAN: So we will get those documents.
O'REILLY: But if they defy you -- I think people need -- people need to know the parameters. Number one if they lie to your committee that's a federal crime, right?
RYAN: That's right. That's right.
O'REILLY: Number two if they don't hand over -- they being the IRS the Internal Revenue Service the documents -- that you want that's a crime, right.
RYAN: And we'll subpoena them in that case if they don't.
O'REILLY: Ok but when you say we'll subpoena them they can say well, we're not going to do it anyway. That's happened before then they can be charged with a crime.
RYAN: That's correct.
O'REILLY: Ok so you have a criminal capability here.
RYAN: That's right.
O'REILLY: Now you are thoroughly convinced this is just not a Cincinnati deal or a couple of rogue IRS people going --
RYAN: No, that's pretty clear.
RYAN: It's pretty clear that it's more systematic from that.
O'REILLY: So you've got to find out whether it was just contained in the IRS, all right, and this Lois Lerner she's a big player her and she's gone. Or it was ordered from the White House, I mean basically that -- that's what you've got to find out.
RYAN: Yes we don't know the answer to that so we're going to let the facts take us there. We're not going to speculate.
O'REILLY: As you should. As you should.
RYAN: We're going to do our job.
RYAN: The legislator branch overseeing the executive branch. This is an arrogant abuse of power. It's really quite --