Updated

This is a RUSH transcript from "The O'Reilly Factor," May 14, 2015. This copy may not be in its final form and may be updated.
Watch "The O'Reilly Factor" weeknights at 8 p.m. and 11 p.m. ET!

O'REILLY: Continuing now with our lead story: distorting the record on poverty off President Obama's remarks about Fox News. With us, the author of the brand new book, big hit -- My Journey with Maya" very good read. Mr. Tavis Smiley. You heard Bernie and I, go.

TAVIS SMILEY, AUTHOR, "MY JOURNEY WITH MAYA": First of all, there are many of us who have been trying to get this president to talk about poverty for years now. So one I'm just glad to see the President finally talking about poverty, saying the p word. Not just income inequality, not just the middle class but poverty. So one, I'm glad to hear him say that.

Number two there is no doubt about the data, Bill. Two parents are better than one. Let me underscore -- the right two parents. You all talk about the black family as if it just collapsed like a sort of souffle. There are reasons for the dissolution of the black family. Clearly some folk make bad choices but there have also been government policies that have gotten in the way.

For example, there have been policies on the books for years where if you have your baby daddy in the house with you, then the government cuts your check. They cut those resources, but I thought we wanted the family to come together so there have been government programs that have led to this dissolution as well as bad choices.

O'REILLY: Ok. But that is public policy. I'm big on the personal thing.

SMILEY: Sure.

O'REILLY: Because I'm a former high school teacher. I taught a lot of black kids, all right? I saw the ones with involved parents prosper while the ones with parents who didn't give a fig go down. And so I want to declare a war on irresponsible parents.

You are right about the government policy. But take that out of it, for example. If you have two parents, even if they don't have much money, who are just hell bent on getting their kid educated, he does his homework, he is respectful, this, and that. That child is not going to be in poverty, come on.

SMILEY: I had two parents and I grew up in poverty. I had brothers and sisters. I am one of 10 kids. I have been blessed to do extremely well. But I have nine brothers and sisters who are still fighting their way out of poverty. Just because you grew up in a family two parents doesn't mean that you don't have to struggle in this world because racism is real. Discrimination is real. These gaps, these disparities between black and white economically are real.

O'REILLY: All right. I want to go to another topic.

There is a woman Cynthia Tucker, very far left woman who attacks Dr. Ben Carson and she says, quote, "The good doctor's foray into Republican presidential politics threatens to become his epitaph to overshadow perhaps even overwhelm his academic and surgical accomplishments. He will likely to be remembered as the GOP's latest black mascot, a court jester, a minstrel show." He'll be the Herman Caine of 2016 because she doesn't like Dr. Carson's opinion on Obamacare.

SMILEY: Why is Cynthia Tucker using your word attacking Ben Carson but Ben Carson wasn't attacking the President?

O'REILLY: I don't know about that.

SMILEY: Oh, come on, Bill. Stop that. You heard the comments that Ben Carson made about the President. He has done it repeatedly and he's done it to Republican applause when he attacks the President.

O'REILLY: You don't justify bad behavior by pointing to other bad behavior.

SMILEY: I'm not justifying. I'm just asking you a question.

O'REILLY: He attacked Obamacare.

SMILEY: She attacked Ben Carson but you don't say that Ben Carson attacked the President.

O'REILLY: Did Ben Carson use any racially loaded terms? No. This is a racially-loaded deal.

SMILEY: You are smarter than that the fact that you don't use a racially-tinged term doesn't mean you are not attacking.

O'REILLY: You are deflecting a well-known talker's racism.

SMILEY: You are deflecting from the attack that Ben Carson --

O'REILLY: It was on Obamacare.

SMILEY: It wasn't just on Obamacare.

O'REILLY: It was on Obamacare -- this is what's rolled this.

SMILEY: It's on the President. Here is the bottom line on Ben Carson -- I won't use his language, that her language. Here is my assessment. Ben Carson has been respected and revered. Not just respected but revered, admired in black America for years for his gifted hands that he still possesses. But Ben Carson is, how might I put this is he a black bull in a Republican China shop. And if he's not careful, he's going to do himself irreparable damage. He's going to do the Party damage and I were a person in his face who professed to love Ben Carson I'd call for an intervention to stop him from doing what he's doing to himself and his reputation.

O'REILLY: Be that as it may, this is a racial attack on Dr. Carson because this woman holds a different opinion on Obamacare than he does. This is wrong. This is wrong.

SMILEY: You invited me earlier to read the entire piece that you did about LBJ and poverty.

O'REILLY: I read the entire piece ten times.

SMILEY: In this piece she makes it clear that he has been respected for years and she doesn't like the idea that he will allow himself to be a token at the risk of his reputation for the party.

O'REILLY: Last question. Last question.

SMILEY: Yes.

O'REILLY: If a white person had written these words against Dr. Ben Carson or any other African-American, that person would be out of business.

SMILEY: One, it happens every day. Number two, it's not in my language. Number three, Ben Carson has to be careful that what he does doesn't invite that same kind of attack on him.

O'REILLY: I think he can speak his mind. But this was off the chart.

SMILEY: He ought to be stick to neurosurgery though. Politics is not his game.

O'REILLY: That's your opinion.

SMILEY: You have got to know the issues.

O'REILLY: That's your opinion.

SMILEY: You have got to know the issues.

O'REILLY: Tavis Smiley, everybody.

Content and Programming Copyright 2015 Fox News Network, LLC. ALL RIGHTS RESERVED. Copyright 2015 CQ-Roll Call, Inc. All materials herein are protected by United States copyright law and may not be reproduced, distributed, transmitted, displayed, published or broadcast without the prior written permission of CQ-Roll Call. You may not alter or remove any trademark, copyright or other notice from copies of the content.