Madonna has finally admitted to her issue with Lady Gaga.

In a candid new interview with Rolling Stone, the 56-year-old "Living for Love" singer explains her beef with the 28-year-old "Applause" singer, who recently charmed audiences with her surprisingly understated "The Sound of Music" tribute at the Oscars.

"The only time I ever criticized Lady Gaga was when I felt like she blatantly ripped off one of my songs," Madonna says bluntly. "It's got nothing to do with 'she's taking my crown' or 'she's in some space of mine.' She has her thing. I do think she's a very talented singer and songwriter. It was just that one issue."

Madonna is clearly referring to Gaga's hit "Born This Way," whose similar sound to "Express Yourself" is undeniable. Some suspected that her leaked song "Two Steps Behind Me" was a thinly veiled diss at Gaga, with the lyrics reading, "You're a copycat, Where is my royalty? You're a pretty girl, I'll give you that. But stealing my recipe, it's an ugly look." But her manager Guy Oseary denied the rumors in a Twitter Q&A last December.

PHOTOS: Madonna Is 56 and Not Showing It

More On This...

Madonna now claims she doesn't "care anymore" about the "boring" feud.

"I don't think she wants my crown ... We live in a world where people like to pit women against each other," she says. "And this is why I love the idea of embracing other females who are doing what I'm doing … "

But that's not the only musician Madonna gets candid about in the new interview. She also gives her thoughts on the always controversial Kanye West.

"I don't always agree with the things he says or does -- I don’t always like his music, even. But he's a beautiful mess," she comments. "I think he takes award shows too seriously. I never got too engaged with who wins awards or not, because I don’t honestly think it’s that important. ... Don't come to an award show looking for justice!”

NEWS: Madonna Crowns Taylor Swift a Princess of Pop

As for her new album, Rebel Heart, Madonna is still looking to be provocative with her 13th studio album.

"My nature is to provoke, that’s true. I can’t help myself," she explains. "But it’s always with good intentions. I think there probably was a time when I was less provocative. That’s when I was married [and] I don’t think my ex-husband approved of it. Or, maybe he didn’t understand it. I don’t think he understood my provocation."

Though she doesn't say his name, Madonna was married to director Guy Ritchie for eight years before splitting in 2008. She says her ex didn't approve of her infamous 2003 MTV Video Music Awards kiss with Britney Spears and Christina Aguilera.

"He was not a fan of me kissing Britney Spears onstage, for instance," she surprisingly reveals. "Was that provocative? I think it was. I mean, now it wouldn’t be. [But in marriage,] I think all of us make the mistake of thinking we're going to change people when we get together. But we’re not. People are who they are. And people change in their own time, you know?”

Rebel Heart is set to his shelves on March 6.