Jeff Vespa / 1 / 14
Jeff Vespa / 1 / 14

Nick Cannon never holds back in interviews -- but his wife, Mariah Carey, wishes he would. During an interview with shock jock Howard Stern on Wednesday, April 2, the "America's Got Talent" host said he got in trouble with Carey because of a different interview with Stern, in which the two talked about Cannon's past sexual conquests. 

"People feel like they can ask me anything, because I say anything. I'm brutally honest, and now my wife doesn't like when I come on your show!" he told Stern.

PHOTOS: Celebrity sex confessions

"She doesn't care when I talk about our sex life, because our sex life is amazing. She's one of the most beautiful women in the world," he continued of his superstar spouse, with whom he has two kids, twins Monroe and Moroccan, 2. "But...when we bring up -- I'm not gonna do it -- other people's names, she's like, 'Why would you even do that?'"

"Oh, the other people you've had sex with," Stern replied. "That drives a woman nuts."

"Absolutely, and I understand why, especially [for] a woman on the level of my wife," the 33-year-old "Me Sexy" rapper said. "So I got in a lot of trouble, and I gotta stop talking about my past."

PHOTOS: Mariah and Nick's love story

Stern claimed that Carey was most upset that Cannon talked about sleeping with Kim Kardashian. (Back in 2012, he said he dumped the reality star because she lied about her sex tape.) However, Cannon said that wasn't the case.

"You know, I don't think so, no. 'Cause honestly, my wife, she don't even know who Kim Kardashian is," the "Drumline" actor said. "She doesn't pay attention to that. I think it was more about the fact...[that I spent] time on my past. ... The most amazing sex I've ever had is with my wife."

PHOTOS: Hollywood's hottest married couples

The father-of-two also spoke with Stern about Carey's tendency to fire their kids' nannies "every other week." So what's the problem? "It's something about a woman and her know, the minute the child chooses to go to the nanny before they go to the mom -- I would have an issue with that, too," he explained.

"Everything's on a trial basis," Cannon added. "It's just like, hey, we're gonna see how this works out. And we're always traveling, so the nanny might not get a plane ticket to the next city," he joked, laughing.