Adam Levine has always been a ladies' man.

In the June issue of Details, the 33-year-old "Payphone" singer attempts to explain why he's romanced everyone from Jessica Simpson to Natalie Portman.

"There's two kinds of men: There are men who are f-cking misogynist pigs, and then there are men who just really love women, who think they're the most amazing people in the world. And that's me," Levine tells the magazine. "Maybe the reason I was promiscuous, and wanted to sleep with a lot of them, is that I love them so much."

PHOTOS: Hollywood's biggest flirts

Being linked to so many high-profile women might seem like a dream come true for some, but not Levine. "I've always felt a little misrepresented in the world," he says. "I felt like people only knew me as a singer who dated pretty girls. A little bit of a bimbo. Maybe I was kind of a bimbo."

PHOTOS: The Voice mentors, then and now

"I was the music dude that was naked all the time with the girls, and that's fine, no problem with that," he continues. "But I wanted to create a little balance. When The Voice came around, I thought, 'People now know that I have a brain.'"

VIDEO: Adam Levine and Christina Aguilera duet on The Voice

Levine -- who recently split with model Anne Vyalitsyna, his girlfriend of two years -- goes on to say that he's "fiercely independent but also terrified of being alone."

"I travel in a pack," the Maroon 5 frontman explains. "I like to be surrounded, not just with my boys, but with family, too."

And it's Levine's family who helped him become "capable of understanding women" in the first place.

VIDEO: Inside Adam Levine and Javier Colon's coaching sessions

"After my parents split, my mom moved in with her brother's ex-wife -- my aunt --who was also newly single," he tells Details. "So I was living in a house with two jilted women, plus my cousin, who's more like my sister, and my brother, Michael, who we eventually find out is gay. Just the estrogen alone . . . You know when you're 14 and terrified to talk to a girl? I didn't suffer much from that. It seemed very natural to me to talk to girls."

This article originally appeared on Adam Levine: "I Was Promiscuous" Because I Love Women "So Much"