According to the 40-year-old, his wife Victoria Beckham "was pretty pleased" about his crowning, but he "would hope she'd think that anyway."
"Around the house, David is just David, not the Sexiest Man Alive!" she said. "He's a really good person. He's a really great dad, he's very kind, charitable and he inspires me every day."
To his four children -- sons Brooklyn, 16, Romeo, 13 and Cruz, 10, and 4-year-old daughter Harper -- he's just a dad though, so when they saw him on extra large billboards wearing nothing but underwear, "it kind of slightly embarrassed them at the time," he admitted.
"We kind of laughed about it with the boys," David told the magazine. "The boys kind of laughed at me and said, 'Really?! Sexiest man alive? Really'"
Brooklyn, who is also a model, did what most teenagers do and mocked his father.
"My oldest son Brooklyn was the one who was like, 'Are you sure it's not me that's meant to be there today?'" he joked.
"He didn't really believe it at first," David said. "But I've kind of been pushing it to him a little bit more just to let him know that's still up and running."
People's annual feature is now in it's 30th year and will be on newsstands starting Nov. 20.