David Beckham said son Brooklyn raids his wardrobe, although "he doesn't think I am cool"

David Beckham took his Sexiest Man Alive tour home to London this week.

And in typical humble style, he joked he’s “really embarrassed and surprised” to win the PEOPLE honor.

Speaking on The Graham Norton Show, which airs Friday evening in the U.K., Beckham adds that eldest child Brooklyn Beckham, 16, was just as stunned – even if he is one of the few teenagers to feel comfortable wearing his old man’s clothes.

“He doesn’t think I am cool but he still raids my wardrobe,” says Beckham, who describes his eldest son’s reaction to the win as “Really?!”

Beckham, 40, started his reign in November, adding to an already impressive résumé that includes global superstar, soccer pro and devoted husband and father.

“It’s a huge honor,” Beckham, 40, told PEOPLE of scoring our 30th anniversary Sexiest Man crown. “And I’m very pleased to accept.”

And while his kids may still be in disbelief over his sex-symbol status, when he told the news to his wife, Victoria Beckham, she was totally on-board.

“I would hope that she feels this way about me all the time anyway!” he joked. “But she said, ‘Congratulations!’ “