“People would go to quite extreme lengths to get into our personal space or to our underpants,” the pop-rock icon – currently on tour with Duran Duran for the Paper Gods tour – tells PEOPLE.
Case in point?
“It was in a hotel in Japan, and I don’t know how it happened, but a girl was in my closet when I checked in,” Le Bon, 57, recalls with a laugh. “I was slightly frantic. I guess she must have known at the hotel – it was definitely an inside job.”
For more on Simon Le Bon and Duran Duran, pick up the new issue of PEOPLE, on newsstands everywhere Friday.
The Japanese incident wasn’t the only time Duran Duran die-hards were on the prowl overseas.
“I remember walking into the dressing room in Italy, and we [had] stuff laid out on the table – drinks and sandwiches – and there was a tablecloth on it,” Le Bon says.
All of a sudden, “there was some giggling coming from underneath: We lifted up the tablecloth, and there were some girls there, and they had forged their passes and everything. They were amazing.”
RELATED VIDEO: VIDEO: Madonna Surprises Fans With an Intimate Street Performance
Now 14 albums into their career, Le Bon and the Duran Duran crew clearly still got it.
“Fans are still trying to find out where we’re staying!” Le Bon says of their Paper Gods tour groupies.
For a complete list of Paper Gods tour dates, click here.