“Judge Keyla Blanc De Cnop, the Special Court of the Fan and Major Events, ordered the dispatch of search warrants and seizure of passports of American swimmers Ryan Lochte and James Feigen,” the judge’s office confirmed in a statement to PEOPLE.
Subsequently, Lochte and Feigen are prohibited from leaving Brazil – but the 32-year-old 12-time Olympic medalist has already moved out of the Olympic athletes’ village.
The swimmer’s father, Steve Lochte, told the AP that his son arrived in the U.S. Tuesday – before the judge ordered the seizure of his passport. The Olympian also took to Snapchat on Tuesday to announce that he’s “back on U.S. soil.”
A source with the U.S. Team told PEOPLE that police went to the Olympic village early Wednesday morning to take the swimmers’ passports, but Lochte was already gone. In addition, police searched the now-vacant swim team’s rooms in the village, the source said.
“The entire swim team had moved out already, so they couldn’t take the passports,” the source said. “They don’t believe his version of events, so there will be an inquiry.”
The source continued, “This was the most high profile incident that has happened here in Brazil, so the government is really taking it seriously. The USOC is cooperating fully, of course, but they want to talk to Ryan. They’re not happy at all that this has given Rio a black eye, and they are vowing to get to the bottom of it. It’s a mess right now.”
Lochte told NBC that he and three other American swimmers were held up at gunpoint after robbers posing as police officers pulled them over in a taxi. Police have not been able to find their taxi driver or witnesses, however, and they say the swimmers were unable to provide key details in police interviews, according to the Associated Press.
The United States Olympic Committee previously confirmed that Lochte was robbed in a statement, but provided no additional details. Lochte’s lawyer, Jeff Ostrow, did not immediately return PEOPLE’s request for comment.
Ostrow told the AP that there was no doubt that the robbery happened and Lochte remained confined to his hotel room in the days since.
“It doesn’t behoove Ryan and anyone else to make up a story,” he said.