The investigation is still ongoing as authorities have found inconsistencies in the story.
Ryan Lochte has been ordered by a Brazilian judge to hand over his passport as officials in Rio investigate his claim of a gunpoint robbery there.
The 32-year-old decorated swimmer and teammate James Feigen, 26, claim they were robbed by a gun-wielding assailant while returning to the Olympic village over the weekend.
Brazilian judge Keyla Blank declared that she wanted their passports seized Wednesday morning in the ongoing investigation. However, it has been reported that both swimmers have already flown back to America.
“The swim team moved out of the village after their competition ended, so we were not able to make the athletes available,” the U.S. Olympic Committee said in a statement.
The judge says the swimmers have inconsistencies in their report to police. Lochte allegedly said a group of men held them up while Feigen claimed it was just one man.
Read: Ryan Lochte Posts Pictures Showing His Bleached Hair Turning Green
Lochte, Feigen and two other swimmers, Gunnar Bentz and Jack Conger, claim they were held up and robbed of cash and personal items early Sunday morning while taking a taxi back to the Olympic village after a night on the town.
Police say they have not found any evidence of a crime.
Watch: Photo Finish! Runner Dives Head-First Across Finish Line to Take Olympic Gold