Sarah Doukas, head of the Storm modeling agency (search), said Moss was considering leaving Britain after the furor spawned by photos in the Daily Mirror tabloid that appeared to show her snorting cocaine.
"She loves England. But I'm sure she's feeling concerned about living here again," Doukas was quoted as saying by The Times newspaper.
Doukas said Moss, 31, was "gutted, absolutely devastated" by the tabloid's story.
"I read it over the phone to her and the avalanche started almost immediately," Doukas was quoted as saying.
Moss, 31, lost contracts with H&M, Burberry and Chanel in the wake of the drug claims.
Doukas, who helped launch Moss's career after she spotted her in New York's John F. Kennedy International Airport when Moss was 14, said the model was continuing with her career and would soon sign a contract to represent a luxury perfume brand.
"She loves modeling — and she needs to be busy," Doukas said.