Former boy band creator Lou Pearlman has finally been transferred to a federal penitentiary to serve his 25-year prison sentence.

The Federal Bureau of Prisons confirmed Pearlman was sent Tuesday to its facility in southeast Atlanta. The 54-year-old was being held at the Orange County Jail in Orlando while investigators and the defense worked through his complicated financial situation.

Pearlman pleaded guilty to four criminal counts in March and was sentenced in May. He has been ordered to pay nearly $300 million in restitution to banks and investors bilked in a decades-long scam.