Agents with the Hall County Sheriff's Office assigned to a Homeland Security Investigations task force found Milton Marshall, 40, at a home in Gainesville, 55 miles northeast of Atlanta, the sheriff's office said.
While carrying out a search warrant, they found 32 grams of cocaine, 42 grams of meth, 24 fentanyl tablets and marijuana.
The drugs were worth around $8,400, authorities said. In addition, agents found $1,255 in cash.
Marshall also had two loaded pistols on him, for which he will face weapons charges, the sheriff's office said. He is being held in Hall County jail.
He faces several drug and weapons charges, according to jail records.