Gabriel Albala, 45, of Margate, Fla. was ordered held without bond following an appearance in Fort Lauderdale federal court Friday..
The FBI interviewed Albala on Thursday morning before arresting him in the afternoon, according to FBI Miami.
Boynton Beach Chief of Police, Michael G. Gregory said in a statement that Albala had been relieved of duty following his arrest.
"This morning, agents from the Federal Bureau of Investigation interviewed a Boynton Beach Police Officer in regard to an ongoing federal investigation," Gregory said. "This afternoon, the officer was taken into federal custody and relieved of duty ... While this investigation has drawn scrutiny of this particular officer's conduct, it is not reflective of all the women and men who serve this community."
The FBI's Miami office did not respond to Fox News request for comment.
The South Florida Sun-Sentinel reported that Albala is accused of purchasing child pornography via the microblogging website Tumblr in September and October of last year. The transactions, which were done over Venmo, were described as innocuous purchases, such as "Textbook" and "Tutor."
The paper reported that Albala's next court appearance is set for Sept 4 and his arraignment is scheduled for Sept. 13.