Kim Kardashian called the Christian worship service "sooo good!" on Twitter and shared footage of the 25-year-old pop star on her Instagram story as he joined the Sunday Service Choir for the first time.
"I never would have made it without you. I would have lost it all, but now I see how you were there for me," Bieber sang as those in attendance cheered, "I can say, 'I'm stronger, and wiser. I'm better, much better..'"
Bieber hopped off the stage and gave West a hug as the two smiled.
With the release of his latest album, "Changes," Bieber became the youngest person to ever achieve seven albums debuting at No. 1 on the Billboard 200 charts, beating Elvis Presley, who achieved it at 26 years old.
Bieber sang Sapp's gospel song in August while leading worship at Pastor Judah Smith's Churchome location in Los Angeles.
He's not the first celebrity to join the Sunday Service Choir for a song or two. Sia, Chance the Rapper, and many others have added bars or attended one of West's services, which have been held in Miami, Chicago, Salt Lake City and other cities.