Updated

Kelsey and Kayte Grammer welcomed a healthy baby girl, Faith Evangeline Elisa Grammer Friday, the couple told Fox411.com in a statement. But the arrival of their brand new baby was also a bittersweet moment for the couple, who revealed that their daughter’s twin brother did not make it to full term.

“We are thrilled,” they said of Faith’s birth. “We were ecstatic earlier this year when we announced that Kayte was carrying twins. Tragically, we lost the little boy shortly thereafter,” the couple revealed.

“This was not something we cared to make known publicly at the time. It was unspeakably painful and we know that people will understand our desire to keep the news private then, as we know they will respect our privacy in this matter now.  A glorious birth with a lingering sadness is ours today.  We choose to celebrate the life that has been given us.  We proudly introduce our Faith to the world today looking forward to the days ahead and the children yet to come."

The couple married in February of 2011. This is their first child together.

They previously lost a child in the fall of 2010.

Kelsey Grammer is currently starring on Showtime’s “Boss.”