Woolery, 62, and wife Teri Nelson, 47 -- granddaughter of Ozzie and Harriett -- have been separated for at least five weeks, according to Woolery. That means their separation has been longer than the four-week run so far of the reality series focusing on their family life.
Woolery said his wife first proposed back in early April that they separate for reasons she would not disclose.
"She said she needed to find herself - that's as far as she took it," he told The New York Post.
Woolery later hired a private investigator who reported "that she was spending an awful lot of time with a ski instructor who works on the mountain" near the family home in Park City, Utah, Woolery disclosed.
He cautioned that the investigator found no evidence of a physical relationship between the two.
In the meantime, Woolery says his home life has been shattered. He and his wife have two small sons - Sean, 7, and Michael, 13. Woolery is staying in Los Angeles while his wife remains in Park City.
"The family is pretty much wrecked at this point," says Woolery, who remains hopeful that his marriage can be repaired.
He insists he's not angry about the situation and feels nothing but love and concern for his estranged wife.
"My philosophy is, you can accomplish nothing with anger. You can only accomplish things through love and affection. I would like to have her back."
As for Naturally Stoned, two more episodes remain of the series initial six-episode run, although plans to commence filming on another flight of episodes has been suspended.