New Jersey's wayward dolphins won't be removed from two rivers near the Jersey shore.

A federal wildlife agency reached that decision Friday in the case of a pod of bottlenose dolphins that took a wrong turn in June and ended up in the Shrewsbury and Navesink rivers.

Two dolphins have died so far, and concern is growing among animal rescuers that the rest could die as well if they're not removed.

The leader of one such group says leaving the 12 remaining animals there is tantamount to letting them all die.

"We're already at 20 percent mortality with this group," said Bob Schoelkopf, co-director of the Marine Mammal Stranding Center in Brigantine. "What happens when it hits 50 percent? According to them, nothing.

• Click here to visit FOXNews.com's Natural Science Center.

"They say people need to be educated that this is something that happens to animals sometimes — they die," Schoelkopf added.

The National Oceanic and Atmospheric Administration says it has been monitoring the dolphins for the past two weeks and feels they are fine.

"They are not in any distress, there's still prey in the river, they are still acting and behaving as normal dolphins," said Teri Rowles, director of the agency's National Marine Mammal Health and Stranding Program. "We're not going to interfere in what appears to be a completely natural phenomenon, especially when doing so carries a high risk of harming healthy animals.

"To do an intervention is risky for the dolphins," she said. "We could kill dolphins if we intervened at this time."

She said the only way authorities will intervene to try to move the dolphins is if they strand themselves on land or in very shallow water.

The agency noted that other dolphins ventured into the river in 1993 and 2000.

"NOAA did try to move them," the agency wrote in a press release. "In both cases, all the animals perished."

But Schoelkopf said that's because the agency waited far too long to get involved. He has been calling for intervention since the beginning of July. In the 1993 case, the dolphins died after getting trapped under ice.

Larry Hansen, the chief bottlenose dolphin researcher at the agency's Southeast Fisheries Science Center in Beaufort, N.C., said dolphins are intelligent animals that pass on accumulated knowledge to successive generations.

"Dolphins need to learn to get out of that river on a regular basis," he said. "They're probably going to go back into that river next year and the year after that. They need to learn to do this. Whether this group does that or not, eventually, another group will and they will pass that on."

Hansen said 16 dolphins were counted during the summer at the height of their population. Two have died and 12 remain. The other two may have found their way out of the river on their own, he said, adding it is unlikely they stranded themselves and died but have not yet been discovered in the heavily populated area.

Earlier this month, federal officials drew up contingency plans to an intervention, including trying to either coax or scare the dolphins out of the rivers and out to the open ocean.

The agency had considering using a U-shaped flotilla of boats to try to herd the dolphins out of the river and back out to sea, or using recorded "socialization sounds" of other dolphins to try to lure them from the river into Sandy Hook Bay and ultimately the ocean.

Part of the proposal to herd the dolphins out of the rivers would involve playing loud or unpleasant noises underwater and creating a "visual barrier" such as a curtain of air bubbles in the water to try to guide the dolphins in a particular direction.

But Katie Touhey, who manages stranding responses for the Cape Cod Stranding Network in Massachusetts, said neither of those is likely to work.

"Based on our experiences, herding is unlikely to be effective here given the small number of animals and the distance to the ocean," she said. It is about eight miles from where the dolphins are now to the ocean.

The agency is hesitant to try moving the dolphins, noting that no one has ever tried to move this many dolphins that far.

It also said luring with sounds has never been tried with bottlenose dolphins, and herding has been tried before with other dolphin species with mixed results.

"In most successful cases these animals were in poor habitats or otherwise distressed, and nearer to safer waters," the agency said in its press release. "Herding raises the stress level of animals considerably, and in some cases causes dolphins to strand, which is often lethal."

Hansen said it is possible they can survive the winter in the river.

"They can spend the winter in colder water and even endure icy conditions, as long as there is enough to eat," he said.

Shore-area politicians were quick to criticize the decision.

"These experts better be sure that their inaction is what will ultimately turn out to be best for the dolphins," said state Sen. Joseph Kyrillos (R-Monmouth).

U.S. Rep. Frank Pallone Jr. (D-NJ) urged the agency to act before conditions become too dangerous for the dolphins to survive.