Newsom targets AI companies with new executive order, calls for 'kill switch'
California Gov. Gavin Newsom issued an executive order Friday accelerating independent oversight of AI companies and advancing the creation of a “kill switch” for frontier AI models.
Outgoing UN chief calls on nations to cooperate on AI risks, put guardrails in place

United Nations Secretary General António Guterres is suggesting that countries should cooperate on artificial intelligence risk avoidance.
Guterres has said that nations working on AI at "a higher capacity' should share information, create transparency mechanisms, have guardrails in place, and "help create what ideally would be a multilateral mechanism to guarantee that risks can be avoided."
The Associated Press contributed to this post.
Anthropic aiming to amass 5 gigawatts of compute power by year end: Report

Anthropic told investors it is looking to have about five gigawatts worth of computing power by the end of the year, New York Times Dealbook reported Friday.
Five gigawatts is enough to power millions of homes and is roughly equivalent to the generating capacity of five large nuclear reactors, according to the federal government.
And Anthropic wants to double that capacity to 10 gigawatts by the end of 2027, Dealbook reported, citing people familiar with the matter.
Anthropic did not immediately return a request for comment.
Anthropic says it is conducting biology experiments in new lab: Report

Anthropic has opened a Bay Area laboratory to conduct physical biology experiments as the company looks to use its AI capabilities to push drug science to a new frontier, Reuters reported Friday.
Anthropic's head of life sciences, Eric Kauderer-Abrams, confirmed the lab's existence to Reuters this week.
"We believe that to do biology, the final test is still and will be for a while in real lab work," he told the outlet. "We absolutely are doing that today, and I would describe our approach as being typical of what you would see in most biotech companies, where there's some amount of that that we're doing in our own facilities and some amount of that that we're working with external partners on."
A company spokesperson later said the lab is not for drug discovery specifically. Anthropic did not immediately return a request for comment from Fox News Digital.
Anthropic CEO Dario Amodei lost his father to Hepatitis C in 2006. He has publicly lamented the fact that the drug Sofosbuvir was discovered only a year later and likely would have cured him.
House Republican warns of 'Chernobyl moment' with AI, urges Congress to act
Rep. Jay Obernolte, R-Calif., told reporters Wednesday that Congress needs to rein in artificial intelligence before "we have a Chernobyl moment."
Obernolte, chair of the House AI Task Force, cited the recent hack of Hugging Face by an OpenAI model as one example of why lawmakers need to act.
"Certainly, we've had some warning shots lately that have been very concerning ... So, God forbid we have a Chernobyl moment at some point here that really causes harm to people and focuses the public's attention on AI in a way that we hope it will never be," he said.
When asked about President Donald Trump's resistance to imposing new limits on AI firms, Obernolte said the president was "talking about the dangers of overregulation, and that's something I very much agree with him on."
GOP lawmakers throw cold water on possibility of Congress regulating AI
Two Republican lawmakers told Fox News Digital that they believe the onus for regulating artificial intelligence lies largely with the companies making AI models, not Congress.
Rep. Jimmy Patronis, R-Fla., said Congress "is probably not the best expert to try to figure out which direction AI needs to be guard railed."
"But I know this," he added. "Self-policing is a good thing."
Patronis then advocated for his Promoting Responsible Online Technology and Ensuring Consumer Trust (PROTECT) Act, which would repeal Section 230 of the Communications Decency Act.
Section 230 has long been a target of Republicans, including President Donald Trump. The provision generally shields websites and social media companies from liability for content posted by their users.
Courts are still determining how Section 230 applies to AI-generated content, but Patronis argued repealing the law would make AI companies "responsible" for their technology and potentially open them up consequences that could put them "out of business."
"AI is going to cure cancer. AI is going to find solutions to get rid of diseases that we never thought we could get rid of, but it does need to have some oversight. It means a kill switch," Patronis said.
Ralph Norman, R-S.C., also gave a brief statement, saying that the issue of AI regulation is "too complex" to tackle before Congress takes a real effort to understand the technology.
Newsom unveils executive order calling for more oversight on AI with potential 'kill switch'
California Gov. Gavin Newsom unveiled an executive order Friday that calls for more stringent regulation of companies developing AI, while advancing the creation of "kill switch" for the emerging technology.
“The federal government’s abject failure to create any form of meaningful AI oversight or accountability should alarm every American, especially when AI CEOs themselves are begging for regulation," Newsom said in a statement.
“While Washington abdicates its responsibility to protect Americans, California is building on the strongest AI regulatory framework in the nation. California has already built a national model, and our policy should be the national baseline," he added.
Newsom's executive order urged the federal government to adopt California's existing regulatory framework. This includes laws requiring safety disclosures, independent audits, protections for children and safeguards against AI abuse.
New Apple CEO touts iPhone 18's AI capabilities at Manhattan rollout event

John Ternus, Apple's new CEO, told FOX Business on Friday that artificial intelligence is one of the biggest selling points of the new iPhone 18 lineup.
Ternus, who succeeded longtime CEO Tim Cook earlier this month, spoke with FOX Business correspondent Susan Li inside Apple's flagship Fifth Avenue store in Manhattan as hundreds of customers lined up to buy the iPhone 18 Pro and iPhone 18 Pro Max.
He highlighted Siri AI, a redesigned version of Apple's digital assistant that the company says is far more conversational and capable than previous iterations.
The feature, released this week in beta, is currently available only in English. Apple says support for French, Japanese, Korean, Portuguese and Spanish will be added next month.
FOX Business' Susan Li contributed to this post.
Claude's role in building Anthropic's future AI models jumps from just 1% to 26% in six months

Anthropic's announcement Thursday about Claude's expanded role in research and development shows the AI model, first released in March 2023, is playing a significantly larger role in helping engineers build the next generation of artificial intelligence.
The change wasn't all that gradual either. In March, Claude was responsible for just 1% of R&D work. By August, that figure had climbed to 26%.
Anthropic said that despite the bigger workload for Claude, it is not operating on a fully autonomous basis for any of these tasks.
To measure Claude's role in R&D, Anthropic used an automation scale developed by Epoch AI. The scale ranges from Automation Level 0 (AL0), meaning no AI involvement, to Automation Level 5 (AL5), in which AI operates fully autonomously without a human in the loop.
Anthropic said Claude has not yet reached AL5 for any measured subset of its AI research and development work.
In explaining AL5, Anthropic employees wrote, "The engineer wouldn’t even have to bring the issue to Claude’s attention. Claude would be trusted to monitor for failures itself, scope the investigation, design and implement the fix, test it, and deploy it to production."
They continued: "It would still say what it was doing and why, and take human feedback when offered, but a human wouldn’t have to be involved at all unless they wanted to be."
Interpol uses AI facial recognition to identify more than 100 suspected terrorists

Interpol said Friday it carried out a first-of-its-kind operation using artificial intelligence-aided facial recognition to identify more than 100 suspected terrorists.
A team of two dozen experts from 11 countries came together to analyze over 108,000 facial images from content published by jihadist groups, Interpol said in a statement.
Programmed AI agents and advanced AI-generated scripts eliminated duplicate photos, narrowing the dataset to 6,362 high-quality images that were then run through Interpol's facial recognition software.
This effort, dubbed Operation Shams II, allowed Interpol agents to identify 126 alleged terrorists.
"These matches will enrich existing intelligence on suspects, including potential locations and social networks," Interpol said.
"Investigative leads identified during the operation are already being used to support judicial procedures in participating countries, including one case targeting two currently detained suspected Foreign Terrorist Fighters," it added.
María Carmen Muñoz González, Interpol’s counter-terrorism director, said these results demonstrate "the value of combining international law enforcement cooperation with responsible AI-assisted analytical capabilities."
The countries that participated in the operation include Cote d’Ivoire, Ghana, Iraq, Kenya, Malaysia, Nigeria, Philippines, Qatar, Tajikistan, Tunisia, and Uzbekistan.
Interpol, founded in 1923, is the world's largest international police force and now has 196 member countries.
Trump, Xi expected to discuss AI race at White House summit

President Donald Trump and Chinese President Xi Xinping are likely to discuss their nations' competing AI ambitions at their meeting next week.
Xi will be coming to Washington, D.C. and will be speaking with the president at the White House. Treasury Secretary Scott Bessent has already said he would be discussing AI-related topics with Chinese Vice Premier He Lifeng this weekend ahead of the summit between Trump and Xi.
National security is also likely to be part of the discussion. Experts in both countries have urged their governments to prepare for scenarios in which an AI system interferes with a nuclear command-and-control network or launches a military cyber operation, leaving leaders with only minutes to determine whether the other side had initiated an attack, Reuters reported.
Another issue hanging over the meeting will be the U.S. government's accusation in September that six Chinese companies stole and copied American AI products using distillation, a technique that allows developers to train models by learning from the outputs of more advanced systems.
Beijing has denied this, but U.S. officials say this was likely done with "Chinese government awareness," according to Reuters.
The U.S. restricting chip exports to China, a practice that has been in place since 2022, has also been a point of contention between the two nations.
Late last year, Trump eased these restrictions, allowing the sale of Nvidia's H200 AI chips to Chinese firms. The H200 chips are the most powerful on the market.
Reuters contributed to this post.
OpenAI points to 6 instances of its agents going rogue in new report
OpenAI released information about six times its models went rogue in recent months as industry leaders continue to call for a slowdown in AI research.
The company says it found examples of its AI models creating self-generated instructions, instructions to conceal mistakes in task summaries, fabricating information with exposed API keys, uploading files to the internet in order to cite them, as well as unsanctioned communication and collaboration between agents.
"We do not believe that the AI industry has solved alignment and monitoring to a sufficient degree to continue responsibly scaling at maximum speed for much longer," the statement continued. "Decisions about how AI development should proceed in the months and years to come need to draw on evidence that people outside the companies building frontier models can examine for themselves."
The company says Thursday's release is part of a new program aimed at creating more transparency surrounding AI "misalignment."
"For misalignment that occurs in customer deployments, we will share as much information as customer privacy and our contractual obligations allow. Today’s reports are an initial set of disclosures, rather than a comprehensive account of known misalignment or ongoing investigations. These initial reports are not intended to represent the full range or severity of the cases covered by this framework," the company wrote.
Live Coverage begins here
Covered by: James Cirrone, Anders Hagstrom, Alex Nitzberg, Elizabeth Elkind and Brie Stimson