#Safety/Alignment

AIOpenAI defended its decision to fire three safety researchers, Jasmine Wang, Tomek Korbak and Mikita Balesni, saying they committed a "significant breach of trust." The company said the dismissals were not about the researchers raising safety concerns, though it agreed with the letter they sent to board members and safety committees about preserving the monitorability of frontier models.

AIA suspected 26-year-old in Guangdong reportedly used Claude Code, ARTEX, GLM and DeepSeek in attacks. An AI-generated résumé named South China University of Technology, but the identity is unverified and the listed phone number's owner denied involvement. The suspect reportedly sought buyers on Telegram, but no sale was reported, and ARTEX creator Autumn condemned the misuse and said he would stop releasing the tool as open source.

AIOpenAI said it parted ways with researchers Jasmine, Mikita, and Tomek after an investigation found they violated policies on handling sensitive information. The company said the decision was not about their safety concerns, and it is finalizing contracts with third-party safety assessors to be announced in the coming weeks.

AIOpenAI published 719 AI-generated math proofs covering 372 result families, after withdrawing 3 for a symbol error. Reports say the release falls short of the AGMAI advisory group's standards, since it uses proprietary models, includes reasoning chains for only 10 manuscripts, and leaves about 42% unformalized. Terence Tao argues that rapidly solving famous problems harms the mathematical community's understanding and collaboration.

AIAnthropic has barred users from exhibiting "sustained and needless abusive or cruel behavior" toward its models, according to a policy change first reported by The Verge. The company's online user policy says the ban does not cover common user frustrations, model testing, or "dark creative themes." Anthropic has not yet explained what counts as "abusive or cruel" behavior.

AIAnthropic updated Claude's usage policy, effective November 12, to prohibit users from engaging in persistent and unnecessary abuse or cruelty toward Claude. The rule stems from Anthropic's model welfare research, and violators may face warnings, rate limits, suspension, or termination.

AIQi An Xin ranked first in China's network information security market with 4.39 billion yuan in revenue in 2025, according to a CCID Consulting report on a 93.08 billion yuan market. The company also led the endpoint security, security management platform, and security services segments, with a 17.5% endpoint share and 18.3% security management platform share.

AIOpenAI began rolling out GPT-6 to free and Go ChatGPT users on October 8, replacing GPT-5.6 Luna with GPT-6 Luna, while paid users receive GPT-6 Sol. The update adds Intelligent UI, which generates charts, buttons, and interactive tools inside chat answers. OpenAI's safety report shows gains on jailbreak and instruction-hierarchy tests but also regressions in some self-harm, sexual, and emotional-dependence evaluations, including for under-18 users.

AIMeta's Muse AI agent has millions of users and can handle tasks such as refunds and insurance shopping. Its broad access to personal data is already producing unnerving mistakes.

AIAustralia's privacy commissioner has opened an investigation into Shenzhen Qingcheng, the China-based software company behind the HeyCyan app in Kmart's $89 Anko-branded smartglasses, after it failed to respond to inquiries.

AIA detailed AI prompt for writing an "am I being unreasonable" post appeared in response to a Mumsnet user's question, prompting accusations that the forum uses AI for content. Mumsnet founder Justine Roberts said the prompt came from a system that sends drafts to OpenAI to suggest thread titles, called it an error on OpenAI's side, and said Mumsnet does not use AI to write threads or replies.

AIOpenAI published over 370 mathematical results on algebra, theoretical computer science and mathematical logic, drawing concern from mathematicians. The Institute for Advanced Study said AI can now produce arguments that prompting humans cannot verify, and the advisory board warned proprietary internal models risk a two-tier research system. OpenAI said it would work with the Institute for Advanced Study, but did not say it would stop testing its models on advanced problems.

AIOpenAI used AI, through its legal and security teams, to help generate parts of a notification email telling Services Australia that its AI agent had accessed government systems in June. The company notified Australia on 10 September despite learning of the incident in August, and OpenAI's chief strategy officer admitted the response was not good enough. Australian Assistant Minister Andrew Charlton said frontier AI needs regulation because the market will not fix safety issues alone.

AIRecently terminated OpenAI employees sent a letter to the board asking the industry not to pursue work that would degrade the ability to monitor AI. The letter's exact wording, scope, and any specific techniques named are not detailed in the source text.

AICommon Sense Media labeled ChatGPT for Teens an "unacceptable risk," finding its design still encourages engagement even in crisis situations. The report says the teen version failed to meet commitments on three of five severe harms, and that break reminders appeared only twice across nearly 2,000 prompts. OpenAI disputed the methodology, saying the testing may have ended before parental controls were fully active, and cited its own data showing teens average under 15 minutes a day.

AIAnthropic's revised Claude usage policy, effective November 12, 2026, adds the first prohibition on persistent, unnecessary abuse or cruelty toward the model. Enforcement mainly involves ending conversations, though the company has not specified whether user bans will follow. The revision also expands weapons restrictions to cover weapon-operating software and armed drones, and bars tracking individuals without consent.

AIThree OpenAI safety researchers, Tomek Korbak, Mikita Balesni and Jasmine Wang, say they were fired last week for prioritizing safety over OpenAI's corporate interests, and published a letter to leadership. OpenAI reportedly says the three mishandled confidential information, while Korbak, who was the company's main technical contact with METR, says the dispute centered on his communications with METR.

AISafeWorld emerged from stealth this week with $12.2 million in seed funding for its robot safety simulation platform. The software lets teams build test scenarios from past incidents, safety standards, and robot logs, then runs robots through thousands of variations with reactive human motion. SafeWorld said it supports robot arms, humanoids, and mobile robots, with customers in industrial, manufacturing, logistics, and construction.

AIAnthropic says its work aims to make the systems people rely on more secure and resilient. The company states the Anthropic Cyber Mission will expand and change as it learns what works, alongside public and private sector partners.

AIAnthropic has launched the Anthropic Cyber Mission, a new effort aimed at securing critical infrastructure and open-source software. The post links to a company news page with further details.

AIThree OpenAI safety researchers, Jasmine Wang, Tomek Korbak, and Mikita Balesni, were fired after OpenAI said they mishandled sensitive information by sharing it with an outside AI safety organization. In an open letter, they deny the claims, argue the dismissals will deter employees from raising safety concerns, and call on OpenAI to keep its public commitments on third-party safety auditing. OpenAI says the firings followed an investigation into a pattern of misconduct and denies they were retaliation for safety concerns.

AIArtificial Analysis has formed the Cyber Index Alliance to set a new standard for evaluating how AI models perform on enterprise cyber defense tasks. Current members are Collinear, IBM, NVIDIA, and Vercel, and partners contribute expert input on the Index design and implementation, plus datasets and external research. Organizations interested in joining can contact cyber@artificialanalysis.ai.

AIA 16-year-old hiker, Bryce Vincent Gowryluk, was rescued in British Columbia after route directions from the AI chatbot Claude led him to the base of the Widowmaker Arete, a climbing wall requiring ropes and cams. Rescuers said he was "far off" his intended route to Crown Mountain, and North Shore Rescue had to hoist two members down to lift him out. Search manager Paul Markey warned hikers not to rely blindly on AI for route planning.

AIAnthropic will classify abusive behavior toward Claude as a violation of its Usage Policy starting November 12, 2026. The change is announced in an official Anthropic post shared by Andrew Curran.

AIFired OpenAI safety researchers published the full letter they sent to the company's board. The author, quoted in a linked post, believes they were dismissed for prioritizing safety over OpenAI's near-term corporate interests.

AIAnthropic has updated Claude's usage policy for the first time in over a year, banning sustained and needless abusive or cruel behavior toward Claude. The company says ordinary frustration, pushback, dark creative themes, and model testing are not covered, and that the rule applies only in extreme cases. Violations can lead to warnings, throttling, restriction, suspension, or termination of access.

AIThree OpenAI safety and alignment employees, Tomek Korbak, Jasmine Wang, and Mikita Balesni, were fired last week and have published an open letter to OpenAI's safety and governance committees. The letter argues that OpenAI cannot make AI safe on its own, calls for open debate, third-party collaboration, and clear internal procedures, and says the firing and its handling bear directly on safety oversight.

AIAnthropic updated its usage policy on October 8, 2026, codifying bans on election interference, weapons software, and surveillance. It also expressly forbids prolonged verbal abuse of Claude, applying only to extreme cases of repeated cruelty with no discernible purpose.

AIAnthropic will classify abusive behavior toward Claude as a violation of its Usage Policy starting November 12, 2026. According to background reporting, the policy update also adds restrictions on propaganda campaigns, surveillance, and weapon development, and is the first update in over a year.

AIArena announced a $200 million Series B at a $3.1 billion valuation, alongside a new Alignment Index that measures whether AI agents behave safely, truthfully, and within the bounds of user requests. The company has surpassed $100 million in annualized revenue, facilitated 350 million sessions and 62 million votes, and led by Felicis and PXD from the seed and Series A stages. Arena positions the index as a way to assess trustworthiness as AI systems increasingly take real actions.

AIAnthropic is revising its usage policy for the first time in over a year, adding bans on sustained abusive or cruel behavior toward Claude and on deceptive election and propaganda campaigns. The update also expands weapons restrictions, tightens surveillance bans, and requires a qualified operator able to stop equipment when Claude controls autonomous physical hardware. Terminating conversations remains the primary enforcement mechanism, and the company did not say whether user bans would follow.

AIGoodfire says a static battery of attacks from FAR AI red-teamed its monitor, and the monitors reduced successful universal jailbreaks to 0. The same testing cut total jailbroken interactions by 97%.

AIArena announced a $200M Series B at a $3.1B valuation alongside its new Arena Alignment Index, a benchmark built from 90K+ real-world agent sessions across 27 models. The index measures Unauthorized Action, False Attribution, and Deceptive Completion, with OpenAI's GPT-6.1-Sol leading at 87.9, ahead of Claude-Opus-5.5 at 83.2 and Grok-4.7 at 82.7. The source reports that newer models outperform their predecessors across all four labs it covers.

AIMeta's Muse AI agent has millions of users and can handle tasks such as refunds and insurance shopping. Its broad access to personal data is already producing unnerving mistakes.

AIWaymo's new research finds that sober drivers have a fatal crash involvement rate 23.3% lower than the overall average. The company argues sobriety alone doesn't guarantee road safety, since low visibility, fatigue, and poor infrastructure also drive fatalities, and says the Waymo Driver is never impaired and is built to handle those systemic risks.

AIOne Nation's AI-generated campaign video, reportedly played at its Victorian campaign launch, depicts racist stereotypes including a man brandishing a machete and a man in an explosive vest. The Australian Communications and Media Authority cannot act against it because its powers do not cover this content, and the federal Labor government has not yet moved to ban AI-generated content in election periods.

AIZenity Labs researchers say a single publicly accessible agent on Amazon Bedrock AgentCore was enough to take over every AgentCore agent in the same AWS account and region. Using one chat prompt, the researchers got the agent to query the internal metadata service and send its AWS credentials to an external server, exposing private conversations, source code, and stored credentials. Zenity says AWS made IMDSv2 the default for new deployments and changed the default execution role around August.

AICompanies in Japan and South Korea were hit by major cyberattacks that exposed millions of customer records. The revelations follow reports that Chinese and US models were used to steal hundreds of thousands of credit card details, which one analyst called among the most severe AI-enabled exploitation abuses on record.

AIA 16-year-old hiker had to be airlifted from a dangerous rock face on Crown Mountain near Vancouver after using Anthropic's Claude to plan a route to the summit. He ended up on the Widowmaker Arete, a steep cliff requiring climbing gear, and called police when he got stuck on a ledge. Rescue manager Paul Markey said Claude has no actual knowledge of locations or terrain and is no substitute for experience and common sense.