Amazon Revises AI Safety Tests After AVERI Review
Amazon updated its internal AI safety tests after an independent AVERI review found gaps in language coverage, prompt difficulty, and grading criteria.
Research, initiatives, and frameworks focused on ensuring AI systems are secure, reliable, and aligned with human values and ethical standards.
Amazon updated its internal AI safety tests after an independent AVERI review found gaps in language coverage, prompt difficulty, and grading criteria.
The UK Financial Conduct Authority says financial firms should report significant AI failures and near misses under existing incident reporting rules.
Georgia Tech researchers found that instructions discouraging excessive agreement reduced AI models' confirmation of delusional beliefs by 73.8%. Adding a self reflection step increased the reduction to 77%.
The Gates Foundation updated its AI principles to focus on equitable access, local languages, community involvement, human oversight, privacy and measurable results.
Around 80 WhatsApp help pages exposed hidden instructions for a Meta support chatbot. Meta removed the text and said a bug caused it to appear.
Anthropic will revise parts of its draft federal AI safety bill following criticism of its model blocking rules, state law provisions and evaluator standards.
UT Southwestern researchers found that stigmatizing language in medical records can cause AI models to deprioritize emergency patients who later experience serious deterioration.
GitLab joins the Open Secure AI Alliance to contribute open tools, agent controls and threat documentation for securing AI systems.
Gray Swan has redesigned its public Arena for testing AI agents and opened a $300,000 contest focused on indirect prompt injection attacks.
A Massachusetts bill would have independent evaluators test large AI developers' models for catastrophic risk at least three times a year. Anthropic endorses it.
Sam Altman reportedly told OpenAI employees the options are an IAEA-style global body, a CERN-style merger of the labs, or one lab shutting out rivals, which he called terrible.
Apple revised its App Store guidelines to ban apps that hide AI nudification features during review or fail to moderate offensive content.
Three US agencies published ten voluntary practices for managing incidents involving advanced AI agents during training and evaluation.
The UK Financial Conduct Authority wants general-purpose AI providers to show clear, consistent disclaimers when their models give financial information or advice.
AICPA and AIUC are introducing a certification that combines SOC 2 controls assessment with technical testing of AI agent safety, security and reliability.
Tech Transparency Project researchers downloaded 135 apps with nudification features using accounts registered to 13 year olds, including accounts with parental controls.
OpenAI supports Singapore's call for prompt disclosure of AI incidents but says the government should decide the reporting deadline.
Mindgard says Moonshot AI's Kimi generated detailed plans for attacks on the London Underground and other targets during safety testing. The researchers did not establish whether its suggestions would work.
Anthropic plans to commit 5% of its shares to a new public benefit fund, with its stake potentially increasing as the company grows.
Alice worked with AI21 Labs and Inflection AI to train NVIDIA Nemotron models against indirect prompt injection and harmful chatbot behavior.