AI Assurance¶

September 4, 2025
in Critical Systems, AI Assurance, Human-Centered AI
3 min read

AI earns trust in critical systems through control

Google DeepMind and its research partners report on September 4 that an artificial intelligence (AI) controller has undergone testing at the Laser Interferometer Gravitational-Wave Observatory (LIGO) in Livingston, Louisiana. Their Deep Loop Shaping method reduces control noise in a difficult mirror-control loop by a reported factor of 30 to 100.

The achievement is technically specific, and that is precisely why it offers a useful lesson for AI in critical systems.

August 8, 2025
in Cybersecurity, AI Assurance, Defense Technology
3 min read

The AI Cyber Challenge makes evaluation operational

The Defense Advanced Research Projects Agency's (DARPA) August 8 announcement reports the results of its Artificial Intelligence (AI) Cyber Challenge (AIxCC). In the final scored round, competing cyber reasoning systems have analyzed more than 54 million lines of code, identified 86 percent of the synthetic vulnerabilities, and patched 68 percent of those identified.

Those figures are impressive. The design of the evaluation may be more important.

June 11, 2025
in Public-Sector AI, Cloud Architecture, AI Assurance
3 min read

Authorization creates a lane, not an outcome

Anthropic's June 11 announcement reports that selected Claude models in Amazon Bedrock have received approval for Federal Risk and Authorization Management Program (FedRAMP) High and Department of Defense (DoD) Impact Level 4 and 5 workloads.

For public-sector teams, that matters. A useful model outside an authorized environment is not a deployable capability. But authorization answers a narrower question than many buyers assume.

May 22, 2025
in AI Assurance, AI Governance, Agentic AI
3 min read

Capability releases need operational gates

Anthropic's May 22 release of Claude 4 comes with a less ordinary announcement: the company is activating stronger Artificial Intelligence Safety Level 3 (ASL-3) safeguards for Claude Opus 4 even though it has not concluded that the model definitively crosses the relevant capability threshold.

That provisional decision is worth examining. It treats uncertainty as a reason to strengthen a control, not as permission to continue under the old one.

May 14, 2025
in AI Assurance, AI Security, Innovation Management
2 min read

A bug bounty is a learning system

Anthropic's May 14 opening of a bug bounty for unreleased safety defenses invites researchers to find universal jailbreaks in classifiers intended to block a narrow set of dangerous chemical, biological, radiological, and nuclear requests.

The bounty is an evaluation mechanism. More importantly, it is a way to bring outside knowledge into the development process.

February 5, 2025
in AI Assurance, AI Governance, Trustworthy AI
3 min read

Frontier safety must be governed as a moving threshold

When a technology changes quickly, a fixed policy can be obsolete while everyone is still complying with it.

Google DeepMind's February update to its Frontier Safety Framework addresses that problem by linking stronger safeguards to capability thresholds in areas that could create severe harm. The details will continue to evolve. The organizational principle should endure: controls should respond to what a system can do, not only to the name or generation printed on it.

January 2, 2025
in AI Assurance, Defense Technology, Human-Centered AI
3 min read

AI assurance has to survive contact with the mission

The first consequential defense artificial intelligence story of 2025 does not arrive as a new model or a weapons demonstration. It arrives as an invitation to test.

The Department of Defense's (DoD) Chief Digital and Artificial Intelligence Office (CDAO) begins January with a crowdsourced assurance pilot in military medicine. The setting matters. A medical system can perform impressively on average and still fail a clinician or patient at exactly the wrong moment. Its quality cannot be separated from the people, workflow, uncertainty, and consequences around it.

March 6, 2024
in AI Strategy, Government Technology, Trustworthy AI, AI Assurance
6 min read

Federal AI standards should standardize evidence, not freeze design

Federal agencies need a common way to show that an artificial intelligence (AI) system is understood, controlled, and worthy of use. They do not need Washington to prescribe one architecture, model class, or development method for every mission.

That tension sat inside the Federal AI Governance and Transparency Act introduced in 2024. House bill H.R. 7532 proposed a government-wide structure for AI governance, including agency charters, inventories, risk practices, workforce training, oversight, and updates to federal acquisition rules.

The bill advanced through the House Oversight Committee and was formally reported late in 2024, but it did not become law. The question it raised remains unresolved: what should federal AI standards make uniform, and where should they preserve variation?

The right answer is to standardize the interfaces of accountability—the evidence agencies retain, the decisions they document, and the signals they exchange—without freezing the technical design beneath them.