Skip to content

Trustworthy AI

Principles do not field themselves: why I am writing RAIDops

I did not set out to write a book.

RAIDops began during my Master of Science studies in Columbia University's Information & Knowledge Strategy program. An independent study, guided by Blake M. DiCosola III and strengthened by the advice and input of Edward J. Hoffman, started as a literature review of trustworthy artificial intelligence in national defense. Blake and Ed are both IKNS faculty; Ed previously served as NASA's first Chief Knowledge Officer.

The review grew into a long paper. The paper kept returning to an unresolved organizational problem. Eventually, the problem outgrew the paper.

I invented RAIDops and coined the name Responsible AI Development Operations for the framework that emerged from that work. The working monograph is coauthored with Blake and Ed, whose substantive intellectual contributions, guidance, editing, and mentorship have materially shaped it.1 Their collaboration has made the work substantially better.

I have hesitated to write publicly about RAIDops because the research program is active and the manuscript is unfinished. I am not going to reproduce the complete pattern catalog, assessment instruments, or the book's full analytical machinery here. But a framework concerned with reviewability should itself be open to review. This essay offers the public argument: enough to explain and defend RAIDops, while preserving the monograph as the place where the complete derivation, architecture, patterns, evidence controls, and limitations belong.

The thesis is straightforward: trustworthy AI is not merely a property to test in a model. It is an operating achievement that an organization must repeatedly produce, challenge, bound, preserve, and sometimes revoke.

That problem is not abstract to me. It recurs across my work in enterprise AI engineering, knowledge systems, and public-sector technology: building a capable system is only part of the job. The institution must also keep the purpose, evidence, authority, and means of intervention intact as the system crosses teams, contracts, environments, and time.

A benchmark needs a theory of use

The National Institute of Standards and Technology (NIST) has released draft guidance on best practices for automated benchmark evaluations. The subject sounds technical, but it reaches directly into strategy and procurement. Organizations routinely use benchmark results to choose models, justify investment, and communicate readiness.

A benchmark can support those decisions. It can also lend numerical confidence to a question it was never designed to answer.

A model constitution is an operating artifact

Anthropic has published a new constitution for Claude. The document is intended to shape how the model understands its role, weighs competing considerations, and behaves when a simple rule does not resolve the situation.

The interesting idea is not that an artificial intelligence system has a constitution. It is that governance becomes more useful when principles are written to support reasoning, implementation, testing, and revision—not merely to announce values.

AlphaGenome and the discipline of decision support

Google DeepMind's June 25 introduction of AlphaGenome presents an artificial intelligence (AI) model that predicts how changes in deoxyribonucleic acid sequences may affect gene regulation across multiple molecular processes.

The scientific capability is impressive. The framing of its limits is equally instructive for anyone building high-stakes decision support.

AI for science needs an evidence supply chain

Anthropic launches a program for using artificial intelligence (AI) in research—AI for Science—on May 5, offering application programming interface credits to researchers, with an initial emphasis on biology and the life sciences.

Access matters. Many scientific teams cannot afford sustained experimentation with frontier models. But access to a model is only one input to discovery. The harder work is building a trustworthy path from generated idea to scientific claim.

Frontier safety must be governed as a moving threshold

When a technology changes quickly, a fixed policy can be obsolete while everyone is still complying with it.

Google DeepMind's February update to its Frontier Safety Framework addresses that problem by linking stronger safeguards to capability thresholds in areas that could create severe harm. The details will continue to evolve. The organizational principle should endure: controls should respond to what a system can do, not only to the name or generation printed on it.

A management-system certificate is a beginning, not a verdict

Anthropic's January 13 announcement reports that the company has achieved International Organization for Standardization and International Electrotechnical Commission (ISO/IEC) 42001 certification, making it one of the first frontier-model companies to certify an artificial intelligence management system against the new international standard.

That is meaningful. It is also easy to misunderstand.

READER-NEUTRAL SUBSCRIPTION

Follow Field Notes via RSS.

Copy this address into the RSS reader you already use. New notes will appear there automatically—no account, email address, or tracking required.