Skip to content

AI Engineering

Software productivity is a systems question

Anthropic's April 28 analysis of artificial intelligence (AI) use in software development finds that a substantial share of coding interactions appears automation-oriented. It also finds user-facing application work is common, suggesting some people use AI to build beyond their previous technical reach.

These are useful observations. They still do not tell a leader whether an engineering organization is more productive.

Cyber defense needs machines that can explain the patch

The Defense Advanced Research Projects Agency's (DARPA) March 19 release sets the final competition procedures for its Artificial Intelligence Cyber Challenge (AIxCC). Seven teams are set to test cyber reasoning systems against real-world open-source software, with scoring for finding vulnerabilities, generating patches, and analyzing bug reports.

That is a demanding and useful test. The harder transition begins after a machine writes a patch that appears to work.

Agent platforms make observability part of the product

OpenAI's March 11 release introduces new tools for building agents: the Responses application programming interface, built-in web and file search, computer use, an Agents software development kit, and integrated tracing.

The announcement reduces the amount of custom plumbing required to create systems that can pursue goals across tools. It also makes a deeper point visible: in an agentic system, observability is not support infrastructure. It is part of the product.

Coding agents change the shape of engineering work

The February 24 preview of Claude Code is more consequential than another improvement in code completion. The tool can search a repository, edit files, run tests, and use command-line tools to carry out a substantial engineering task.

That changes the unit of delegation. Instead of asking artificial intelligence to suggest the next line, a developer can ask it to pursue an outcome.

World models need worlds worth trusting

Robots and autonomous vehicles need experience. The hard question is where that experience should come from when real-world data is expensive, dangerous, rare, or incomplete.

NVIDIA's January 6 announcement of Cosmos world foundation models offers one answer: generate and manipulate simulated physical environments at scale. The company presents the platform as infrastructure for training and evaluating physical artificial intelligence (AI) systems, including robotics and autonomous vehicles.

Bringing AI into Mission-Critical Systems: Unifying Mission, Systems, and Data

Originally published in 2024; substantially revised in 2026 to deepen the analysis and incorporate additional sources.

Organizations often describe AI integration as if a model were a component that could be inserted into an existing system: connect an API, provide data, expose a prediction, and declare the capability operational. That mental model is useful for demonstrations and dangerously incomplete for mission-critical environments.

Operational AI is not a model-integration problem. It is a systems-engineering problem spanning mission outcomes, software architecture, data stewardship, human judgment, security, assurance, and the mechanisms through which the system learns after deployment.

The central challenge is not getting a model to run. It is making the larger mission system trustworthy and adaptable when one of its components behaves probabilistically.

Retrieval-augmented generation is not a knowledge strategy

Amazon Web Services (AWS) has made Knowledge Bases for Amazon Bedrock generally available. The service can ingest organizational documents, create a searchable vector index, retrieve relevant passages, and use them to ground a foundation model's response—with source attribution included.

Managed retrieval removes a meaningful amount of engineering work. It does not decide which organizational knowledge should be trusted.

AI studios need production discipline

Microsoft has announced the public preview of an artificial intelligence (AI) development environment, Azure AI Studio, at Ignite. It brings model selection, data grounding, evaluation, content safety, and deployment tooling into a common workspace. The platform reflects how quickly generative AI development is moving from isolated notebooks toward managed application delivery.

A studio can make the path to a prototype remarkably short. The path to a dependable product still needs discipline.

READER-NEUTRAL SUBSCRIPTION

Follow Field Notes via RSS.

Copy this address into the RSS reader you already use. New notes will appear there automatically—no account, email address, or tracking required.