Skip to content

Defense Technology

The AI Cyber Challenge makes evaluation operational

The Defense Advanced Research Projects Agency's (DARPA) August 8 announcement reports the results of its Artificial Intelligence (AI) Cyber Challenge (AIxCC). In the final scored round, competing cyber reasoning systems have analyzed more than 54 million lines of code, identified 86 percent of the synthetic vulnerabilities, and patched 68 percent of those identified.

Those figures are impressive. The design of the evaluation may be more important.

AI assurance has to survive contact with the mission

The first consequential defense artificial intelligence story of 2025 does not arrive as a new model or a weapons demonstration. It arrives as an invitation to test.

The Department of Defense's (DoD) Chief Digital and Artificial Intelligence Office (CDAO) begins January with a crowdsourced assurance pilot in military medicine. The setting matters. A medical system can perform impressively on average and still fail a clinician or patient at exactly the wrong moment. Its quality cannot be separated from the people, workflow, uncertainty, and consequences around it.

AI Policy Should Leave Behind Institutions, Not Checklists

Revised and substantially expanded July 17, 2026, with the subsequent change in federal AI policy reflected explicitly.

Executive Order 14110 was remarkable in scope. Issued in October 2023, it assigned artificial-intelligence actions across a wide portion of the federal government: safety and security, privacy, civil rights, consumer protection, workforce, innovation, competition, international leadership, federal use, and technical standards. Many assignments carried deadlines measured in days or months.

By early 2024, progress was naturally reported as a sequence of completed actions. Agencies had issued requests for information, convened experts, begun standards work, created hiring pathways, launched pilots, and prepared guidance. The original version of this post praised that momentum but did little to explain what “progress” should mean.

The later policy record creates a useful natural experiment. In January 2025, a new administration revoked Executive Order 14110 and established a different federal AI policy. OMB subsequently replaced core agency-use and acquisition guidance. Yet many technical problems, statutory obligations, agency missions, and organizational constraints remained.

This reveals the correct unit of progress. It is not the number of executive-order tasks marked complete. It is the amount of durable state capacity created: people, evidence, standards, architectures, acquisition mechanisms, data, evaluation systems, and decision processes that remain useful when the policy language changes.

Space traffic coordination needs an evidence market, not another data feed

More orbital data does not automatically produce a better collision warning.

A useful warning depends on the quality and timing of observations, the model used to estimate an object's orbit, the uncertainty attached to that estimate, the way several sources are combined, and whether a satellite operator can act on the result. Two providers can observe the same object and produce different answers without either behaving irrationally.

That is what made a small 2024 procurement by the Office of Space Commerce (OSC) more interesting than the original announcement suggested. OSC, part of the National Oceanic and Atmospheric Administration (NOAA), hired Kayhan Space and SpaceNav to evaluate the accuracy, consistency, and quality of commercial space situational awareness (SSA) products created by three other companies. The work supported a limited pathfinder for the emerging Traffic Coordination System for Space (TraCSS).

The government was not only buying data. It was buying an independent way to learn which data and services were useful, under which conditions, and according to which evidence.

The CDAO evaluation was really about decision rights

When the Pentagon announced that its inspector general was evaluating the Chief Digital and Artificial Intelligence Office in early 2024, it was tempting to ask for a verdict: Was the new organization working?

The final report produced a more revealing answer. The Department of Defense (DoD) Office of Inspector General (OIG) found that the Chief Digital and Artificial Intelligence Office (CDAO) was still operating without several foundational documents needed to make its responsibilities clear across the Department.

The problem was not a lack of ambition. CDAO had inherited data, analytics, digital services, and artificial intelligence (AI) responsibilities from four organizations. It was expected to set strategy, create policy, break adoption barriers, provide enabling services, and scale proven capabilities across one of the world's largest enterprises.

The problem was that a broad mandate does not tell thousands of people how authority should work at the boundary between organizations. Enterprise AI offices succeed or fail in those boundaries.

Exploring AI-Enabled Sensors: US Army SBIR Program Unveils Phase I and Phase II Opportunities

US Army to Prioritize AI in Optical Sensors: SBIR Program Launches New Opportunities

The U.S. Army is welcoming Phase I and Direct to Phase II small business proposals focused on the use of artificial intelligence (AI) in autonomous optical sensors and the like. The Small Business Innovation Research (SBIR) Program is further emphasizing novel AI and machine learning (ML) methods for signal classification in positioning, navigation, and timing applications.

Palantir Secures a $178 Million Deal to Deliver TITAN Ground Stations

Palantir Secures a $178 Million Deal to Deliver TITAN Ground Stations

Denver-based Palantir has secured a substantial $178 million deal to deliver cutting-edge technologies for the U.S. Army. Specifically, the company has been tasked with constructing 10 Tactical Intelligence Targeting Access Node (TITAN) ground stations over a two-year period.

READER-NEUTRAL SUBSCRIPTION

Follow Field Notes via RSS.

Copy this address into the RSS reader you already use. New notes will appear there automatically—no account, email address, or tracking required.