Skip to content

2024

Data at Speed and Scale Is a Control Problem

Calls for defense technologies that can collect, store, process, monitor, analyze, and transmit data at scale naturally attract products that maximize one dimension: sensor volume, link capacity, database throughput, analytic speed, or model performance.

Mission systems do not win by maximizing any of those quantities independently. They win by preserving a useful relationship between a changing environment and an accountable decision.

That makes data at speed and scale a control problem. The system must sense, estimate, decide, act, observe the result, and adapt—while delays, uncertainty, adversaries, and limited resources affect every stage.

Do Not Buy a Data Platform; Build a Data Capability Market

When the Department of Defense asks industry for technologies covering collection, transport, storage, processing, monitoring, and analysis, it encounters a predictable commercial response: every vendor explains why its platform should become the center of the architecture.

The Department’s problem is not a lack of platforms. It is the cost of composing capabilities across programs, vendors, clouds, classifications, and missions. Selecting another comprehensive product may solve a local integration problem while creating a larger dependency.

The alternative is not to build everything internally. It is to create a data capability market: a governed environment in which products can compete at stable architectural seams and must demonstrate evidence against shared mission threads.

An AI Dataset Is a Supply Chain, Not a Bag of Files

Revised and substantially expanded July 17, 2026. This essay discusses child sexual abuse material only at the level necessary to address dataset governance, research safety, and institutional responsibility; it does not reproduce or link to the material itself.

In late 2023, Stanford Internet Observatory research documented the presence of known child sexual abuse material (CSAM) in LAION-5B, a web-scale index widely used in image-model research. The finding was rightly disturbing. It also exposed a structural weakness that extends far beyond a single dataset or content category: the AI research ecosystem had learned to distribute data at internet scale without building an equally mature system for establishing provenance, communicating hazards, and containing downstream harm.

The original version of this post described the incident as a warning that harmful material can “go unnoticed” in very large datasets. That is true, but incomplete. Scale is not the root cause. Scale merely makes weak governance consequential.

A dataset used to train or evaluate an AI system is not a passive collection of files. It is the product of a supply chain: sources are selected; content is acquired or indexed; metadata is created; filters and transformations are applied; versions are published; mirrors and derivatives proliferate; models are trained; and those models become dependencies of still other systems. Every stage creates claims, obligations, and opportunities for failure.

When illegal or profoundly harmful material is discovered, the event should therefore be handled as a data-supply-chain incident. The response cannot end with deleting a few records from the latest copy. The responsible organization must determine what entered the chain, which artifacts derived from it, who received those artifacts, what models may have incorporated the data, what legal and victim-safety obligations apply, and what evidence is necessary to demonstrate containment.

AI Talent Needs Durable Product Funding, Not Episodic Enthusiasm

The Department of Veterans Affairs’ difficulty hiring artificial-intelligence talent under uncertain appropriations illustrated a structural contradiction in federal modernization. Leaders can recognize AI as a generational capability, identify important health and benefits applications, and receive new governance mandates—while lacking the durable funding needed to assemble and retain the teams responsible for the work.

This is not simply a human-resources problem. Funding instability changes architecture, acquisition, accountability, and risk.

An agency that cannot sustain internal technical capacity becomes dependent on vendors for the knowledge required to understand its own systems. It may still acquire AI. It loses the ability to act as an intelligent owner.

Unlocking Innovation: Strategic Capabilities Office Calls for Deep Learning and Cyber Research Submissions

Strategic Capabilities Office Calls for Research Submissions in Key Technical Areas

The Strategic Capabilities Office (SCO) under the Office of the Secretary of Defense has made a significant announcement, calling for research submissions pertinent to five strategic technical areas. This aligns with the current trajectory of the U.S. government in leveraging advanced technologies for national defense. The original article can be found here .

Advancing Defense Tech: AI-Enabled Valkyrie Drone Foretells the Future of the US Air Force

Redefining Air Combat: Envisioning a Future of AI-Enabled Multi-Drone Operations

Col. Tucker “Cinco” Hamilton paints an enticing view of AI’s future role in military operations. As a seasoned pilot and the chief of AI testing and operations, he sees a future where military commanders could delegate certain missions to autonomous drones.

Brad Smith Praises White House’s AI ‘Homework’ Initiative for Accelerating Action

Brad Smith Commends White House’s AI Initiatives: A Proactive Step Towards AI Safety and Security

Brad Smith, Vice Chair and President of Microsoft, lauded the White House’s initiatives to explore what companies could achieve in AI safety and security. His remarks came during the World Economic Forum’s annual meeting, casting light on a unique approach adopted by the Biden administration to fast-track AI development and regulation.

Skills-Based AI Hiring Requires Better Evidence Than a Degree Screen

Removing unnecessary degree requirements from federal artificial-intelligence jobs is both an access reform and a talent reform. Technical competence can be developed through community college, military service, apprenticeships, open-source work, industry experience, self-directed study, and nontraditional training. A four-year degree is an imperfect proxy for whether someone can solve a real agency problem.

But eliminating a weak proxy does not automatically create a strong hiring system. If agencies replace degree screens with résumé keyword searches, self-ratings, vendor certificates, or unstructured interviews, they may widen the applicant pool while preserving inconsistency and bias.

Skills-based hiring succeeds only when government becomes better at observing job-relevant capability directly.

READER-NEUTRAL SUBSCRIPTION

Follow Field Notes via RSS.

Copy this address into the RSS reader you already use. New notes will appear there automatically—no account, email address, or tracking required.