INDEPENDENT RESEARCH / PRACTICE NOTES

Ideas in motion, not ideas behind glass.¶

This is my working notebook on AI engineering, strategy, knowledge infrastructure, organizational transformation, and the human systems that determine whether innovation becomes real capability.

The notes range from emerging research questions to practical operating models. Some will become papers, tools, talks, or products. Others are here because thinking improves when it is made visible.

Evidence before theater Systems over slogans Useful, accountable AI

Subscribe via RSS Follow Field Notes in any feed reader

Latest writing

February 20, 2024
in AI Strategy, Defense Technology, Government Technology, Innovation Management
2 min read

Charting the Pentagon’s Course: Scale AI Leading Testing and Evaluation of Large Language Models Scale AI, in collaboration with the Pentagon’s Chief Digital and Artificial Intelligence Office, is spearheading the development of a comprehensive framework for testing and evaluating large language models. The innovative one-year contract aims to deploy AI safely, measure model performance, offer real-time feedback for warfighters, and create specialized evaluation sets for military support applications. This cutting-edge initiative addresses the potential of generative AI to revolutionize military planning and decision-making. By working on developing holdout datasets, engaging DOD insiders, and automating model assessments, the partnership endeavors to enhance the robustness and resilience of AI systems in classified environments. Scale AI’s strategic approach towards testing and evaluating generative AI models will enable the DoD to harness the technology responsibly and support military applications effectively.

Scale AI: Charting the Pentagon’s Course in Testing and Evaluating Large Language Models

San Francisco-based Scale AI has received a one-year contract from the Pentagon’s Chief Digital and Artificial Intelligence Office (CDAO) to develop a comprehensive testing and evaluation (T&E) framework for generative AI.

February 20, 2024
in AI Strategy, Defense Technology, Government Technology, Innovation Management
2 min read

Enhancing Military Efficiency: Scale AI Collaborates with Pentagon to Evaluate Generative AI Technologies Scale AI has been chosen by the U.S. Department of Defense to assist in the testing and evaluation of generative artificial intelligence for military applications. This partnership, announced by the California-based company, will focus on producing benchmarks for large language models, a subtype of generative AI that can generate text, images, and more based on statistical relationships among input data. The Defense Department’s interest in generative AI has been increasing, although its potential applications and risks are subject to ongoing discussions. Scale AI’s founder, Alexandr Wang, highlighted the importance of adopting secure and verifiable AI models to address issues like misinformation, bias, and data breaches. By leveraging Scale’s test-and-evaluation procedures, the DOD aims to grasp the capabilities and limitations of generative AI technologies to ensure responsible deployment. This strategic collaboration underscores the significance of data quality and innovation in enhancing AI systems for military use.

Critical Assessment of Pentagon’s Data Policies: Insight from Scale AI’s Alexandr Wang

Last year, Scale AI’s Chief Executive, Alexandr Wang, brought to light some pressing issues during a congressional meeting. He emphasized that the Pentagon was being held back by “outdated data-retention and management policies.”

February 20, 2024
in AI Strategy, Defense Technology, Government Technology, Innovation Management
1 min read

How Artificial Intelligence is Transforming Annual Performance Evaluations in the Navy

How Artificial Intelligence Can Streamline Annual Performance Evaluations

According to a Reddit user, presumed to be a sailor, the AI application known as ChatGPT has been a game-changer in aiding the often dreaded task of annual performance evaluations.

February 20, 2024
in AI Strategy, Defense Technology, Government Technology, Innovation Management
1 min read

Innovative AI-Based Malware Classification Technique by LANL Researchers

New AI-Based Technique for Classifying Malware: A Game-Changer from LANL Researchers

Researchers at the Los Alamos National Laboratory (LANL) recently developed an innovative malware classification technique for Microsoft Windows, employing artificial intelligence (AI) to identify and chart new malware families, breathing new life into cyber defense strategies.

February 20, 2024
in AI Strategy, Defense Technology, Government Technology, Innovation Management
2 min read

Revolutionary AI Drones: A Comparative Study of National Strategies and Implementation Efforts

The Viability of AI Drones: A Comparative Study of Russia, Ukraine, the US, and China

In the autumn of last year, both Russia and Ukraine claimed to have deployed drones capable of target tracking using AI algorithms. However, recent expert analysis implies that neither side could operationalize this tech to an extent suitable for warfare. Interestingly, the United States and China might have a chance.

February 20, 2024
in AI Strategy, Defense Technology, Government Technology, Innovation Management
2 min read

Revolutionizing AI Policy: House Leaders Unveil New Bipartisan Task Force

Unveiling a New Bipartisan AI Task Force: A Collaborative Step Towards AI Policy

Speaker Mike Johnson and Minority Leader Hakeem Jeffries have announced their selection of 24 members to serve on a bipartisan task force on artificial intelligence (AI). This group will be responsible for producing “forward-looking recommendations and bipartisan policy” concerning the evolving technology.

February 19, 2024
in AI Strategy, Defense Technology, Government Technology, Innovation Management
2 min read

DHS Unveils ‘Aggressive’ Strategy to Recruit AI Talent The Department of Homeland Security (DHS) is embarking on an aggressive recruitment strategy to fill AI jobs, aiming to attract up to 50 AI technology experts in 2024. Leveraging the Office of Personnel Management direct-hire authorities, DHS plans to swiftly build out its AI cadre to support critical missions like countering the flow of fentanyl and combatting child exploitation. The cadre, modeled after the U.S. Digital Service, will offer remote positions with competitive salaries, drawing top-tier talent to apply cutting-edge technology to impactful missions. By emphasizing the appeal of its mission and implementing a streamlined hiring process, DHS is positioning itself as an attractive destination for AI experts seeking to make a difference in national security and public service.

DHS Unveils ‘Aggressive’ Strategy to Recruit AI Talent

In face of intense competition for tech talent, the Department of Homeland Security (DHS) is forging an assertive recruitment strategy aiming to attract up to 50 AI specialists this year.

February 16, 2024
in Government Technology, AI Strategy, Defense Technology, Innovation Management
2 min read

Army’s PEO STRI Establishes New Project Office to Accelerate Rapid Acquisition Requirements

U.S. Army’s PEO STRI Establishes New Project Office to Accelerate Modernization

The U.S. Army’s Program Executive Office Simulation, Training and Instrumentation (PEO STRI) has announced the establishment of a new project office. This is part of the bid to fast-track its modernization requirements via an innovative and agile acquisition strategy, embracing modular open systems and shared architecture. The original article can be found here .