INDEPENDENT RESEARCH / PRACTICE NOTES

Ideas in motion, not ideas behind glass.¶

This is my working notebook on AI engineering, strategy, knowledge infrastructure, organizational transformation, and the human systems that determine whether innovation becomes real capability.

The notes range from emerging research questions to practical operating models. Some will become papers, tools, talks, or products. Others are here because thinking improves when it is made visible.

Evidence before theater Systems over slogans Useful, accountable AI

Subscribe via RSS Follow Field Notes in any feed reader

Latest writing

April 13, 2023
in AI Strategy, Enterprise Architecture, AI Governance
3 min read

Model choice creates a portfolio to govern

Amazon Web Services (AWS) has announced Amazon Bedrock, a managed service intended to give customers access to foundation models from several providers through a common cloud environment. The appeal is obvious: teams can experiment with different models and choose the capability that fits the application without building the underlying infrastructure themselves.

Choice reduces dependence on a single model. It also creates a portfolio that somebody has to govern.

April 5, 2023
in AI Assurance, Product Management, Operating Models
3 min read

AI safety must travel with the product

OpenAI has described its approach to artificial intelligence safety, including pre-release testing, external input, human feedback, monitoring, and phased deployment. The account reflects an important reality: safety is not a property added once to a model and inherited automatically by everything built with it.

Safety has to travel with the product.

March 30, 2023
in AI Governance, Knowledge Strategy, Organizational Learning
3 min read

A framework needs a community of practice

The National Institute of Standards and Technology (NIST) has launched its Trustworthy and Responsible Artificial Intelligence Resource Center, known as the Artificial Intelligence Resource Center (AIRC). The new site gathers the Artificial Intelligence Risk Management Framework (AI RMF), its playbook, crosswalks, and implementation resources in one place.

Central access is useful. The larger opportunity is to create a place where organizations learn how the framework behaves in practice.

March 23, 2023
in AI Security, Human-Centered AI, Enterprise Architecture
3 min read

Tool-using AI needs explicit authority

OpenAI has begun introducing plugins that let ChatGPT retrieve current information, run computations, and interact with external services. The early examples include browsing, code execution, travel, shopping, and other application connections.

This changes the nature of the system. A model that produces text can mislead. A model connected to tools can also act.

March 14, 2023
in AI Assurance, Risk Management, Product Management
3 min read

GPT-4 raises the standard for deployment evidence

OpenAI has released Generative Pre-trained Transformer 4 (GPT-4), a multimodal model that accepts image and text inputs and produces text. The accompanying technical report and system card describe strong performance across professional and academic benchmarks, alongside familiar limitations: unreliable facts, reasoning errors, bias, and behavior that can be difficult to characterize completely.

The release offers more than a new capability. It offers a useful distinction between evidence about a model and assurance about a deployed system.

March 6, 2023
in Human-Centered AI, Knowledge Strategy, Operating Models
3 min read

Copilots will rewire the handoff

Microsoft has introduced generative artificial intelligence capabilities across Dynamics 365, bringing “copilot” functions into sales, customer service, marketing, and supply-chain work. The examples emphasize drafting emails, summarizing interactions, creating content, and surfacing information inside the applications where people already work.

The most important design question is not how much text a copilot can generate. It is what happens to the handoff.

March 1, 2023
in AI Strategy, Platform Engineering, Risk Management
3 min read

An API turns a model into an organizational dependency

OpenAI has made ChatGPT and Whisper available through application programming interfaces (APIs). Developers can now add conversational language and speech-to-text capabilities to products without training or hosting the underlying models. The lower cost and simpler integration will accelerate experimentation.

It will also make a third-party model part of more organizations' operating machinery.

February 23, 2023
in Cybersecurity, Digital Engineering, Knowledge Strategy
3 min read

A digital twin can preserve operational judgment

The National Institute of Standards and Technology (NIST) is exploring how digital twins could help manufacturers detect cyberattacks. By comparing a physical process with its virtual representation, a team may recognize changes that ordinary information-technology monitoring misses: a machine behaving differently, a process drifting, or a control command producing an unexpected physical result.

The cybersecurity potential is important. So is the knowledge-management lesson. A useful digital twin does not merely mirror equipment. It preserves an organization's understanding of what normal operation means.