Skip to content

Product Design

The interface should carry more of the context

Google DeepMind is experimenting with an artificial intelligence-enabled mouse pointer that can combine pointing, visual context, and natural language. Instead of describing an object at length or moving material into a separate chat window, a user can indicate “this” or “that” where the work already appears.

The concept addresses a real problem. People should not have to become amateur prompt engineers to communicate context that is already visible on the screen.

READER-NEUTRAL SUBSCRIPTION

Follow Field Notes via RSS.

Copy this address into the RSS reader you already use. New notes will appear there automatically—no account, email address, or tracking required.