AI Vocabulary · 05 Agents
What is Computer Use?
AI that operates a computer like a person: looking at the screen, clicking, typing and moving between apps.
Computer use lets an agent control a desktop or browser directly. It takes screenshots, decides where to click, types into fields and navigates between applications, much like a person sitting at the keyboard. Several AI providers now offer it, in the browser or on the desktop.
It is useful where no clean integration or tool exists: old software, websites without an API, forms that must be filled by hand. It is also slower and more error-prone than a direct integration, and a website the agent reads can contain hidden instructions, a form of prompt injection.
Why it matters for you
Computer use can take tedious clicking work off your plate, from data entry to booking flows. It is best for repetitive tasks you can easily check afterwards.
Own it
Give it a separate browser profile or account with limited permissions, keep it away from banking and passwords, and stay in the loop for anything that submits, pays or sends.
Where it comes from
Anthropic introduced "computer use" on 22 October 2024 as a public beta: a model that looks at screenshots and moves the cursor, clicks and types like a person would (Anthropic). It was explicitly called experimental, and other labs soon released their own screen-using agents. The name stuck as the general term for this ability.
Related
Your AI Learning Hub
Learn the whole AI Vocabulary, step by step, and build with it. Build it. Own it.