What are computer-use or browser agents good for, and what are their risks?
Agents and tools · Pro 2
Short answer
They control a screen or browser like a person, so they can work with sites and apps that have no API. They are slower, more expensive and less reliable than API calls, and riskier: a malicious page can inject instructions, and they could click something irreversible. Use a sandbox, allow-listed sites and approval before submitting.
Deeper answer
Use an API when one exists. For browser automation with fixed steps, a script with Playwright is cheaper and more predictable than an agent. Computer-use agents fit tasks that vary each time and where a person would otherwise click through.
Log screenshots, cap steps and keep credentials out of the agent's reach where possible.
What a strong answer covers
- Controls a screen or browser like a person
- Useful when there is no API
- Slower, costlier, less reliable
- Injection from web pages and risky clicks
- Sandbox, allow-lists and approval
Answer it out loud in the mock interview about 1.5 min
Follow-ups to expect
- When would you choose Playwright over a computer-use agent?
- How would you stop the agent from submitting a payment?
Common mistakes
- Using it when an API exists
- No approval before irreversible clicks
Learn it
Browser and computer-use agents
- What are common failure modes of agents, and how do you guard against them?
- What kinds of memory can an agent have, and how do you implement them?
- Your agent ran overnight and ran up a large API bill. What probably happened, and what do you change?
- How would you design a harness for an agent that has to work on one task for several hours?
- What is the difference between an agent and a workflow?
- What is context engineering, and why does it matter for agents?
- An agent completes a task correctly most of the time but sometimes goes badly wrong. How do you debug it?
- What makes a good tool for an agent?
- Design an agent that handles refund requests for an online store.
- You changed your agent's harness. How do you prove the change made it better?
- What are verification gates in an agent harness, and how would you add them to a coding agent?
- How does tool calling work?
- When should an AI agent ask a human for approval before acting?
- Explain state, nodes, edges and checkpoints in LangGraph.
- What are planning and reflection in agents, and when do they help?
- Two coding agents use the same model, but one solves far more of your tasks. Why could that be, and how would you find out?
- What is an agent harness, and what is harness engineering?
- What is the Model Context Protocol, and why does it matter?
- When is a multi-agent system worth it, and what are the risks?