Build with AI

What is an AI agent, and how is it different from a chatbot?

· By Robert Scales · 4 min read

Short answer

An AI agent is a program that gives a language model a goal, a set of tools such as web search or file writing, and a loop that lets it choose and carry out one step after another until it decides the goal is met. A chatbot answers one message at a time and waits for you; an agent keeps going on its own, which makes it more ambitious and also much easier to send off course.

In the past three weeks, "AI agent" has moved from research papers to people's own computers, largely because of Auto-GPT, an open-source project released on March 30. Its README, the project's main instruction page, describes a program driven by GPT-4 that chains together the model's "thoughts" to pursue whatever goal you set. That is a different way of using a language model than typing into ChatGPT, and it helps to understand the difference before trying one.

Four parts that make an agent

A chatbot has one job: read the conversation and write the next reply. An agent wraps the same kind of model in four extra parts.

  1. A goal. Instead of a question, you give an objective. Auto-GPT asks you to name your AI, describe its role and list up to five goals.
  2. Tools. The agent can take actions in the world, not just write text. Auto-GPT's first version listed commands such as Google search, browsing a website, writing to a file, starting helper agents and declaring the task complete.
  3. A loop. After each action, the result is fed back to the model, which decides on the next step. This repeats until the agent judges the goal achieved, or until you stop it.
  4. Memory. Because a model can only read a limited amount of text at once, agents keep notes. Auto-GPT has short- and long-term memory and can even be pre-loaded with documents split into chunks it can recall later.

The idea of mixing thinking and doing has a research background. A 2022 paper called ReAct, short for reasoning and acting, had language models alternate between writing out their reasoning and taking actions such as looking something up through a simple Wikipedia tool. The authors found that checking outside sources reduced made-up facts compared with reasoning alone. Auto-GPT applies a similar pattern: each turn, the model returns its thoughts, its reasoning, a short plan, a self-criticism and one command to run.

A worked trace: where an agent gets stuck

Here is the kind of goal a beginner might give an agent:

Prompt
Name: TripPlanner
Role: an assistant that plans affordable weekend trips
Goal 1: Find three family-friendly things to do in Quebec City in July.
Goal 2: Estimate the cost of each for two adults and two children.
Goal 3: Save the results to a file called trip.txt.

The trace below is illustrative, written to show typical behavior rather than copied from a real run:

StepAgent's thoughtCommandWhat happens
1I should search for activitiesGoogle searchGets a list of links
2Read the first resultBrowse websiteGets a long travel article
3Save notes before I forgetMemory addStores three activity names
4Find ticket pricesBrowse websiteThe site's prices page needs a date picker it cannot use
5Try another sourceBrowse websiteFinds last year's prices
6Check if prices are currentGoogle searchResults look similar to step 1
7Read the first resultBrowse websiteSame article as step 2

By step 7 the agent is going in circles. It cannot fill in the website's form, it has no way to tell that last year's prices are out of date, and its memory of what it already tried is incomplete. Each step also costs money, because every turn is a paid call to OpenAI's API. Notice, too, that it has not yet written trip.txt, the only part of the goal you could easily check.

This is why Auto-GPT, by default, stops after each action and asks you to authorize the next command, type feedback or exit. You can approve several steps at once, and there is a "continuous mode" that runs with no approval at all. The README calls that mode potentially dangerous and warns it may run forever or take actions you would not authorize.

Try it: Without installing anything, write out the goal and the first five steps you think an agent would take for a task of your own, such as comparing three laptops under $800. Mark the steps where a website, a login or out-of-date information could stop it.

What can agents like AutoGPT actually do today?

They can carry out short, well-defined research and writing chores: run a few searches, read pages, collect notes and save a summary to a file. For developers, they are a fascinating way to see how far a model can plan on its own. The software is changing fast: the README currently tells users to download the stable release, because the main development version may often be broken.

They are not reliable assistants yet. The README lists the limits plainly: it is an experiment, not a polished product, it may struggle with messy, real-world business problems, and it is expensive to run, with a full day of development easily costing about $20 in API fees. Agents can repeat themselves, chase dead ends and trust weak sources, as the trace shows. Setup also needs some comfort with the terminal, Python and a paid OpenAI API key.

If you experiment, keep the goals small and checkable, leave approval on, set spending limits on your API account and watch every step. The README also recommends a separate virtual machine for anything that needs strong security. Treat today's agents as a preview of a new way of working, and keep the important decisions in your own hands.

Sources

  1. Auto-GPT README (commit of 2023-04-15) — Significant-Gravitas on GitHub, April 15, 2023
  2. ReAct: Synergizing Reasoning and Acting in Language Models — arXiv (Shunyu Yao and six co-authors), October 6, 2022
  3. Auto-GPT: An Autonomous GPT-4 Experiment (repository at commit 1f0905a, 30 March 2023) — Toran Bruce Richards (Torantulino / Significant Gravitas) on GitHub, March 30, 2023

Get the free Guide to Artificial Intelligence

Sign up for the weekly newsletter and receive the free guide: what changed in AI this week, one lesson, one prompt to try. Unsubscribe in one click.

How we handle your address

Back to top

Display

Your choices are saved in this browser only. No data is sent.

Text size
100%
Colours
Reading
More settings
Accessibility statement