Skip to content
AITermsLab
–points–day streak

LLM vs AI agent: what's the difference?

An LLM is the AI model that reads and writes text by predicting the next word. An AI agent is a system built around an LLM that plans steps and uses tools to reach a goal.

Last updated

What each one means

LLM
An LLM is a kind of AI trained on huge amounts of text. It writes by predicting the next word, again and again.
AI agent
An AI agent is an AI that takes actions to reach a goal: it decides its own steps and uses tools, rather than only replying with text.

Side by side

LLM compared with AI agent
LLMAI agent
What it isA model: the engine that writes textA system: an LLM plus tools and a goal
What it doesTurns text in into text outPlans steps, uses tools and checks the results
Can it take actions?No, it only writesYes, through tools like search, email or a calendar
How it runsOne reply per requestA loop: plan, act, check, repeat until done
Who makes itAI labs that train modelsCompanies and developers, on top of an LLM
What can go wrongWrong or made-up textWrong actions too, like sending or buying the wrong thing
In everyday termsA brilliant writer at a deskThat writer with a phone, a laptop and a to-do list

An example: planning a trip

Ask an LLM to plan a weekend in Lisbon and it writes a decent itinerary from what it learned in training. Give the same job to an agent and it uses the LLM to plan, then searches for train times, checks hotel prices for your dates and adds the plan to your calendar.

See the LLM: pick the next word

Starting from "The cat sat on the", the demo shows the words an LLM is most likely to add next, with percentages. Pick a word and it suggests the next one, until the sentence is done. Let the model choose twice and you may get two different endings.

Choose a model

The text so far

The cat sat on the

Most likely next words

  • Every other word: 3%

A large model has learned from more text, so it's more confident about sensible words. It still picks with a little randomness, so the same start can end differently.

See the agent: one request, real steps

The demo sends one request, booking a table for two on Friday at 7pm, to a chat AI and to an agent. The chat AI explains how you could do it. The agent plans the job, checks a calendar, searches for restaurants, books a table and reports a reference number.

Book a table for 2 at an Italian place near me on Friday at 7pm.

What the agent can use

Connectors (MCP)
Skills

Chat AI: replies with text

Press send to see its reply.

Agent: takes actions

This lesson

Press send to watch it work.

Same request, two very different results. The chat AI explains how; the agent plans steps and uses tools to do it.

Common questions

Does every AI agent use an LLM?

Most new ones do, because the LLM is what lets an agent understand a goal written in plain words and plan the steps. Older software agents followed fixed rules instead.

Is an AI chat app an LLM?

Not exactly. The app is built around an LLM and adds a chat window, memory and sometimes tools. With tools switched on, it starts to behave like an agent.

Can I build an AI agent myself?

Yes. AI providers offer agent tools, some with little or no code. You give it an LLM, a goal, the tools it may use and limits on what it's allowed to do.