#separator:tab
#html:true
#tags:ai-agents-quiz
#columns:Front Back
You ask a chatbot to fix a script that stops with an error. It suggests a change, you run the script yourself and paste the new error message back. What changes if you give the same task to an agent?
- It uses a larger language model that makes fewer mistakes when programming.
- It runs the script itself, reads the error and decides on the next change until the script works.
- It solves the task in one step, because it plans the whole solution before writing anything.
- It asks for permission before each suggestion but otherwise works like the chatbot.
- It runs the script itself, reads the error and decides on the next change until the script works.
Correct: the agent takes over the steps you take with a chatbot. It calls tools, observes the result and carries on until the goal is reached.
An agent reads the file fields.csv. What exactly does the language model contribute to this step?
- It opens the file on the disk and loads its content into its memory.
- It writes text that names the tool and its arguments; a program around it reads the file and returns the content.
- It sends a request to the operating system, which checks the permissions and delivers the file.
- It recalls the file from training, because tables like this occur there frequently.
- It writes text that names the tool and its arguments; a program around it reads the file and returns the content.
Correct: the tool call is just text, like the TOOL card in the game. The harness carries it out and puts the result into the context.
Which of these tasks is better solved with a fixed workflow than with an agent?
- Every morning an LLM reads the new delivery notes, a program matches them with the orders and flags differences.
- A dairy's main supplier of packaging has gone bankrupt; find alternatives, compare offers and draft a recommendation.
- Find out why the yield on one field dropped last year, using all data and sources available.
- Build a small web app showing the bookings of the farm machinery, from a short description.
- Every morning an LLM reads the new delivery notes, a program matches them with the orders and flags differences.
Correct: the steps are the same every time and can be fixed in advance. That an LLM does one of them does not make it an agent.
Which of these jobs does the harness do rather than the language model?
- carry out the tool calls and return the results
- decide which tool to call next
- ask the user for permission before a command runs
- manage the context window, for example by summarising when it fills up
- write the plan for the task
- carry out the tool calls and return the results
Correct: the model only writes the call down; the harness carries it out, as in the game, where the Harness carries every card to the tool. - ask the user for permission before a command runs
Correct: asking is a rule in the program around the model; the model can neither trigger nor bypass it. - manage the context window, for example by summarising when it fills up
Correct: the harness decides what goes into the context window and what gets shortened when space runs out; the model only sees the result.
After two hours of work an agent suddenly repeats a step it had finished long ago. Which explanation fits best?
- The model learned from the previous steps and adjusted its weights, which overwrote the earlier result.
- The context window was full; earlier results were summarised or removed, so the step is no longer in it.
- A tool reported an error, and the harness repeats failed calls on its own.
- The language model only ever keeps the last tool result, so every earlier step is lost after one round.
- The context window was full; earlier results were summarised or removed, so the step is no longer in it.
Correct: what is no longer in the context, the model does not know. This is why agents write plans and notes into files they can read again.
An agent is asked to research 40 milestones in the history of AI and starts eight sub-agents for it. What is the main advantage?
- Each sub-agent has a fresh context window, so the many sources do not fill the main agent's context, and they work at the same time.
- Sub-agents use a smaller model that specialises in searching the web.
- Sub-agents may access files the main agent has no permission for.
- Several sub-agents vote on every answer, which rules out invented facts.
- Each sub-agent has a fresh context window, so the many sources do not fill the main agent's context, and they work at the same time.
Correct: the main agent only receives the results, not every page that was read. Its context stays free for the actual task.
You use Claude Code on your laptop, and it creates files in your project folder. Where does the language model run?
- On your laptop, inside the program you installed.
- On a server of the provider; only text travels back and forth, while the harness and the files stay on your laptop.
- Partly on the laptop and partly in the cloud: small steps locally, large ones on the server.
- In the browser, which downloads the model at the start of the session.
- On a server of the provider; only text travels back and forth, while the harness and the files stay on your laptop.
Correct: the harness sends the context to the model in the cloud and carries out its tool calls locally. That is why the files appear on your machine.
Your agent works with your user account, and you have allowed it to run commands without asking. What can it do?
- delete files in your personal folder
- publish a website through your GitHub account
- read files on a colleague's laptop on the same network that your account has no access to
- read every file your account can read, private documents included
- change the model's weights so that it remembers your project next week
- delete files in your personal folder
Correct: anything your account may do, the agent may do as well, deleting included. - publish a website through your GitHub account
Correct: if your account is signed in on the computer, a command from the agent can publish in your name. - read every file your account can read, private documents included
Correct: the agent does not distinguish between project files and private documents; it can access everything you can.
Two agents use exactly the same language model but different harnesses. Which statement is correct?
- They behave the same, because all decisions are made in the model.
- They can behave differently, because the harness determines which tools, instructions, permissions and context the model gets.
- They differ only in speed, because the harness sets how fast the model computes.
- They give the same answers in a different layout, because the harness only formats the output.
- They can behave differently, because the harness determines which tools, instructions, permissions and context the model gets.
Correct: an agent is an LLM plus a harness. The same model in a different harness is a different agent.
An agent is asked to work out how much nitrogen may still be applied to a field. Its web search returns a current page and an archived page from 2009 with a different requirement, and it calculates with the 2009 value. What does this show?
- The search tool made a mistake; a better one would only return current pages.
- The model works only with what is in its context; whether it notices an outdated source depends on whether it reads and checks the result carefully.
- The harness should have filtered out the old page, because it checks every result for correctness.
- A larger model would have known the current value from training, so the mistake is down to the size of the model alone.
"- The model works only with what is in its context; whether it notices an outdated source depends on whether it reads and checks the result carefully.
Correct: the year was in the search result. An agent is only as good as the results that reach it and the way it handles them; in the game ""Be the Agent"" this is exactly the trap of Task 2.
"
Which sequence describes the loop at the core of every agent?
- plan, carry out all steps, deliver a report
- prompt, answer, user feedback, new prompt
- think, act, observe, and again until the goal is reached
- search, read, summarise, and stop after one answer
- think, act, observe, and again until the goal is reached
Correct: in research this pattern is called ReAct (Yao et al., 2022); in the game it is the THINK, TOOL and RESULT cards.
"METR reports a ""time horizon"" of several hours for current models. What does it measure?
- How long a model can work before its context window is full.
- The length of tasks, measured in the time a human needs, that a model completes on its own in half of the cases.
- How many hours of human work a model saves on average per day.
- How long the model needs for a task that a human completes in one hour.
" - The length of tasks, measured in the time a human needs, that a model completes on its own in half of the cases.
Correct: a horizon of four hours means that tasks a human needs four hours for succeed in about half of the cases.