Background
An agent is a model that calls tools such as functions and services to complete a task. As the number of tools grows, the tool definitions themselves take up space in every request. Google introduced Tool Retrieval to address this.[1]
What happened
On 19 November 2026 Google announced Tool Retrieval in the Gemini API, in a post by Lucia Loher, Product Manager, and Nora Kassner, Research Scientist at Google DeepMind.[1] The feature is in preview in the Gemini Interactions API and works with Gemini 3.6 and later models.[1]
How it works
Instead of sending the full tool library with every prompt, Tool Retrieval loads tool parameter schemas on demand. To turn it on, developers add a tool_search tool and set defer_loading to true on the tools they want to hold back.[1]
The model still sees the name and description of each deferred tool. When it asks for a tool by name within the same request, the API loads that tool's full schema.[1]
Why it matters
Google said the feature is meant to reduce input tokens and to keep tool selection accurate as an agent's tool library grows.[1]
Terms used in this entry
Tool use, also called function calling, lets a model request an outside action such as looking up data or calling a service. Each tool is described by a schema, a structured definition of its name, its parameters and their types, which tells the model how to fill in a call correctly. A token is a small piece of text, and input tokens are the text a model reads on each request; the more tokens sent, the more the request costs and the more room it takes up in the model's working memory.
When an agent is connected to many tools, most of the input in each request can be tool definitions that a given step never uses. Loading a schema only when it is needed is one way to keep the prompt short while leaving every tool available. The approach is useful only if the model can still pick the right tool, which is why the accuracy of tool selection matters as much as the size of the input.
Sources
- 1
Cite this page: Google launches Tool Retrieval in the Gemini API preview. TellWorld, https://www.tellworld.net/news/gemini-api-tool-retrieval-2026. Updated 2026-11-20