Google lets Gemini agents fetch tool instructions on demand

An agent can keep a one-line description of each tool in its prompt. Google says the feature has no separate fee, though it bills for instructions the agent loads.

Numbers in brackets link to the sources listed below.

Google introduced Tool Retrieval on 19 November in its Gemini Interactions API[1GoogleIntroducing Tool Retrieval in the Gemini APIOpen sourceSources [1]]. The preview lets an AI agent fetch instructions about the inputs a tool accepts when it needs that tool for a task, Google said[1GoogleIntroducing Tool Retrieval in the Gemini APIOpen sourceSources [1]].

For a tool on standby, the agent keeps a one-line description in its prompt that takes up about 26 tokens, PPC Land reported[2PPC LandGoogle shrinks idle tools in Gemini agents to about 26 tokens eachOpen sourceSources [2]]. Tokens are units of text that a language model processes. Google says sending full instructions with every request slows responses and makes it harder for the model to choose the right tool as the list grows[1GoogleIntroducing Tool Retrieval in the Gemini APIOpen sourceSources [1]].

Google says developers can run searches in their own apps if they maintain a tool directory or filter tools by user permissions[1GoogleIntroducing Tool Retrieval in the Gemini APIOpen sourceSources [1]]. That option adds a round trip for each lookup and lets an app make new tools available when a user connects a service during a conversation[1GoogleIntroducing Tool Retrieval in the Gemini APIOpen sourceSources [1]]. The preview supports Gemini 3.6 and later, including every Gemini 4 model[1GoogleIntroducing Tool Retrieval in the Gemini APIOpen sourceSources [1]].

Google says it charges no separate fee for retrieval and applies the model’s standard token rates[1GoogleIntroducing Tool Retrieval in the Gemini APIOpen sourceSources [1]]. Once the agent loads a tool’s instructions, Google counts them as billable input for the rest of that conversation[1GoogleIntroducing Tool Retrieval in the Gemini APIOpen sourceSources [1]]. Each search that Google runs on its servers also incurs a charge for another pass through the model, PPC Land reported[2PPC LandGoogle shrinks idle tools in Gemini agents to about 26 tokens eachOpen sourceSources [2]].

Sources

  1. 1
    Introducing Tool Retrieval in the Gemini API

    PrimaryGoogleAccessed

  2. 2
    Google shrinks idle tools in Gemini agents to about 26 tokens each

    IndependentPPC LandAccessed

ITANU’s newsroom system produced this article with AI and checked it against the sources listed above. How we work

ITANU Magazine

AI, computing and science news