{"version":"1","article":{"id":"ai-agent-tool-retrieval-runtime-reliability-rated-2026","slug":"ai-agent-tool-retrieval-runtime-reliability-rated-2026","language":"en","url":"https://haberpaper.com/en/news/ai-agent-tool-retrieval-runtime-reliability-rated-2026","api_url":"https://haberpaper.com/api/v1/articles/ai-agent-tool-retrieval-runtime-reliability-rated-2026?lang=en","title":"AI agent tool retrieval updates rankings from runtime reliability","summary":"Texas Tech researchers’ RATED method combines semantic search with feedback on whether tools work at runtime. The new EcoAgent benchmark contains 5,172 tools and more than 210,000 query-tool pairs.","category":"business","region":"world","topics":["ai"],"published_at":"2026-10-13T20:11:52+03:00","modified_at":"2026-10-13T20:11:52+03:00","publication_basis":"publication-record","event_period":"2026-10-09","event_period_basis":"event-or-reference-period","sources":[{"name":"arXiv, RATED: Reliability-Aware AI Agent Tool Retrieval via Execution Dynamics (arXiv:2610.13889)","url":"https://arxiv.org/abs/2610.13889","checkedAt":"2026-10-13","publishedAt":"2026-10-09"}],"translations":[{"language":"tr","url":"https://haberpaper.com/tr/news/ai-agent-tool-retrieval-runtime-reliability-rated-2026","api_url":"https://haberpaper.com/api/v1/articles/ai-agent-tool-retrieval-runtime-reliability-rated-2026?lang=tr"},{"language":"en","url":"https://haberpaper.com/en/news/ai-agent-tool-retrieval-runtime-reliability-rated-2026","api_url":"https://haberpaper.com/api/v1/articles/ai-agent-tool-retrieval-runtime-reliability-rated-2026?lang=en"},{"language":"ar","url":"https://haberpaper.com/ar/news/ai-agent-tool-retrieval-runtime-reliability-rated-2026","api_url":"https://haberpaper.com/api/v1/articles/ai-agent-tool-retrieval-runtime-reliability-rated-2026?lang=ar"},{"language":"fr","url":"https://haberpaper.com/fr/news/ai-agent-tool-retrieval-runtime-reliability-rated-2026","api_url":"https://haberpaper.com/api/v1/articles/ai-agent-tool-retrieval-runtime-reliability-rated-2026?lang=fr"},{"language":"es","url":"https://haberpaper.com/es/news/ai-agent-tool-retrieval-runtime-reliability-rated-2026","api_url":"https://haberpaper.com/api/v1/articles/ai-agent-tool-retrieval-runtime-reliability-rated-2026?lang=es"}],"data_types":[],"data":null,"data_compilations":[],"data_downloads":[],"content":{"paragraphs":["A preprint posted on arXiv on 9 October by Texas Tech University researchers introduces RATED, a method designed to help AI agents find tools matching a request without repeatedly selecting tools that are unavailable or failing. It first ranks candidates by semantic similarity, then updates the ranking from execution feedback. The researchers created EcoAgent for evaluation, a benchmark with 5,172 real-world tools and more than 210,000 query-tool pairs.","On the EcoAgent-Real test of real queries, the paper reports a 52.2% increase in mean reciprocal rank over the ToolLLM API retriever; RATED’s MRR of 0.618 remained below Ada-002 at 0.670 and SPLADE-v3 at 0.626. In a simulated scenario where 30% of tools failed, RATED reduced the fault-selection rate to 2.9%. This is a controlled benchmark and injected-failure test, not a reliability guarantee validated in live agent deployments; cold-start behavior on newly added tools is also left for future study. The work is a preprint that has not yet undergone peer review."],"key_points":[],"sections":[]},"text":"Texas Tech researchers’ RATED method combines semantic search with feedback on whether tools work at runtime. The new EcoAgent benchmark contains 5,172 tools and more than 210,000 query-tool pairs.\n\nA preprint posted on arXiv on 9 October by Texas Tech University researchers introduces RATED, a method designed to help AI agents find tools matching a request without repeatedly selecting tools that are unavailable or failing. It first ranks candidates by semantic similarity, then updates the ranking from execution feedback. The researchers created EcoAgent for evaluation, a benchmark with 5,172 real-world tools and more than 210,000 query-tool pairs.\n\nOn the EcoAgent-Real test of real queries, the paper reports a 52.2% increase in mean reciprocal rank over the ToolLLM API retriever; RATED’s MRR of 0.618 remained below Ada-002 at 0.670 and SPLADE-v3 at 0.626. In a simulated scenario where 30% of tools failed, RATED reduced the fault-selection rate to 2.9%. This is a controlled benchmark and injected-failure test, not a reliability guarantee validated in live agent deployments; cold-start behavior on newly added tools is also left for future study. The work is a preprint that has not yet undergone peer review.","corrections":[],"editorial_illustration":{"kind":"symbolic-editorial-illustration","documentary":false,"scope":"section","asset_id":"business","url":"https://haberpaper.com/assets/illustrations/business-1536.webp","width":1536,"height":1024,"alt":"Symbolic industrial workshop with machinery, a warehouse and a crane.","language":"en"},"section_illustration":{"kind":"symbolic-editorial-illustration","documentary":false,"scope":"section","asset_id":"business","url":"https://haberpaper.com/assets/illustrations/business-1536.webp","width":1536,"height":1024,"alt":"Symbolic industrial workshop with machinery, a warehouse and a crane.","language":"en"}}}