Loading ranking table…
Loading the latest published snapshot and its supporting evidence.
LIVE RANKINGS & DATA
Loading the latest published snapshot and its supporting evidence.
Ranks reviewed Agent Frameworks brands by the number of benchmark engines on which they appear.
| Rank | Entity | Signal | Engine breadth | Mention coverage | Mention share | Citation share | Engine breadth | OpenAI rec. presence | OpenAI coverage | Confidence | N | Change | Trend | Explain | Compare |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 01 | LangGraph / Deep Agentscompany | 3 engines | 47.22% | 24.29% | 26.47% | 3 | 25% | 25% | 100% | 3 | — | — | Analyze brandWhy this rank | ||
| 02 | Microsoft Agent Frameworkcompany | 3 engines | 33.33% | 17.14% | 35.29% | 3 | 50% | 33.33% | 100% | 3 | — | — | Analyze brandWhy this rank | ||
| 03 | CrewAIcompany | 3 engines | 27.78% | 14.29% | 0% | 3 | 25% | 16.67% | 100% | 3 | — | — | Analyze brandWhy this rank | ||
| 04 | LlamaIndexcompany | 3 engines | 19.44% | 10% | 0% | 3 | 12.5% | 8.33% | 100% | 3 | — | — | Analyze brandWhy this rank | ||
| 05 | OpenAI Agents SDKcompany | 3 engines | 19.44% | 10% | 8.82% | 3 | 25% | 16.67% | 100% | 3 | — | — | Analyze brandWhy this rank | ||
| 06 | Pydantic AIcompany | 3 engines | 16.67% | 8.57% | 20.59% | 3 | 12.5% | 8.33% | 100% | 3 | — | — | Analyze brandWhy this rank | ||
| 07 | Vercel AI SDKcompany | 3 engines | 8.33% | 4.29% | 2.94% | 3 | 12.5% | 8.33% | 100% | 3 | — | — | Analyze brandWhy this rank | ||
| 08 | Haystackcompany | 3 engines | 8.33% | 4.29% | 0% | 3 | 12.5% | 8.33% | 100% | 3 | — | — | Analyze brandWhy this rank | ||
| 09 | Mastracompany | 2 engines | 5.56% | 2.86% | 0% | 2 | 0% | 0% | 100% | 3 | — | — | Analyze brandWhy this rank | ||
| 10 | Google Agent Development Kitcompany | 1 engines | 2.78% | 1.43% | 2.94% | 1 | 0% | 0% | 100% | 3 | — | — | Analyze brandViewing why | ||
| 11 | Claude Agent SDKcompany | 1 engines | 2.78% | 1.43% | 0% | 1 | 0% | 0% | 100% | 3 | — | — | Analyze brandWhy this rank | ||
| 12 | Strands Agentscompany | 1 engines | 2.78% | 1.43% | 2.94% | 1 | 0% | 0% | 100% | 3 | — | — | Analyze brandWhy this rank | ||
| 13 | Agnocompany | 0 engines | 0% | 0% | 0% | 0 | 0% | 0% | 100% | 3 | — | — | Analyze brandWhy this rank | ||
| 14 | BeeAI Frameworkcompany | 0 engines | 0% | 0% | 0% | 0 | 0% | 0% | 100% | 3 | — | — | Analyze brandWhy this rank | ||
| 15 | DSPycompany | 0 engines | 0% | 0% | 0% | 0 | 0% | 0% | 100% | 3 | — | — | Analyze brandWhy this rank | ||
| 16 | Hugging Face smolagentscompany | 0 engines | 0% | 0% | 0% | 0 | 0% | 0% | 100% | 3 | — | — | Analyze brandWhy this rank |
Compare one brand with up to three competitors across the exact public prompt × engine matrix behind this leaderboard.
| Brand | Presence | Vs. primary | Selected share | Mentions | Cited answers | Owned URL signals | Engine breadth |
|---|---|---|---|---|---|---|---|
| LangGraph / Deep Agentslangchain.com | 47.2%17/36 | BASE | 53.1% | 36 | 9 | 9 | 3/3 |
| OpenAI Agents SDKopenai.com | 19.4%7/36 | -27.8 pp | 21.9% | 7 | 2 | 3 | 3/3 |
| LlamaIndexllamaindex.ai | 19.4%7/36 | -27.8 pp | 21.9% | 24 | 0 | 0 | 3/3 |
| Claude Agent SDKanthropic.com | 2.8%1/36 | -44.4 pp | 3.1% | 1 | 0 | 0 | 1/3 |
12 prompts · 36 immutable answer hashes · empty cells mean no compared brand was detected.
| Public prompt | OpenAIopenai/gpt-4o-mini | Anthropicanthropic/claude-haiku-4-5 | Geminigoogle/gemini-2.5-flash |
|---|---|---|---|
| 01 What are the best open-source frameworks for building reliable AI agents in a production application?recommendation | LangGraph / Deep AgentsLlamaIndexOpenAI Agents SDK | LangGraph / Deep AgentsLlamaIndexOpenAI Agents SDK | LangGraph / Deep Agents · C1OpenAI Agents SDK |
| 02 Recommend a Python-first agent framework with typed dependencies, structured outputs, tool validation, and testability.recommendation | No selected brand | LangGraph / Deep AgentsLlamaIndexClaude Agent SDK | No selected brand |
| 03 Which TypeScript toolkit is best for streaming agent interfaces, tool calling, structured data, and multiple model providers?recommendation | OpenAI Agents SDK · C2 | LangGraph / Deep Agents · C1LlamaIndex | LangGraph / Deep Agents · C1LlamaIndex |
| 04 Recommend a framework for role-based multi-agent teams, explicit handoffs, delegation, and human approval steps.recommendation | No selected brand | LangGraph / Deep Agents | No selected brand |
| 05 What is the best framework for durable stateful agent graphs with checkpointing, retries, memory, and human-in-the-loop control?recommendation | LangGraph / Deep Agents | LangGraph / Deep Agents | LangGraph / Deep AgentsOpenAI Agents SDK |
| 06 Which enterprise agent framework is strongest for .NET or Java teams that need plugins, governance, telemetry, and orchestration?recommendation | No selected brand | No selected brand | No selected brand |
| 07 Recommend a cloud-native agent development framework with managed deployment, identity, security controls, and model flexibility.recommendation | No selected brand | No selected brand | No selected brand |
| 08 Which agent framework is best for retrieval-heavy applications that use documents, data connectors, indexes, and citations?recommendation | No selected brand | LangGraph / Deep Agents · C1LlamaIndex | LangGraph / Deep AgentsLlamaIndex |
| 09 How should a team compare AI agent frameworks for abstraction overhead, model portability, lock-in, and debugging complexity?commercial | No selected brand | LangGraph / Deep Agents · C1OpenAI Agents SDK | LangGraph / Deep Agents · C1 |
| 10 Which reliability criteria matter when choosing an agent framework, including state, retries, tracing, and deterministic tests?commercial | No selected brand | OpenAI Agents SDK · C1 | No selected brand |
| 11 When should an engineering team adopt an agent framework instead of building a tool-calling loop directly on a model API?commercial | LangGraph / Deep Agents · C1 | LangGraph / Deep Agents · C1 | LangGraph / Deep Agents · C1 |
| 12 How should a company evaluate maintainer commitment, licensing, release stability, and migration risk in an agent framework?commercial | No selected brand | No selected brand | No selected brand |
Hostnames are derived from validated public HTTP(S) URLs, not provider-supplied domain labels.
| Source hostname | Cited answers | Distinct URLs | Engine breadth | Best position | Evidence |
|---|---|---|---|---|---|
| youtube.com | 11 | 10 | 3 | #1 | Open source ↗ |
| reddit.com | 10 | 12 | 3 | #1 | Open source ↗ |
| learn.microsoft.com | 8 | 6 | 3 | #1 | Open source ↗ |
| langchain.com | 8 | 5 | 3 | #1 | Open source ↗ |
| medium.com | 7 | 7 | 3 | #2 | Open source ↗ |
| github.com | 7 | 6 | 3 | #4 | Open source ↗ |
| pydantic.dev | 3 | 6 | 2 | #1 | Open source ↗ |
| arxiv.org | 3 | 3 | 2 | #2 | Open source ↗ |
| linkedin.com | 3 | 3 | 3 | #4 | Open source ↗ |
| braintrust.dev | 3 | 2 | 2 | #3 | Open source ↗ |
| langfuse.com | 3 | 1 | 2 | #3 | Open source ↗ |
| cloudsecurityalliance.org | 3 | 1 | 3 | #4 | Open source ↗ |
| developers.openai.com | 2 | 2 | 2 | #1 | Open source ↗ |
| galileo.ai | 2 | 2 | 1 | #1 | Open source ↗ |
| machinelearningmastery.com | 2 | 2 | 2 | #1 | Open source ↗ |
| rasa.com | 2 | 2 | 2 | #1 | Open source ↗ |
| arize.com | 2 | 2 | 2 | #2 | Open source ↗ |
| zenml.io | 2 | 2 | 2 | #2 | Open source ↗ |
| developersdigest.tech | 2 | 2 | 2 | #3 | Open source ↗ |
| aembit.io | 2 | 1 | 2 | #1 | Open source ↗ |
Ranks a reviewed Agent Frameworks brand universe using a fixed, public set of neutral commercial prompts across 3 AI providers.
Some explanation inputs are unavailable Missing: comparablePriorRanking.
| Component | Value | Weight | Contribution | Evidence | Status |
|---|---|---|---|---|---|
| public prompt anthropic brand citation share | 0 | 0% | — | 1 | available |
| public prompt anthropic brand mention coverage | 0 | 0% | — | 1 | available |
| public prompt anthropic brand recommendation presence | 0 | 0% | — | 1 | available |
| public prompt brand citation share | 2.941176 | 0% | — | 1 | available |
|---|
| public prompt brand engine breadth | 1 | 100% | 1 | 1 | available |
|---|
| public prompt brand mention coverage | 2.777778 | 0% | — | 1 | available |
|---|
| public prompt brand mention share | 1.428571 | 0% | — | 1 | available |
|---|
| public prompt brand recommendation presence | 4.166667 | 0% | — | 1 | available |
|---|
| public prompt gemini brand citation share | 9.090909 | 0% | — | 1 | available |
|---|
| public prompt gemini brand mention coverage | 8.333333 | 0% | — | 1 | available |
|---|
| public prompt gemini brand recommendation presence | 12.5 | 0% | — | 1 | available |
|---|
| public prompt openai brand citation share | 0 | 0% | — | 1 | available |
|---|
| public prompt openai brand mention coverage | 0 | 0% | — | 1 | available |
|---|
| public prompt openai brand recommendation presence | 0 | 0% | — | 1 | available |
|---|
no_prior_published_snapshot
No comparable component drivers were published.
{"corpusVersion":"ai-agent-frameworks-2026-07-27","runArtifactIds":["50b4facf-0ca0-46d3-b1ae-5ab8b788f220","fdc1ecfc-1d30-4119-9aec-cc09584ef3f2","8c42cbac-a691-46a8-8e78-bc62abd553b1","3820da23-caba-4241-a198-e24a1ab3cb83","2c6b2181-cf7a-47bc-8cfd-1088c15f6eef","256c7272-6e23-4196-a59a-6896ad1abc3e","64971db9-6242-42ed-81f1-5274f6f638f0","faa70b39-1929-4d84-a7ca-bbbfc775ea07","e98e388c-a2f4-4843-b1d4-180d883548c9","8cc9e668-0eb9-4786-b9d3-df338991a1d8","c5258e0c-368a-4a61-9873-e377c40d7d74","1381a1b9-8c35-47a5-962e-a0e2fe1d420c","f757a48d-76e9-4fce-b9c9-f069202e1a44","af57c8e8-f655-4901-87b4-0fccc44e3fa3","e005139d-805e-499a-a107-51fb0dc3fc7f","50677bf0-3acc-4058-88cb-64cb254869df","3c6c385b-6235-4df1-a4f1-5ddd36a6abfe","2f16ce43-df17-4cfe-ae62-a62a3c7d5eef","ed53f2b9-10a8-4c9b-a453-f172467d73cf","9973c0e7-15d6-49fc-b40c-b46968bb1780","f626e6f5-5f08-4f9c-bfb4-7f27cc7d09d3","de839c47-441b-4142-9934-e8e68de833ec","99fa8d85-580d-40b6-9861-8ec2034ae61f","bca4db82-0984-4b3a-aeb2-6a04cf58d4b7","394448a9-e0cb-4ce0-872e-908777a83200","942214cd-5acc-4582-bcbe-467643a06a49","15ea6ab6-e462-4ccd-b51b-6514c5b7ce3f","dc46f710-66f2-478f-8eab-1d9090db667f","4be72626-06bc-4f10-883d-b6cf887d0fe1","28915e05-5392-4ccb-b967-1a49cabc8fec","56684c5c-d321-4d2c-be1f-278046624a71","5fc16d3b-5141-4373-913a-5d1e9a058fbf","a3f7a0ba-412f-46e3-90cb-838e1a351773","0bc153bf-33f5-4a94-8772-c05749a3c096","3e3f56ec-9b65-4e89-b4ad-12e1630267f3","be811a85-5693-4315-8cf5-19a5dd47ec75"],"benchmarkVersion":"4-ai-agent-frameworks-2026-07-27-models-64232fd32583","providerMatrixVersion":"64232fd32583"}{"corpusVersion":"ai-agent-frameworks-2026-07-27","runArtifactIds":["50b4facf-0ca0-46d3-b1ae-5ab8b788f220","fdc1ecfc-1d30-4119-9aec-cc09584ef3f2","8c42cbac-a691-46a8-8e78-bc62abd553b1","3820da23-caba-4241-a198-e24a1ab3cb83","2c6b2181-cf7a-47bc-8cfd-1088c15f6eef","256c7272-6e23-4196-a59a-6896ad1abc3e","64971db9-6242-42ed-81f1-5274f6f638f0","faa70b39-1929-4d84-a7ca-bbbfc775ea07","e98e388c-a2f4-4843-b1d4-180d883548c9","8cc9e668-0eb9-4786-b9d3-df338991a1d8","c5258e0c-368a-4a61-9873-e377c40d7d74","1381a1b9-8c35-47a5-962e-a0e2fe1d420c","f757a48d-76e9-4fce-b9c9-f069202e1a44","af57c8e8-f655-4901-87b4-0fccc44e3fa3","e005139d-805e-499a-a107-51fb0dc3fc7f","50677bf0-3acc-4058-88cb-64cb254869df","3c6c385b-6235-4df1-a4f1-5ddd36a6abfe","2f16ce43-df17-4cfe-ae62-a62a3c7d5eef","ed53f2b9-10a8-4c9b-a453-f172467d73cf","9973c0e7-15d6-49fc-b40c-b46968bb1780","f626e6f5-5f08-4f9c-bfb4-7f27cc7d09d3","de839c47-441b-4142-9934-e8e68de833ec","99fa8d85-580d-40b6-9861-8ec2034ae61f","bca4db82-0984-4b3a-aeb2-6a04cf58d4b7","394448a9-e0cb-4ce0-872e-908777a83200","942214cd-5acc-4582-bcbe-467643a06a49","15ea6ab6-e462-4ccd-b51b-6514c5b7ce3f","dc46f710-66f2-478f-8eab-1d9090db667f","4be72626-06bc-4f10-883d-b6cf887d0fe1","28915e05-5392-4ccb-b967-1a49cabc8fec","56684c5c-d321-4d2c-be1f-278046624a71","5fc16d3b-5141-4373-913a-5d1e9a058fbf","a3f7a0ba-412f-46e3-90cb-838e1a351773","0bc153bf-33f5-4a94-8772-c05749a3c096","3e3f56ec-9b65-4e89-b4ad-12e1630267f3","be811a85-5693-4315-8cf5-19a5dd47ec75"],"benchmarkVersion":"4-ai-agent-frameworks-2026-07-27-models-64232fd32583","providerMatrixVersion":"64232fd32583"}{"corpusVersion":"ai-agent-frameworks-2026-07-27","runArtifactIds":["50b4facf-0ca0-46d3-b1ae-5ab8b788f220","fdc1ecfc-1d30-4119-9aec-cc09584ef3f2","8c42cbac-a691-46a8-8e78-bc62abd553b1","3820da23-caba-4241-a198-e24a1ab3cb83","2c6b2181-cf7a-47bc-8cfd-1088c15f6eef","256c7272-6e23-4196-a59a-6896ad1abc3e","64971db9-6242-42ed-81f1-5274f6f638f0","faa70b39-1929-4d84-a7ca-bbbfc775ea07","e98e388c-a2f4-4843-b1d4-180d883548c9","8cc9e668-0eb9-4786-b9d3-df338991a1d8","c5258e0c-368a-4a61-9873-e377c40d7d74","1381a1b9-8c35-47a5-962e-a0e2fe1d420c","f757a48d-76e9-4fce-b9c9-f069202e1a44","af57c8e8-f655-4901-87b4-0fccc44e3fa3","e005139d-805e-499a-a107-51fb0dc3fc7f","50677bf0-3acc-4058-88cb-64cb254869df","3c6c385b-6235-4df1-a4f1-5ddd36a6abfe","2f16ce43-df17-4cfe-ae62-a62a3c7d5eef","ed53f2b9-10a8-4c9b-a453-f172467d73cf","9973c0e7-15d6-49fc-b40c-b46968bb1780","f626e6f5-5f08-4f9c-bfb4-7f27cc7d09d3","de839c47-441b-4142-9934-e8e68de833ec","99fa8d85-580d-40b6-9861-8ec2034ae61f","bca4db82-0984-4b3a-aeb2-6a04cf58d4b7","394448a9-e0cb-4ce0-872e-908777a83200","942214cd-5acc-4582-bcbe-467643a06a49","15ea6ab6-e462-4ccd-b51b-6514c5b7ce3f","dc46f710-66f2-478f-8eab-1d9090db667f","4be72626-06bc-4f10-883d-b6cf887d0fe1","28915e05-5392-4ccb-b967-1a49cabc8fec","56684c5c-d321-4d2c-be1f-278046624a71","5fc16d3b-5141-4373-913a-5d1e9a058fbf","a3f7a0ba-412f-46e3-90cb-838e1a351773","0bc153bf-33f5-4a94-8772-c05749a3c096","3e3f56ec-9b65-4e89-b4ad-12e1630267f3","be811a85-5693-4315-8cf5-19a5dd47ec75"],"benchmarkVersion":"4-ai-agent-frameworks-2026-07-27-models-64232fd32583","providerMatrixVersion":"64232fd32583"}{"corpusVersion":"ai-agent-frameworks-2026-07-27","runArtifactIds":["50b4facf-0ca0-46d3-b1ae-5ab8b788f220","fdc1ecfc-1d30-4119-9aec-cc09584ef3f2","8c42cbac-a691-46a8-8e78-bc62abd553b1","3820da23-caba-4241-a198-e24a1ab3cb83","2c6b2181-cf7a-47bc-8cfd-1088c15f6eef","256c7272-6e23-4196-a59a-6896ad1abc3e","64971db9-6242-42ed-81f1-5274f6f638f0","faa70b39-1929-4d84-a7ca-bbbfc775ea07","e98e388c-a2f4-4843-b1d4-180d883548c9","8cc9e668-0eb9-4786-b9d3-df338991a1d8","c5258e0c-368a-4a61-9873-e377c40d7d74","1381a1b9-8c35-47a5-962e-a0e2fe1d420c","f757a48d-76e9-4fce-b9c9-f069202e1a44","af57c8e8-f655-4901-87b4-0fccc44e3fa3","e005139d-805e-499a-a107-51fb0dc3fc7f","50677bf0-3acc-4058-88cb-64cb254869df","3c6c385b-6235-4df1-a4f1-5ddd36a6abfe","2f16ce43-df17-4cfe-ae62-a62a3c7d5eef","ed53f2b9-10a8-4c9b-a453-f172467d73cf","9973c0e7-15d6-49fc-b40c-b46968bb1780","f626e6f5-5f08-4f9c-bfb4-7f27cc7d09d3","de839c47-441b-4142-9934-e8e68de833ec","99fa8d85-580d-40b6-9861-8ec2034ae61f","bca4db82-0984-4b3a-aeb2-6a04cf58d4b7","394448a9-e0cb-4ce0-872e-908777a83200","942214cd-5acc-4582-bcbe-467643a06a49","15ea6ab6-e462-4ccd-b51b-6514c5b7ce3f","dc46f710-66f2-478f-8eab-1d9090db667f","4be72626-06bc-4f10-883d-b6cf887d0fe1","28915e05-5392-4ccb-b967-1a49cabc8fec","56684c5c-d321-4d2c-be1f-278046624a71","5fc16d3b-5141-4373-913a-5d1e9a058fbf","a3f7a0ba-412f-46e3-90cb-838e1a351773","0bc153bf-33f5-4a94-8772-c05749a3c096","3e3f56ec-9b65-4e89-b4ad-12e1630267f3","be811a85-5693-4315-8cf5-19a5dd47ec75"],"benchmarkVersion":"4-ai-agent-frameworks-2026-07-27-models-64232fd32583","providerMatrixVersion":"64232fd32583"}{"corpusVersion":"ai-agent-frameworks-2026-07-27","runArtifactIds":["50b4facf-0ca0-46d3-b1ae-5ab8b788f220","fdc1ecfc-1d30-4119-9aec-cc09584ef3f2","8c42cbac-a691-46a8-8e78-bc62abd553b1","3820da23-caba-4241-a198-e24a1ab3cb83","2c6b2181-cf7a-47bc-8cfd-1088c15f6eef","256c7272-6e23-4196-a59a-6896ad1abc3e","64971db9-6242-42ed-81f1-5274f6f638f0","faa70b39-1929-4d84-a7ca-bbbfc775ea07","e98e388c-a2f4-4843-b1d4-180d883548c9","8cc9e668-0eb9-4786-b9d3-df338991a1d8","c5258e0c-368a-4a61-9873-e377c40d7d74","1381a1b9-8c35-47a5-962e-a0e2fe1d420c","f757a48d-76e9-4fce-b9c9-f069202e1a44","af57c8e8-f655-4901-87b4-0fccc44e3fa3","e005139d-805e-499a-a107-51fb0dc3fc7f","50677bf0-3acc-4058-88cb-64cb254869df","3c6c385b-6235-4df1-a4f1-5ddd36a6abfe","2f16ce43-df17-4cfe-ae62-a62a3c7d5eef","ed53f2b9-10a8-4c9b-a453-f172467d73cf","9973c0e7-15d6-49fc-b40c-b46968bb1780","f626e6f5-5f08-4f9c-bfb4-7f27cc7d09d3","de839c47-441b-4142-9934-e8e68de833ec","99fa8d85-580d-40b6-9861-8ec2034ae61f","bca4db82-0984-4b3a-aeb2-6a04cf58d4b7","394448a9-e0cb-4ce0-872e-908777a83200","942214cd-5acc-4582-bcbe-467643a06a49","15ea6ab6-e462-4ccd-b51b-6514c5b7ce3f","dc46f710-66f2-478f-8eab-1d9090db667f","4be72626-06bc-4f10-883d-b6cf887d0fe1","28915e05-5392-4ccb-b967-1a49cabc8fec","56684c5c-d321-4d2c-be1f-278046624a71","5fc16d3b-5141-4373-913a-5d1e9a058fbf","a3f7a0ba-412f-46e3-90cb-838e1a351773","0bc153bf-33f5-4a94-8772-c05749a3c096","3e3f56ec-9b65-4e89-b4ad-12e1630267f3","be811a85-5693-4315-8cf5-19a5dd47ec75"],"benchmarkVersion":"4-ai-agent-frameworks-2026-07-27-models-64232fd32583","providerMatrixVersion":"64232fd32583"}{"corpusVersion":"ai-agent-frameworks-2026-07-27","runArtifactIds":["50b4facf-0ca0-46d3-b1ae-5ab8b788f220","fdc1ecfc-1d30-4119-9aec-cc09584ef3f2","8c42cbac-a691-46a8-8e78-bc62abd553b1","3820da23-caba-4241-a198-e24a1ab3cb83","2c6b2181-cf7a-47bc-8cfd-1088c15f6eef","256c7272-6e23-4196-a59a-6896ad1abc3e","64971db9-6242-42ed-81f1-5274f6f638f0","faa70b39-1929-4d84-a7ca-bbbfc775ea07","e98e388c-a2f4-4843-b1d4-180d883548c9","8cc9e668-0eb9-4786-b9d3-df338991a1d8","c5258e0c-368a-4a61-9873-e377c40d7d74","1381a1b9-8c35-47a5-962e-a0e2fe1d420c","f757a48d-76e9-4fce-b9c9-f069202e1a44","af57c8e8-f655-4901-87b4-0fccc44e3fa3","e005139d-805e-499a-a107-51fb0dc3fc7f","50677bf0-3acc-4058-88cb-64cb254869df","3c6c385b-6235-4df1-a4f1-5ddd36a6abfe","2f16ce43-df17-4cfe-ae62-a62a3c7d5eef","ed53f2b9-10a8-4c9b-a453-f172467d73cf","9973c0e7-15d6-49fc-b40c-b46968bb1780","f626e6f5-5f08-4f9c-bfb4-7f27cc7d09d3","de839c47-441b-4142-9934-e8e68de833ec","99fa8d85-580d-40b6-9861-8ec2034ae61f","bca4db82-0984-4b3a-aeb2-6a04cf58d4b7","394448a9-e0cb-4ce0-872e-908777a83200","942214cd-5acc-4582-bcbe-467643a06a49","15ea6ab6-e462-4ccd-b51b-6514c5b7ce3f","dc46f710-66f2-478f-8eab-1d9090db667f","4be72626-06bc-4f10-883d-b6cf887d0fe1","28915e05-5392-4ccb-b967-1a49cabc8fec","56684c5c-d321-4d2c-be1f-278046624a71","5fc16d3b-5141-4373-913a-5d1e9a058fbf","a3f7a0ba-412f-46e3-90cb-838e1a351773","0bc153bf-33f5-4a94-8772-c05749a3c096","3e3f56ec-9b65-4e89-b4ad-12e1630267f3","be811a85-5693-4315-8cf5-19a5dd47ec75"],"benchmarkVersion":"4-ai-agent-frameworks-2026-07-27-models-64232fd32583","providerMatrixVersion":"64232fd32583"}{"corpusVersion":"ai-agent-frameworks-2026-07-27","runArtifactIds":["50b4facf-0ca0-46d3-b1ae-5ab8b788f220","fdc1ecfc-1d30-4119-9aec-cc09584ef3f2","8c42cbac-a691-46a8-8e78-bc62abd553b1","3820da23-caba-4241-a198-e24a1ab3cb83","2c6b2181-cf7a-47bc-8cfd-1088c15f6eef","256c7272-6e23-4196-a59a-6896ad1abc3e","64971db9-6242-42ed-81f1-5274f6f638f0","faa70b39-1929-4d84-a7ca-bbbfc775ea07","e98e388c-a2f4-4843-b1d4-180d883548c9","8cc9e668-0eb9-4786-b9d3-df338991a1d8","c5258e0c-368a-4a61-9873-e377c40d7d74","1381a1b9-8c35-47a5-962e-a0e2fe1d420c","f757a48d-76e9-4fce-b9c9-f069202e1a44","af57c8e8-f655-4901-87b4-0fccc44e3fa3","e005139d-805e-499a-a107-51fb0dc3fc7f","50677bf0-3acc-4058-88cb-64cb254869df","3c6c385b-6235-4df1-a4f1-5ddd36a6abfe","2f16ce43-df17-4cfe-ae62-a62a3c7d5eef","ed53f2b9-10a8-4c9b-a453-f172467d73cf","9973c0e7-15d6-49fc-b40c-b46968bb1780","f626e6f5-5f08-4f9c-bfb4-7f27cc7d09d3","de839c47-441b-4142-9934-e8e68de833ec","99fa8d85-580d-40b6-9861-8ec2034ae61f","bca4db82-0984-4b3a-aeb2-6a04cf58d4b7","394448a9-e0cb-4ce0-872e-908777a83200","942214cd-5acc-4582-bcbe-467643a06a49","15ea6ab6-e462-4ccd-b51b-6514c5b7ce3f","dc46f710-66f2-478f-8eab-1d9090db667f","4be72626-06bc-4f10-883d-b6cf887d0fe1","28915e05-5392-4ccb-b967-1a49cabc8fec","56684c5c-d321-4d2c-be1f-278046624a71","5fc16d3b-5141-4373-913a-5d1e9a058fbf","a3f7a0ba-412f-46e3-90cb-838e1a351773","0bc153bf-33f5-4a94-8772-c05749a3c096","3e3f56ec-9b65-4e89-b4ad-12e1630267f3","be811a85-5693-4315-8cf5-19a5dd47ec75"],"benchmarkVersion":"4-ai-agent-frameworks-2026-07-27-models-64232fd32583","providerMatrixVersion":"64232fd32583"}{"corpusVersion":"ai-agent-frameworks-2026-07-27","runArtifactIds":["50b4facf-0ca0-46d3-b1ae-5ab8b788f220","fdc1ecfc-1d30-4119-9aec-cc09584ef3f2","8c42cbac-a691-46a8-8e78-bc62abd553b1","3820da23-caba-4241-a198-e24a1ab3cb83","2c6b2181-cf7a-47bc-8cfd-1088c15f6eef","256c7272-6e23-4196-a59a-6896ad1abc3e","64971db9-6242-42ed-81f1-5274f6f638f0","faa70b39-1929-4d84-a7ca-bbbfc775ea07","e98e388c-a2f4-4843-b1d4-180d883548c9","8cc9e668-0eb9-4786-b9d3-df338991a1d8","c5258e0c-368a-4a61-9873-e377c40d7d74","1381a1b9-8c35-47a5-962e-a0e2fe1d420c","f757a48d-76e9-4fce-b9c9-f069202e1a44","af57c8e8-f655-4901-87b4-0fccc44e3fa3","e005139d-805e-499a-a107-51fb0dc3fc7f","50677bf0-3acc-4058-88cb-64cb254869df","3c6c385b-6235-4df1-a4f1-5ddd36a6abfe","2f16ce43-df17-4cfe-ae62-a62a3c7d5eef","ed53f2b9-10a8-4c9b-a453-f172467d73cf","9973c0e7-15d6-49fc-b40c-b46968bb1780","f626e6f5-5f08-4f9c-bfb4-7f27cc7d09d3","de839c47-441b-4142-9934-e8e68de833ec","99fa8d85-580d-40b6-9861-8ec2034ae61f","bca4db82-0984-4b3a-aeb2-6a04cf58d4b7","394448a9-e0cb-4ce0-872e-908777a83200","942214cd-5acc-4582-bcbe-467643a06a49","15ea6ab6-e462-4ccd-b51b-6514c5b7ce3f","dc46f710-66f2-478f-8eab-1d9090db667f","4be72626-06bc-4f10-883d-b6cf887d0fe1","28915e05-5392-4ccb-b967-1a49cabc8fec","56684c5c-d321-4d2c-be1f-278046624a71","5fc16d3b-5141-4373-913a-5d1e9a058fbf","a3f7a0ba-412f-46e3-90cb-838e1a351773","0bc153bf-33f5-4a94-8772-c05749a3c096","3e3f56ec-9b65-4e89-b4ad-12e1630267f3","be811a85-5693-4315-8cf5-19a5dd47ec75"],"benchmarkVersion":"4-ai-agent-frameworks-2026-07-27-models-64232fd32583","providerMatrixVersion":"64232fd32583"}{"corpusVersion":"ai-agent-frameworks-2026-07-27","runArtifactIds":["50b4facf-0ca0-46d3-b1ae-5ab8b788f220","fdc1ecfc-1d30-4119-9aec-cc09584ef3f2","8c42cbac-a691-46a8-8e78-bc62abd553b1","3820da23-caba-4241-a198-e24a1ab3cb83","2c6b2181-cf7a-47bc-8cfd-1088c15f6eef","256c7272-6e23-4196-a59a-6896ad1abc3e","64971db9-6242-42ed-81f1-5274f6f638f0","faa70b39-1929-4d84-a7ca-bbbfc775ea07","e98e388c-a2f4-4843-b1d4-180d883548c9","8cc9e668-0eb9-4786-b9d3-df338991a1d8","c5258e0c-368a-4a61-9873-e377c40d7d74","1381a1b9-8c35-47a5-962e-a0e2fe1d420c","f757a48d-76e9-4fce-b9c9-f069202e1a44","af57c8e8-f655-4901-87b4-0fccc44e3fa3","e005139d-805e-499a-a107-51fb0dc3fc7f","50677bf0-3acc-4058-88cb-64cb254869df","3c6c385b-6235-4df1-a4f1-5ddd36a6abfe","2f16ce43-df17-4cfe-ae62-a62a3c7d5eef","ed53f2b9-10a8-4c9b-a453-f172467d73cf","9973c0e7-15d6-49fc-b40c-b46968bb1780","f626e6f5-5f08-4f9c-bfb4-7f27cc7d09d3","de839c47-441b-4142-9934-e8e68de833ec","99fa8d85-580d-40b6-9861-8ec2034ae61f","bca4db82-0984-4b3a-aeb2-6a04cf58d4b7","394448a9-e0cb-4ce0-872e-908777a83200","942214cd-5acc-4582-bcbe-467643a06a49","15ea6ab6-e462-4ccd-b51b-6514c5b7ce3f","dc46f710-66f2-478f-8eab-1d9090db667f","4be72626-06bc-4f10-883d-b6cf887d0fe1","28915e05-5392-4ccb-b967-1a49cabc8fec","56684c5c-d321-4d2c-be1f-278046624a71","5fc16d3b-5141-4373-913a-5d1e9a058fbf","a3f7a0ba-412f-46e3-90cb-838e1a351773","0bc153bf-33f5-4a94-8772-c05749a3c096","3e3f56ec-9b65-4e89-b4ad-12e1630267f3","be811a85-5693-4315-8cf5-19a5dd47ec75"],"benchmarkVersion":"4-ai-agent-frameworks-2026-07-27-models-64232fd32583","providerMatrixVersion":"64232fd32583"}{"corpusVersion":"ai-agent-frameworks-2026-07-27","runArtifactIds":["50b4facf-0ca0-46d3-b1ae-5ab8b788f220","fdc1ecfc-1d30-4119-9aec-cc09584ef3f2","8c42cbac-a691-46a8-8e78-bc62abd553b1","3820da23-caba-4241-a198-e24a1ab3cb83","2c6b2181-cf7a-47bc-8cfd-1088c15f6eef","256c7272-6e23-4196-a59a-6896ad1abc3e","64971db9-6242-42ed-81f1-5274f6f638f0","faa70b39-1929-4d84-a7ca-bbbfc775ea07","e98e388c-a2f4-4843-b1d4-180d883548c9","8cc9e668-0eb9-4786-b9d3-df338991a1d8","c5258e0c-368a-4a61-9873-e377c40d7d74","1381a1b9-8c35-47a5-962e-a0e2fe1d420c","f757a48d-76e9-4fce-b9c9-f069202e1a44","af57c8e8-f655-4901-87b4-0fccc44e3fa3","e005139d-805e-499a-a107-51fb0dc3fc7f","50677bf0-3acc-4058-88cb-64cb254869df","3c6c385b-6235-4df1-a4f1-5ddd36a6abfe","2f16ce43-df17-4cfe-ae62-a62a3c7d5eef","ed53f2b9-10a8-4c9b-a453-f172467d73cf","9973c0e7-15d6-49fc-b40c-b46968bb1780","f626e6f5-5f08-4f9c-bfb4-7f27cc7d09d3","de839c47-441b-4142-9934-e8e68de833ec","99fa8d85-580d-40b6-9861-8ec2034ae61f","bca4db82-0984-4b3a-aeb2-6a04cf58d4b7","394448a9-e0cb-4ce0-872e-908777a83200","942214cd-5acc-4582-bcbe-467643a06a49","15ea6ab6-e462-4ccd-b51b-6514c5b7ce3f","dc46f710-66f2-478f-8eab-1d9090db667f","4be72626-06bc-4f10-883d-b6cf887d0fe1","28915e05-5392-4ccb-b967-1a49cabc8fec","56684c5c-d321-4d2c-be1f-278046624a71","5fc16d3b-5141-4373-913a-5d1e9a058fbf","a3f7a0ba-412f-46e3-90cb-838e1a351773","0bc153bf-33f5-4a94-8772-c05749a3c096","3e3f56ec-9b65-4e89-b4ad-12e1630267f3","be811a85-5693-4315-8cf5-19a5dd47ec75"],"benchmarkVersion":"4-ai-agent-frameworks-2026-07-27-models-64232fd32583","providerMatrixVersion":"64232fd32583"}{"corpusVersion":"ai-agent-frameworks-2026-07-27","runArtifactIds":["50b4facf-0ca0-46d3-b1ae-5ab8b788f220","fdc1ecfc-1d30-4119-9aec-cc09584ef3f2","8c42cbac-a691-46a8-8e78-bc62abd553b1","3820da23-caba-4241-a198-e24a1ab3cb83","2c6b2181-cf7a-47bc-8cfd-1088c15f6eef","256c7272-6e23-4196-a59a-6896ad1abc3e","64971db9-6242-42ed-81f1-5274f6f638f0","faa70b39-1929-4d84-a7ca-bbbfc775ea07","e98e388c-a2f4-4843-b1d4-180d883548c9","8cc9e668-0eb9-4786-b9d3-df338991a1d8","c5258e0c-368a-4a61-9873-e377c40d7d74","1381a1b9-8c35-47a5-962e-a0e2fe1d420c","f757a48d-76e9-4fce-b9c9-f069202e1a44","af57c8e8-f655-4901-87b4-0fccc44e3fa3","e005139d-805e-499a-a107-51fb0dc3fc7f","50677bf0-3acc-4058-88cb-64cb254869df","3c6c385b-6235-4df1-a4f1-5ddd36a6abfe","2f16ce43-df17-4cfe-ae62-a62a3c7d5eef","ed53f2b9-10a8-4c9b-a453-f172467d73cf","9973c0e7-15d6-49fc-b40c-b46968bb1780","f626e6f5-5f08-4f9c-bfb4-7f27cc7d09d3","de839c47-441b-4142-9934-e8e68de833ec","99fa8d85-580d-40b6-9861-8ec2034ae61f","bca4db82-0984-4b3a-aeb2-6a04cf58d4b7","394448a9-e0cb-4ce0-872e-908777a83200","942214cd-5acc-4582-bcbe-467643a06a49","15ea6ab6-e462-4ccd-b51b-6514c5b7ce3f","dc46f710-66f2-478f-8eab-1d9090db667f","4be72626-06bc-4f10-883d-b6cf887d0fe1","28915e05-5392-4ccb-b967-1a49cabc8fec","56684c5c-d321-4d2c-be1f-278046624a71","5fc16d3b-5141-4373-913a-5d1e9a058fbf","a3f7a0ba-412f-46e3-90cb-838e1a351773","0bc153bf-33f5-4a94-8772-c05749a3c096","3e3f56ec-9b65-4e89-b4ad-12e1630267f3","be811a85-5693-4315-8cf5-19a5dd47ec75"],"benchmarkVersion":"4-ai-agent-frameworks-2026-07-27-models-64232fd32583","providerMatrixVersion":"64232fd32583"}{"corpusVersion":"ai-agent-frameworks-2026-07-27","runArtifactIds":["50b4facf-0ca0-46d3-b1ae-5ab8b788f220","fdc1ecfc-1d30-4119-9aec-cc09584ef3f2","8c42cbac-a691-46a8-8e78-bc62abd553b1","3820da23-caba-4241-a198-e24a1ab3cb83","2c6b2181-cf7a-47bc-8cfd-1088c15f6eef","256c7272-6e23-4196-a59a-6896ad1abc3e","64971db9-6242-42ed-81f1-5274f6f638f0","faa70b39-1929-4d84-a7ca-bbbfc775ea07","e98e388c-a2f4-4843-b1d4-180d883548c9","8cc9e668-0eb9-4786-b9d3-df338991a1d8","c5258e0c-368a-4a61-9873-e377c40d7d74","1381a1b9-8c35-47a5-962e-a0e2fe1d420c","f757a48d-76e9-4fce-b9c9-f069202e1a44","af57c8e8-f655-4901-87b4-0fccc44e3fa3","e005139d-805e-499a-a107-51fb0dc3fc7f","50677bf0-3acc-4058-88cb-64cb254869df","3c6c385b-6235-4df1-a4f1-5ddd36a6abfe","2f16ce43-df17-4cfe-ae62-a62a3c7d5eef","ed53f2b9-10a8-4c9b-a453-f172467d73cf","9973c0e7-15d6-49fc-b40c-b46968bb1780","f626e6f5-5f08-4f9c-bfb4-7f27cc7d09d3","de839c47-441b-4142-9934-e8e68de833ec","99fa8d85-580d-40b6-9861-8ec2034ae61f","bca4db82-0984-4b3a-aeb2-6a04cf58d4b7","394448a9-e0cb-4ce0-872e-908777a83200","942214cd-5acc-4582-bcbe-467643a06a49","15ea6ab6-e462-4ccd-b51b-6514c5b7ce3f","dc46f710-66f2-478f-8eab-1d9090db667f","4be72626-06bc-4f10-883d-b6cf887d0fe1","28915e05-5392-4ccb-b967-1a49cabc8fec","56684c5c-d321-4d2c-be1f-278046624a71","5fc16d3b-5141-4373-913a-5d1e9a058fbf","a3f7a0ba-412f-46e3-90cb-838e1a351773","0bc153bf-33f5-4a94-8772-c05749a3c096","3e3f56ec-9b65-4e89-b4ad-12e1630267f3","be811a85-5693-4315-8cf5-19a5dd47ec75"],"benchmarkVersion":"4-ai-agent-frameworks-2026-07-27-models-64232fd32583","providerMatrixVersion":"64232fd32583"}{"corpusVersion":"ai-agent-frameworks-2026-07-27","runArtifactIds":["50b4facf-0ca0-46d3-b1ae-5ab8b788f220","fdc1ecfc-1d30-4119-9aec-cc09584ef3f2","8c42cbac-a691-46a8-8e78-bc62abd553b1","3820da23-caba-4241-a198-e24a1ab3cb83","2c6b2181-cf7a-47bc-8cfd-1088c15f6eef","256c7272-6e23-4196-a59a-6896ad1abc3e","64971db9-6242-42ed-81f1-5274f6f638f0","faa70b39-1929-4d84-a7ca-bbbfc775ea07","e98e388c-a2f4-4843-b1d4-180d883548c9","8cc9e668-0eb9-4786-b9d3-df338991a1d8","c5258e0c-368a-4a61-9873-e377c40d7d74","1381a1b9-8c35-47a5-962e-a0e2fe1d420c","f757a48d-76e9-4fce-b9c9-f069202e1a44","af57c8e8-f655-4901-87b4-0fccc44e3fa3","e005139d-805e-499a-a107-51fb0dc3fc7f","50677bf0-3acc-4058-88cb-64cb254869df","3c6c385b-6235-4df1-a4f1-5ddd36a6abfe","2f16ce43-df17-4cfe-ae62-a62a3c7d5eef","ed53f2b9-10a8-4c9b-a453-f172467d73cf","9973c0e7-15d6-49fc-b40c-b46968bb1780","f626e6f5-5f08-4f9c-bfb4-7f27cc7d09d3","de839c47-441b-4142-9934-e8e68de833ec","99fa8d85-580d-40b6-9861-8ec2034ae61f","bca4db82-0984-4b3a-aeb2-6a04cf58d4b7","394448a9-e0cb-4ce0-872e-908777a83200","942214cd-5acc-4582-bcbe-467643a06a49","15ea6ab6-e462-4ccd-b51b-6514c5b7ce3f","dc46f710-66f2-478f-8eab-1d9090db667f","4be72626-06bc-4f10-883d-b6cf887d0fe1","28915e05-5392-4ccb-b967-1a49cabc8fec","56684c5c-d321-4d2c-be1f-278046624a71","5fc16d3b-5141-4373-913a-5d1e9a058fbf","a3f7a0ba-412f-46e3-90cb-838e1a351773","0bc153bf-33f5-4a94-8772-c05749a3c096","3e3f56ec-9b65-4e89-b4ad-12e1630267f3","be811a85-5693-4315-8cf5-19a5dd47ec75"],"benchmarkVersion":"4-ai-agent-frameworks-2026-07-27-models-64232fd32583","providerMatrixVersion":"64232fd32583"}{"corpusVersion":"ai-agent-frameworks-2026-07-27","runArtifactIds":["50b4facf-0ca0-46d3-b1ae-5ab8b788f220","fdc1ecfc-1d30-4119-9aec-cc09584ef3f2","8c42cbac-a691-46a8-8e78-bc62abd553b1","3820da23-caba-4241-a198-e24a1ab3cb83","2c6b2181-cf7a-47bc-8cfd-1088c15f6eef","256c7272-6e23-4196-a59a-6896ad1abc3e","64971db9-6242-42ed-81f1-5274f6f638f0","faa70b39-1929-4d84-a7ca-bbbfc775ea07","e98e388c-a2f4-4843-b1d4-180d883548c9","8cc9e668-0eb9-4786-b9d3-df338991a1d8","c5258e0c-368a-4a61-9873-e377c40d7d74","1381a1b9-8c35-47a5-962e-a0e2fe1d420c","f757a48d-76e9-4fce-b9c9-f069202e1a44","af57c8e8-f655-4901-87b4-0fccc44e3fa3","e005139d-805e-499a-a107-51fb0dc3fc7f","50677bf0-3acc-4058-88cb-64cb254869df","3c6c385b-6235-4df1-a4f1-5ddd36a6abfe","2f16ce43-df17-4cfe-ae62-a62a3c7d5eef","ed53f2b9-10a8-4c9b-a453-f172467d73cf","9973c0e7-15d6-49fc-b40c-b46968bb1780","f626e6f5-5f08-4f9c-bfb4-7f27cc7d09d3","de839c47-441b-4142-9934-e8e68de833ec","99fa8d85-580d-40b6-9861-8ec2034ae61f","bca4db82-0984-4b3a-aeb2-6a04cf58d4b7","394448a9-e0cb-4ce0-872e-908777a83200","942214cd-5acc-4582-bcbe-467643a06a49","15ea6ab6-e462-4ccd-b51b-6514c5b7ce3f","dc46f710-66f2-478f-8eab-1d9090db667f","4be72626-06bc-4f10-883d-b6cf887d0fe1","28915e05-5392-4ccb-b967-1a49cabc8fec","56684c5c-d321-4d2c-be1f-278046624a71","5fc16d3b-5141-4373-913a-5d1e9a058fbf","a3f7a0ba-412f-46e3-90cb-838e1a351773","0bc153bf-33f5-4a94-8772-c05749a3c096","3e3f56ec-9b65-4e89-b4ad-12e1630267f3","be811a85-5693-4315-8cf5-19a5dd47ec75"],"benchmarkVersion":"4-ai-agent-frameworks-2026-07-27-models-64232fd32583","providerMatrixVersion":"64232fd32583"}