Loading ranking table…
Loading the latest published snapshot and its supporting evidence.
LIVE RANKINGS & DATA
Loading the latest published snapshot and its supporting evidence.
Ranks reviewed LLM Observability brands by the number of benchmark engines on which they appear.
| Rank | Entity | Signal | Engine breadth | Mention coverage | Mention share | Citation share | Engine breadth | OpenAI rec. presence | OpenAI coverage | Confidence | N | Change | Trend | Explain | Compare |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 01 | Braintrustcompany | 3 engines | 50% | 21.18% | 23.21% | 3 | 50% | 41.67% | 100% | 3 | — | — | Analyze brandWhy this rank | ||
| 02 | Langfusecompany | 3 engines | 38.89% | 16.47% | 12.5% | 3 | 62.5% | 41.67% | 100% | 3 | — | — | Analyze brandWhy this rank | ||
| 03 | Maxim AIcompany | 3 engines | 30.56% | 12.94% | 8.93% | 3 | 50% | 33.33% | 100% | 3 | — | — | Analyze brandWhy this rank | ||
| 04 | Arize AI / Phoenixcompany | 3 engines | 27.78% | 11.76% | 25% | 3 | 12.5% | 8.33% | 100% | 3 | — | — | Analyze brandWhy this rank | ||
| 05 | LangSmithcompany | 3 engines | 13.89% | 5.88% | 5.36% | 3 | 12.5% | 8.33% | 100% | 3 | — | — | Analyze brandWhy this rank | ||
| 06 | Fiddlercompany | 3 engines | 13.89% | 5.88% | 10.71% | 3 | 12.5% | 8.33% | 100% | 3 | — | — | Analyze brandWhy this rank | ||
| 07 | Datadog LLM Observabilitycompany | 3 engines | 16.67% | 7.06% | 3.57% | 3 | 12.5% | 25% | 100% | 3 | — | — | Analyze brandWhy this rank | ||
| 08 | Galileocompany | 2 engines | 13.89% | 5.88% | 7.14% | 2 | 12.5% | 8.33% | 100% | 3 | — | — | Analyze brandWhy this rank | ||
| 09 | Heliconecompany | 2 engines | 11.11% | 4.71% | 0% | 2 | 25% | 16.67% | 100% | 3 | — | — | Analyze brandWhy this rank | ||
| 10 | Traceloopcompany | 2 engines | 8.33% | 3.53% | 1.79% | 2 | 0% | 0% | 100% | 3 | — | — | Analyze brandViewing why | ||
| 11 | Opik by Cometcompany | 2 engines | 5.56% | 2.35% | 1.79% | 2 | 0% | 0% | 100% | 3 | — | — | Analyze brandWhy this rank | ||
| 12 | New Relic AI Observabilitycompany | 2 engines | 5.56% | 2.35% | 0% | 2 | 12.5% | 8.33% | 100% | 3 | — | — | Analyze brandWhy this rank | ||
| 13 | HoneyHivecompany | 0 engines | 0% | 0% | 0% | 0 | 0% | 0% | 100% | 3 | — | — | Analyze brandWhy this rank | ||
| 14 | Humanloopcompany | 0 engines | 0% | 0% | 0% | 0 | 0% | 0% | 100% | 3 | — | — | Analyze brandWhy this rank | ||
| 15 | Patronus AIcompany | 0 engines | 0% | 0% | 0% | 0 | 0% | 0% | 100% | 3 | — | — | Analyze brandWhy this rank | ||
| 16 | W&B Weavecompany | 0 engines | 0% | 0% | 0% | 0 | 0% | 0% | 100% | 3 | — | — | Analyze brandWhy this rank |
Compare one brand with up to three competitors across the exact public prompt × engine matrix behind this leaderboard.
| Brand | Presence | Vs. primary | Selected share | Mentions | Cited answers | Owned URL signals | Engine breadth |
|---|---|---|---|---|---|---|---|
| Braintrustbraintrust.dev | 50.0%18/36 | +36.1 pp | 38.3% | 32 | 12 | 13 | 3/3 |
| Langfuselangfuse.com | 38.9%14/36 | +25.0 pp | 29.8% | 31 | 5 | 7 | 3/3 |
| Arize AI / Phoenixarize.com | 27.8%10/36 | +13.9 pp | 21.3% | 10 | 5 | 14 | 3/3 |
| LangSmithlangchain.com | 13.9%5/36 | BASE | 10.6% | 8 | 3 | 3 | 3/3 |
12 prompts · 36 immutable answer hashes · empty cells mean no compared brand was detected.
| Public prompt | OpenAIopenai/gpt-4o-mini | Anthropicanthropic/claude-haiku-4-5 | Geminigoogle/gemini-2.5-flash |
|---|---|---|---|
| 01 What are the best observability platforms for a production application powered by large language models?recommendation | LangfuseBraintrust | Arize AI / PhoenixLangfuse · C1 | LangSmith · C1Arize AI / PhoenixLangfuse |
| 02 Recommend an open-source system for self-hosted language-model tracing, evaluations, and prompt analytics.recommendation | Langfuse | Langfuse · C2Braintrust | LangSmith · C1Langfuse · C1Braintrust · C1 |
| 03 Which enterprise AI observability platform offers private deployment, role-based access, SSO, audit logs, and data residency?recommendation | No selected brand | Arize AI / Phoenix · C1 | No selected brand |
| 04 What is the best platform for tracing multi-agent workflows, tool calls, handoffs, and Model Context Protocol activity?recommendation | LangfuseBraintrust | LangSmithArize AI / Phoenix · C7Braintrust | Arize AI / PhoenixLangfuse · C1Braintrust |
| 05 Recommend an observability tool for debugging retrieval quality, context relevance, groundedness, and hallucinations in RAG systems.recommendation | LangSmith · C1Arize AI / PhoenixLangfuse | Arize AI / PhoenixLangfuseBraintrust · C1 | LangSmithLangfuseBraintrust · C1 |
| 06 Which platform is best for online evaluations, production quality monitoring, failure clustering, and regression alerts?recommendation | LangfuseBraintrust · C1 | Arize AI / Phoenix · C4Braintrust | No selected brand |
| 07 Recommend a platform for versioned evaluation datasets, prompt experiments, human review, and quality gates in CI.recommendation | Braintrust · C1 | LangfuseBraintrust · C1 | Arize AI / Phoenix · C1Braintrust · C1 |
| 08 What is the best language-model gateway with request tracing, token cost, latency, caching, and provider reliability analytics?recommendation | No selected brand | Braintrust · C1 | Braintrust · C1 |
| 09 How should a team compare AI observability pricing across traces, events, retention, evaluator runs, seats, and data volume?commercial | Braintrust · C1 | Langfuse · C2Braintrust · C2 | Braintrust · C1 |
| 10 Which privacy and security criteria matter when buying AI observability, including redaction, sampling, and data retention?commercial | No selected brand | No selected brand | No selected brand |
| 11 Should a production AI team prefer OpenTelemetry-compatible instrumentation or a proprietary tracing SDK?commercial | No selected brand | No selected brand | No selected brand |
| 12 When should a team buy a language-model evaluation and observability platform instead of building one internally?commercial | No selected brand | No selected brand | Arize AI / Phoenix · C1 |
Hostnames are derived from validated public HTTP(S) URLs, not provider-supplied domain labels.
| Source hostname | Cited answers | Distinct URLs | Engine breadth | Best position | Evidence |
|---|---|---|---|---|---|
| braintrust.dev | 12 | 9 | 3 | #1 | Open source ↗ |
| reddit.com | 9 | 10 | 3 | #1 | Open source ↗ |
| confident-ai.com | 7 | 7 | 3 | #1 | Open source ↗ |
| github.com | 6 | 6 | 3 | #2 | Open source ↗ |
| arize.com | 5 | 13 | 2 | #1 | Open source ↗ |
| langfuse.com | 5 | 7 | 2 | #1 | Open source ↗ |
| getmaxim.ai | 5 | 5 | 2 | #3 | Open source ↗ |
| truefoundry.com | 5 | 4 | 3 | #1 | Open source ↗ |
| galileo.ai | 4 | 4 | 1 | #1 | Open source ↗ |
| medium.com | 4 | 4 | 2 | #1 | Open source ↗ |
| openobserve.ai | 4 | 3 | 2 | #2 | Open source ↗ |
| montecarlo.ai | 4 | 2 | 2 | #1 | Open source ↗ |
| fiddler.ai | 3 | 4 | 3 | #1 | Open source ↗ |
| youtube.com | 3 | 4 | 2 | #2 | Open source ↗ |
| dev.to | 3 | 3 | 2 | #1 | Open source ↗ |
| linkedin.com | 3 | 3 | 2 | #1 | Open source ↗ |
| portkey.ai | 3 | 3 | 2 | #1 | Open source ↗ |
| posthog.com | 3 | 3 | 1 | #1 | Open source ↗ |
| groundcover.com | 3 | 3 | 2 | #4 | Open source ↗ |
| techtarget.com | 3 | 3 | 2 | #4 | Open source ↗ |
Ranks a reviewed LLM Observability brand universe using a fixed, public set of neutral commercial prompts across 3 AI providers.
Some explanation inputs are unavailable Missing: comparablePriorRanking.
| Component | Value | Weight | Contribution | Evidence | Status |
|---|---|---|---|---|---|
| public prompt anthropic brand citation share | 0 | 0% | — | 1 | available |
| public prompt anthropic brand mention coverage | 8.333333 | 0% | — | 1 | available |
| public prompt anthropic brand recommendation presence | 12.5 | 0% | — | 1 | available |
| public prompt brand citation share | 1.785714 | 0% | — | 1 | available |
|---|
| public prompt brand engine breadth | 2 | 100% | 2 | 1 | available |
|---|
| public prompt brand mention coverage | 8.333333 | 0% | — | 1 | available |
|---|
| public prompt brand mention share | 3.529412 | 0% | — | 1 | available |
|---|
| public prompt brand recommendation presence | 12.5 | 0% | — | 1 | available |
|---|
| public prompt gemini brand citation share | 4.761905 | 0% | — | 1 | available |
|---|
| public prompt gemini brand mention coverage | 16.666667 | 0% | — | 1 | available |
|---|
| public prompt gemini brand recommendation presence | 25 | 0% | — | 1 | available |
|---|
| public prompt openai brand citation share | 0 | 0% | — | 1 | available |
|---|
| public prompt openai brand mention coverage | 0 | 0% | — | 1 | available |
|---|
| public prompt openai brand recommendation presence | 0 | 0% | — | 1 | available |
|---|
no_prior_published_snapshot
No comparable component drivers were published.
{"corpusVersion":"llm-observability-platforms-2026-07-27","runArtifactIds":["ff51f5d1-1720-45ed-9fea-0b8b7e85abcc","419fb026-eb99-42c7-8981-6ab5eac178c0","db2a70e7-c946-482b-9234-5d119aa96991","1145f959-a5a9-410b-a3cb-f724506487d8","992cb25e-12e3-496e-beef-fe28743bccf4","3bff15b2-2d3c-46e0-b2a9-60cc0f4214df","06c1bb63-4d7a-46e2-8d34-8d6959751467","aedc1b9a-4fe5-4cdc-92fe-6ad8067f03d3","0bb004dc-9a4e-45ec-9e2b-873494c3c74d","8827ccfa-97cd-4c5e-8f8f-c2e5e1053c7a","2156c8f0-72ae-46f1-93e1-d0fc01117c2c","d9e9c763-c3dd-44fa-a406-9ec3f046a664","f1edd715-074f-46aa-a729-c3f06c2be3be","5814a292-0f1c-4ff8-aee5-9d4baa929d7a","258a2c29-acc9-4012-96af-01b70cdcad58","81fe4599-094a-413f-8a58-f584360f8361","b829a157-1f72-4aaa-af2c-8c8fe2ca2259","5b095e47-3542-478a-a862-6d8d5c101a43","db782a22-090a-46d2-808a-8727cde6f273","3942ceb2-3661-4065-bec5-9dc8dfe7d09d","25803bdf-1de3-4098-8b6b-2e35374fe134","7548f89b-7cbb-437a-b137-b1ec440e2d1b","eebb3aeb-e7e6-4052-b9a4-f4b2077f5863","db72cedb-5c9a-4d59-bdae-7dee4b75e781","0d498a02-4a0f-4aa1-9c76-cc46c64f00bf","febe1839-7b15-4e16-9f86-8c99b0b96179","e66d737b-f051-4411-ab7f-2ab94c6b3a0b","d54727a5-1cfa-49a3-b69b-7dfac548c1ca","d0453795-cdd9-443a-a84d-6cdd1e1bf90d","659a831f-a616-4754-b024-c4980a1c6cda","c52f100a-2c08-458a-a210-acf262e593c1","14443c58-a3cf-4a84-bd34-91fff0647e98","97f79dc4-f68d-4643-bd61-0b481d855dc6","b422e895-372d-4694-ad0d-89b4dfda3b1d","e18fff5a-b595-4a13-9383-3a1de17a0dab","691f9d7b-eb83-48b2-91de-8ad64d13a48b"],"benchmarkVersion":"4-llm-observability-platforms-2026-07-27-models-64232fd32583","providerMatrixVersion":"64232fd32583"}{"corpusVersion":"llm-observability-platforms-2026-07-27","runArtifactIds":["ff51f5d1-1720-45ed-9fea-0b8b7e85abcc","419fb026-eb99-42c7-8981-6ab5eac178c0","db2a70e7-c946-482b-9234-5d119aa96991","1145f959-a5a9-410b-a3cb-f724506487d8","992cb25e-12e3-496e-beef-fe28743bccf4","3bff15b2-2d3c-46e0-b2a9-60cc0f4214df","06c1bb63-4d7a-46e2-8d34-8d6959751467","aedc1b9a-4fe5-4cdc-92fe-6ad8067f03d3","0bb004dc-9a4e-45ec-9e2b-873494c3c74d","8827ccfa-97cd-4c5e-8f8f-c2e5e1053c7a","2156c8f0-72ae-46f1-93e1-d0fc01117c2c","d9e9c763-c3dd-44fa-a406-9ec3f046a664","f1edd715-074f-46aa-a729-c3f06c2be3be","5814a292-0f1c-4ff8-aee5-9d4baa929d7a","258a2c29-acc9-4012-96af-01b70cdcad58","81fe4599-094a-413f-8a58-f584360f8361","b829a157-1f72-4aaa-af2c-8c8fe2ca2259","5b095e47-3542-478a-a862-6d8d5c101a43","db782a22-090a-46d2-808a-8727cde6f273","3942ceb2-3661-4065-bec5-9dc8dfe7d09d","25803bdf-1de3-4098-8b6b-2e35374fe134","7548f89b-7cbb-437a-b137-b1ec440e2d1b","eebb3aeb-e7e6-4052-b9a4-f4b2077f5863","db72cedb-5c9a-4d59-bdae-7dee4b75e781","0d498a02-4a0f-4aa1-9c76-cc46c64f00bf","febe1839-7b15-4e16-9f86-8c99b0b96179","e66d737b-f051-4411-ab7f-2ab94c6b3a0b","d54727a5-1cfa-49a3-b69b-7dfac548c1ca","d0453795-cdd9-443a-a84d-6cdd1e1bf90d","659a831f-a616-4754-b024-c4980a1c6cda","c52f100a-2c08-458a-a210-acf262e593c1","14443c58-a3cf-4a84-bd34-91fff0647e98","97f79dc4-f68d-4643-bd61-0b481d855dc6","b422e895-372d-4694-ad0d-89b4dfda3b1d","e18fff5a-b595-4a13-9383-3a1de17a0dab","691f9d7b-eb83-48b2-91de-8ad64d13a48b"],"benchmarkVersion":"4-llm-observability-platforms-2026-07-27-models-64232fd32583","providerMatrixVersion":"64232fd32583"}{"corpusVersion":"llm-observability-platforms-2026-07-27","runArtifactIds":["ff51f5d1-1720-45ed-9fea-0b8b7e85abcc","419fb026-eb99-42c7-8981-6ab5eac178c0","db2a70e7-c946-482b-9234-5d119aa96991","1145f959-a5a9-410b-a3cb-f724506487d8","992cb25e-12e3-496e-beef-fe28743bccf4","3bff15b2-2d3c-46e0-b2a9-60cc0f4214df","06c1bb63-4d7a-46e2-8d34-8d6959751467","aedc1b9a-4fe5-4cdc-92fe-6ad8067f03d3","0bb004dc-9a4e-45ec-9e2b-873494c3c74d","8827ccfa-97cd-4c5e-8f8f-c2e5e1053c7a","2156c8f0-72ae-46f1-93e1-d0fc01117c2c","d9e9c763-c3dd-44fa-a406-9ec3f046a664","f1edd715-074f-46aa-a729-c3f06c2be3be","5814a292-0f1c-4ff8-aee5-9d4baa929d7a","258a2c29-acc9-4012-96af-01b70cdcad58","81fe4599-094a-413f-8a58-f584360f8361","b829a157-1f72-4aaa-af2c-8c8fe2ca2259","5b095e47-3542-478a-a862-6d8d5c101a43","db782a22-090a-46d2-808a-8727cde6f273","3942ceb2-3661-4065-bec5-9dc8dfe7d09d","25803bdf-1de3-4098-8b6b-2e35374fe134","7548f89b-7cbb-437a-b137-b1ec440e2d1b","eebb3aeb-e7e6-4052-b9a4-f4b2077f5863","db72cedb-5c9a-4d59-bdae-7dee4b75e781","0d498a02-4a0f-4aa1-9c76-cc46c64f00bf","febe1839-7b15-4e16-9f86-8c99b0b96179","e66d737b-f051-4411-ab7f-2ab94c6b3a0b","d54727a5-1cfa-49a3-b69b-7dfac548c1ca","d0453795-cdd9-443a-a84d-6cdd1e1bf90d","659a831f-a616-4754-b024-c4980a1c6cda","c52f100a-2c08-458a-a210-acf262e593c1","14443c58-a3cf-4a84-bd34-91fff0647e98","97f79dc4-f68d-4643-bd61-0b481d855dc6","b422e895-372d-4694-ad0d-89b4dfda3b1d","e18fff5a-b595-4a13-9383-3a1de17a0dab","691f9d7b-eb83-48b2-91de-8ad64d13a48b"],"benchmarkVersion":"4-llm-observability-platforms-2026-07-27-models-64232fd32583","providerMatrixVersion":"64232fd32583"}{"corpusVersion":"llm-observability-platforms-2026-07-27","runArtifactIds":["ff51f5d1-1720-45ed-9fea-0b8b7e85abcc","419fb026-eb99-42c7-8981-6ab5eac178c0","db2a70e7-c946-482b-9234-5d119aa96991","1145f959-a5a9-410b-a3cb-f724506487d8","992cb25e-12e3-496e-beef-fe28743bccf4","3bff15b2-2d3c-46e0-b2a9-60cc0f4214df","06c1bb63-4d7a-46e2-8d34-8d6959751467","aedc1b9a-4fe5-4cdc-92fe-6ad8067f03d3","0bb004dc-9a4e-45ec-9e2b-873494c3c74d","8827ccfa-97cd-4c5e-8f8f-c2e5e1053c7a","2156c8f0-72ae-46f1-93e1-d0fc01117c2c","d9e9c763-c3dd-44fa-a406-9ec3f046a664","f1edd715-074f-46aa-a729-c3f06c2be3be","5814a292-0f1c-4ff8-aee5-9d4baa929d7a","258a2c29-acc9-4012-96af-01b70cdcad58","81fe4599-094a-413f-8a58-f584360f8361","b829a157-1f72-4aaa-af2c-8c8fe2ca2259","5b095e47-3542-478a-a862-6d8d5c101a43","db782a22-090a-46d2-808a-8727cde6f273","3942ceb2-3661-4065-bec5-9dc8dfe7d09d","25803bdf-1de3-4098-8b6b-2e35374fe134","7548f89b-7cbb-437a-b137-b1ec440e2d1b","eebb3aeb-e7e6-4052-b9a4-f4b2077f5863","db72cedb-5c9a-4d59-bdae-7dee4b75e781","0d498a02-4a0f-4aa1-9c76-cc46c64f00bf","febe1839-7b15-4e16-9f86-8c99b0b96179","e66d737b-f051-4411-ab7f-2ab94c6b3a0b","d54727a5-1cfa-49a3-b69b-7dfac548c1ca","d0453795-cdd9-443a-a84d-6cdd1e1bf90d","659a831f-a616-4754-b024-c4980a1c6cda","c52f100a-2c08-458a-a210-acf262e593c1","14443c58-a3cf-4a84-bd34-91fff0647e98","97f79dc4-f68d-4643-bd61-0b481d855dc6","b422e895-372d-4694-ad0d-89b4dfda3b1d","e18fff5a-b595-4a13-9383-3a1de17a0dab","691f9d7b-eb83-48b2-91de-8ad64d13a48b"],"benchmarkVersion":"4-llm-observability-platforms-2026-07-27-models-64232fd32583","providerMatrixVersion":"64232fd32583"}{"corpusVersion":"llm-observability-platforms-2026-07-27","runArtifactIds":["ff51f5d1-1720-45ed-9fea-0b8b7e85abcc","419fb026-eb99-42c7-8981-6ab5eac178c0","db2a70e7-c946-482b-9234-5d119aa96991","1145f959-a5a9-410b-a3cb-f724506487d8","992cb25e-12e3-496e-beef-fe28743bccf4","3bff15b2-2d3c-46e0-b2a9-60cc0f4214df","06c1bb63-4d7a-46e2-8d34-8d6959751467","aedc1b9a-4fe5-4cdc-92fe-6ad8067f03d3","0bb004dc-9a4e-45ec-9e2b-873494c3c74d","8827ccfa-97cd-4c5e-8f8f-c2e5e1053c7a","2156c8f0-72ae-46f1-93e1-d0fc01117c2c","d9e9c763-c3dd-44fa-a406-9ec3f046a664","f1edd715-074f-46aa-a729-c3f06c2be3be","5814a292-0f1c-4ff8-aee5-9d4baa929d7a","258a2c29-acc9-4012-96af-01b70cdcad58","81fe4599-094a-413f-8a58-f584360f8361","b829a157-1f72-4aaa-af2c-8c8fe2ca2259","5b095e47-3542-478a-a862-6d8d5c101a43","db782a22-090a-46d2-808a-8727cde6f273","3942ceb2-3661-4065-bec5-9dc8dfe7d09d","25803bdf-1de3-4098-8b6b-2e35374fe134","7548f89b-7cbb-437a-b137-b1ec440e2d1b","eebb3aeb-e7e6-4052-b9a4-f4b2077f5863","db72cedb-5c9a-4d59-bdae-7dee4b75e781","0d498a02-4a0f-4aa1-9c76-cc46c64f00bf","febe1839-7b15-4e16-9f86-8c99b0b96179","e66d737b-f051-4411-ab7f-2ab94c6b3a0b","d54727a5-1cfa-49a3-b69b-7dfac548c1ca","d0453795-cdd9-443a-a84d-6cdd1e1bf90d","659a831f-a616-4754-b024-c4980a1c6cda","c52f100a-2c08-458a-a210-acf262e593c1","14443c58-a3cf-4a84-bd34-91fff0647e98","97f79dc4-f68d-4643-bd61-0b481d855dc6","b422e895-372d-4694-ad0d-89b4dfda3b1d","e18fff5a-b595-4a13-9383-3a1de17a0dab","691f9d7b-eb83-48b2-91de-8ad64d13a48b"],"benchmarkVersion":"4-llm-observability-platforms-2026-07-27-models-64232fd32583","providerMatrixVersion":"64232fd32583"}{"corpusVersion":"llm-observability-platforms-2026-07-27","runArtifactIds":["ff51f5d1-1720-45ed-9fea-0b8b7e85abcc","419fb026-eb99-42c7-8981-6ab5eac178c0","db2a70e7-c946-482b-9234-5d119aa96991","1145f959-a5a9-410b-a3cb-f724506487d8","992cb25e-12e3-496e-beef-fe28743bccf4","3bff15b2-2d3c-46e0-b2a9-60cc0f4214df","06c1bb63-4d7a-46e2-8d34-8d6959751467","aedc1b9a-4fe5-4cdc-92fe-6ad8067f03d3","0bb004dc-9a4e-45ec-9e2b-873494c3c74d","8827ccfa-97cd-4c5e-8f8f-c2e5e1053c7a","2156c8f0-72ae-46f1-93e1-d0fc01117c2c","d9e9c763-c3dd-44fa-a406-9ec3f046a664","f1edd715-074f-46aa-a729-c3f06c2be3be","5814a292-0f1c-4ff8-aee5-9d4baa929d7a","258a2c29-acc9-4012-96af-01b70cdcad58","81fe4599-094a-413f-8a58-f584360f8361","b829a157-1f72-4aaa-af2c-8c8fe2ca2259","5b095e47-3542-478a-a862-6d8d5c101a43","db782a22-090a-46d2-808a-8727cde6f273","3942ceb2-3661-4065-bec5-9dc8dfe7d09d","25803bdf-1de3-4098-8b6b-2e35374fe134","7548f89b-7cbb-437a-b137-b1ec440e2d1b","eebb3aeb-e7e6-4052-b9a4-f4b2077f5863","db72cedb-5c9a-4d59-bdae-7dee4b75e781","0d498a02-4a0f-4aa1-9c76-cc46c64f00bf","febe1839-7b15-4e16-9f86-8c99b0b96179","e66d737b-f051-4411-ab7f-2ab94c6b3a0b","d54727a5-1cfa-49a3-b69b-7dfac548c1ca","d0453795-cdd9-443a-a84d-6cdd1e1bf90d","659a831f-a616-4754-b024-c4980a1c6cda","c52f100a-2c08-458a-a210-acf262e593c1","14443c58-a3cf-4a84-bd34-91fff0647e98","97f79dc4-f68d-4643-bd61-0b481d855dc6","b422e895-372d-4694-ad0d-89b4dfda3b1d","e18fff5a-b595-4a13-9383-3a1de17a0dab","691f9d7b-eb83-48b2-91de-8ad64d13a48b"],"benchmarkVersion":"4-llm-observability-platforms-2026-07-27-models-64232fd32583","providerMatrixVersion":"64232fd32583"}{"corpusVersion":"llm-observability-platforms-2026-07-27","runArtifactIds":["ff51f5d1-1720-45ed-9fea-0b8b7e85abcc","419fb026-eb99-42c7-8981-6ab5eac178c0","db2a70e7-c946-482b-9234-5d119aa96991","1145f959-a5a9-410b-a3cb-f724506487d8","992cb25e-12e3-496e-beef-fe28743bccf4","3bff15b2-2d3c-46e0-b2a9-60cc0f4214df","06c1bb63-4d7a-46e2-8d34-8d6959751467","aedc1b9a-4fe5-4cdc-92fe-6ad8067f03d3","0bb004dc-9a4e-45ec-9e2b-873494c3c74d","8827ccfa-97cd-4c5e-8f8f-c2e5e1053c7a","2156c8f0-72ae-46f1-93e1-d0fc01117c2c","d9e9c763-c3dd-44fa-a406-9ec3f046a664","f1edd715-074f-46aa-a729-c3f06c2be3be","5814a292-0f1c-4ff8-aee5-9d4baa929d7a","258a2c29-acc9-4012-96af-01b70cdcad58","81fe4599-094a-413f-8a58-f584360f8361","b829a157-1f72-4aaa-af2c-8c8fe2ca2259","5b095e47-3542-478a-a862-6d8d5c101a43","db782a22-090a-46d2-808a-8727cde6f273","3942ceb2-3661-4065-bec5-9dc8dfe7d09d","25803bdf-1de3-4098-8b6b-2e35374fe134","7548f89b-7cbb-437a-b137-b1ec440e2d1b","eebb3aeb-e7e6-4052-b9a4-f4b2077f5863","db72cedb-5c9a-4d59-bdae-7dee4b75e781","0d498a02-4a0f-4aa1-9c76-cc46c64f00bf","febe1839-7b15-4e16-9f86-8c99b0b96179","e66d737b-f051-4411-ab7f-2ab94c6b3a0b","d54727a5-1cfa-49a3-b69b-7dfac548c1ca","d0453795-cdd9-443a-a84d-6cdd1e1bf90d","659a831f-a616-4754-b024-c4980a1c6cda","c52f100a-2c08-458a-a210-acf262e593c1","14443c58-a3cf-4a84-bd34-91fff0647e98","97f79dc4-f68d-4643-bd61-0b481d855dc6","b422e895-372d-4694-ad0d-89b4dfda3b1d","e18fff5a-b595-4a13-9383-3a1de17a0dab","691f9d7b-eb83-48b2-91de-8ad64d13a48b"],"benchmarkVersion":"4-llm-observability-platforms-2026-07-27-models-64232fd32583","providerMatrixVersion":"64232fd32583"}{"corpusVersion":"llm-observability-platforms-2026-07-27","runArtifactIds":["ff51f5d1-1720-45ed-9fea-0b8b7e85abcc","419fb026-eb99-42c7-8981-6ab5eac178c0","db2a70e7-c946-482b-9234-5d119aa96991","1145f959-a5a9-410b-a3cb-f724506487d8","992cb25e-12e3-496e-beef-fe28743bccf4","3bff15b2-2d3c-46e0-b2a9-60cc0f4214df","06c1bb63-4d7a-46e2-8d34-8d6959751467","aedc1b9a-4fe5-4cdc-92fe-6ad8067f03d3","0bb004dc-9a4e-45ec-9e2b-873494c3c74d","8827ccfa-97cd-4c5e-8f8f-c2e5e1053c7a","2156c8f0-72ae-46f1-93e1-d0fc01117c2c","d9e9c763-c3dd-44fa-a406-9ec3f046a664","f1edd715-074f-46aa-a729-c3f06c2be3be","5814a292-0f1c-4ff8-aee5-9d4baa929d7a","258a2c29-acc9-4012-96af-01b70cdcad58","81fe4599-094a-413f-8a58-f584360f8361","b829a157-1f72-4aaa-af2c-8c8fe2ca2259","5b095e47-3542-478a-a862-6d8d5c101a43","db782a22-090a-46d2-808a-8727cde6f273","3942ceb2-3661-4065-bec5-9dc8dfe7d09d","25803bdf-1de3-4098-8b6b-2e35374fe134","7548f89b-7cbb-437a-b137-b1ec440e2d1b","eebb3aeb-e7e6-4052-b9a4-f4b2077f5863","db72cedb-5c9a-4d59-bdae-7dee4b75e781","0d498a02-4a0f-4aa1-9c76-cc46c64f00bf","febe1839-7b15-4e16-9f86-8c99b0b96179","e66d737b-f051-4411-ab7f-2ab94c6b3a0b","d54727a5-1cfa-49a3-b69b-7dfac548c1ca","d0453795-cdd9-443a-a84d-6cdd1e1bf90d","659a831f-a616-4754-b024-c4980a1c6cda","c52f100a-2c08-458a-a210-acf262e593c1","14443c58-a3cf-4a84-bd34-91fff0647e98","97f79dc4-f68d-4643-bd61-0b481d855dc6","b422e895-372d-4694-ad0d-89b4dfda3b1d","e18fff5a-b595-4a13-9383-3a1de17a0dab","691f9d7b-eb83-48b2-91de-8ad64d13a48b"],"benchmarkVersion":"4-llm-observability-platforms-2026-07-27-models-64232fd32583","providerMatrixVersion":"64232fd32583"}{"corpusVersion":"llm-observability-platforms-2026-07-27","runArtifactIds":["ff51f5d1-1720-45ed-9fea-0b8b7e85abcc","419fb026-eb99-42c7-8981-6ab5eac178c0","db2a70e7-c946-482b-9234-5d119aa96991","1145f959-a5a9-410b-a3cb-f724506487d8","992cb25e-12e3-496e-beef-fe28743bccf4","3bff15b2-2d3c-46e0-b2a9-60cc0f4214df","06c1bb63-4d7a-46e2-8d34-8d6959751467","aedc1b9a-4fe5-4cdc-92fe-6ad8067f03d3","0bb004dc-9a4e-45ec-9e2b-873494c3c74d","8827ccfa-97cd-4c5e-8f8f-c2e5e1053c7a","2156c8f0-72ae-46f1-93e1-d0fc01117c2c","d9e9c763-c3dd-44fa-a406-9ec3f046a664","f1edd715-074f-46aa-a729-c3f06c2be3be","5814a292-0f1c-4ff8-aee5-9d4baa929d7a","258a2c29-acc9-4012-96af-01b70cdcad58","81fe4599-094a-413f-8a58-f584360f8361","b829a157-1f72-4aaa-af2c-8c8fe2ca2259","5b095e47-3542-478a-a862-6d8d5c101a43","db782a22-090a-46d2-808a-8727cde6f273","3942ceb2-3661-4065-bec5-9dc8dfe7d09d","25803bdf-1de3-4098-8b6b-2e35374fe134","7548f89b-7cbb-437a-b137-b1ec440e2d1b","eebb3aeb-e7e6-4052-b9a4-f4b2077f5863","db72cedb-5c9a-4d59-bdae-7dee4b75e781","0d498a02-4a0f-4aa1-9c76-cc46c64f00bf","febe1839-7b15-4e16-9f86-8c99b0b96179","e66d737b-f051-4411-ab7f-2ab94c6b3a0b","d54727a5-1cfa-49a3-b69b-7dfac548c1ca","d0453795-cdd9-443a-a84d-6cdd1e1bf90d","659a831f-a616-4754-b024-c4980a1c6cda","c52f100a-2c08-458a-a210-acf262e593c1","14443c58-a3cf-4a84-bd34-91fff0647e98","97f79dc4-f68d-4643-bd61-0b481d855dc6","b422e895-372d-4694-ad0d-89b4dfda3b1d","e18fff5a-b595-4a13-9383-3a1de17a0dab","691f9d7b-eb83-48b2-91de-8ad64d13a48b"],"benchmarkVersion":"4-llm-observability-platforms-2026-07-27-models-64232fd32583","providerMatrixVersion":"64232fd32583"}{"corpusVersion":"llm-observability-platforms-2026-07-27","runArtifactIds":["ff51f5d1-1720-45ed-9fea-0b8b7e85abcc","419fb026-eb99-42c7-8981-6ab5eac178c0","db2a70e7-c946-482b-9234-5d119aa96991","1145f959-a5a9-410b-a3cb-f724506487d8","992cb25e-12e3-496e-beef-fe28743bccf4","3bff15b2-2d3c-46e0-b2a9-60cc0f4214df","06c1bb63-4d7a-46e2-8d34-8d6959751467","aedc1b9a-4fe5-4cdc-92fe-6ad8067f03d3","0bb004dc-9a4e-45ec-9e2b-873494c3c74d","8827ccfa-97cd-4c5e-8f8f-c2e5e1053c7a","2156c8f0-72ae-46f1-93e1-d0fc01117c2c","d9e9c763-c3dd-44fa-a406-9ec3f046a664","f1edd715-074f-46aa-a729-c3f06c2be3be","5814a292-0f1c-4ff8-aee5-9d4baa929d7a","258a2c29-acc9-4012-96af-01b70cdcad58","81fe4599-094a-413f-8a58-f584360f8361","b829a157-1f72-4aaa-af2c-8c8fe2ca2259","5b095e47-3542-478a-a862-6d8d5c101a43","db782a22-090a-46d2-808a-8727cde6f273","3942ceb2-3661-4065-bec5-9dc8dfe7d09d","25803bdf-1de3-4098-8b6b-2e35374fe134","7548f89b-7cbb-437a-b137-b1ec440e2d1b","eebb3aeb-e7e6-4052-b9a4-f4b2077f5863","db72cedb-5c9a-4d59-bdae-7dee4b75e781","0d498a02-4a0f-4aa1-9c76-cc46c64f00bf","febe1839-7b15-4e16-9f86-8c99b0b96179","e66d737b-f051-4411-ab7f-2ab94c6b3a0b","d54727a5-1cfa-49a3-b69b-7dfac548c1ca","d0453795-cdd9-443a-a84d-6cdd1e1bf90d","659a831f-a616-4754-b024-c4980a1c6cda","c52f100a-2c08-458a-a210-acf262e593c1","14443c58-a3cf-4a84-bd34-91fff0647e98","97f79dc4-f68d-4643-bd61-0b481d855dc6","b422e895-372d-4694-ad0d-89b4dfda3b1d","e18fff5a-b595-4a13-9383-3a1de17a0dab","691f9d7b-eb83-48b2-91de-8ad64d13a48b"],"benchmarkVersion":"4-llm-observability-platforms-2026-07-27-models-64232fd32583","providerMatrixVersion":"64232fd32583"}{"corpusVersion":"llm-observability-platforms-2026-07-27","runArtifactIds":["ff51f5d1-1720-45ed-9fea-0b8b7e85abcc","419fb026-eb99-42c7-8981-6ab5eac178c0","db2a70e7-c946-482b-9234-5d119aa96991","1145f959-a5a9-410b-a3cb-f724506487d8","992cb25e-12e3-496e-beef-fe28743bccf4","3bff15b2-2d3c-46e0-b2a9-60cc0f4214df","06c1bb63-4d7a-46e2-8d34-8d6959751467","aedc1b9a-4fe5-4cdc-92fe-6ad8067f03d3","0bb004dc-9a4e-45ec-9e2b-873494c3c74d","8827ccfa-97cd-4c5e-8f8f-c2e5e1053c7a","2156c8f0-72ae-46f1-93e1-d0fc01117c2c","d9e9c763-c3dd-44fa-a406-9ec3f046a664","f1edd715-074f-46aa-a729-c3f06c2be3be","5814a292-0f1c-4ff8-aee5-9d4baa929d7a","258a2c29-acc9-4012-96af-01b70cdcad58","81fe4599-094a-413f-8a58-f584360f8361","b829a157-1f72-4aaa-af2c-8c8fe2ca2259","5b095e47-3542-478a-a862-6d8d5c101a43","db782a22-090a-46d2-808a-8727cde6f273","3942ceb2-3661-4065-bec5-9dc8dfe7d09d","25803bdf-1de3-4098-8b6b-2e35374fe134","7548f89b-7cbb-437a-b137-b1ec440e2d1b","eebb3aeb-e7e6-4052-b9a4-f4b2077f5863","db72cedb-5c9a-4d59-bdae-7dee4b75e781","0d498a02-4a0f-4aa1-9c76-cc46c64f00bf","febe1839-7b15-4e16-9f86-8c99b0b96179","e66d737b-f051-4411-ab7f-2ab94c6b3a0b","d54727a5-1cfa-49a3-b69b-7dfac548c1ca","d0453795-cdd9-443a-a84d-6cdd1e1bf90d","659a831f-a616-4754-b024-c4980a1c6cda","c52f100a-2c08-458a-a210-acf262e593c1","14443c58-a3cf-4a84-bd34-91fff0647e98","97f79dc4-f68d-4643-bd61-0b481d855dc6","b422e895-372d-4694-ad0d-89b4dfda3b1d","e18fff5a-b595-4a13-9383-3a1de17a0dab","691f9d7b-eb83-48b2-91de-8ad64d13a48b"],"benchmarkVersion":"4-llm-observability-platforms-2026-07-27-models-64232fd32583","providerMatrixVersion":"64232fd32583"}{"corpusVersion":"llm-observability-platforms-2026-07-27","runArtifactIds":["ff51f5d1-1720-45ed-9fea-0b8b7e85abcc","419fb026-eb99-42c7-8981-6ab5eac178c0","db2a70e7-c946-482b-9234-5d119aa96991","1145f959-a5a9-410b-a3cb-f724506487d8","992cb25e-12e3-496e-beef-fe28743bccf4","3bff15b2-2d3c-46e0-b2a9-60cc0f4214df","06c1bb63-4d7a-46e2-8d34-8d6959751467","aedc1b9a-4fe5-4cdc-92fe-6ad8067f03d3","0bb004dc-9a4e-45ec-9e2b-873494c3c74d","8827ccfa-97cd-4c5e-8f8f-c2e5e1053c7a","2156c8f0-72ae-46f1-93e1-d0fc01117c2c","d9e9c763-c3dd-44fa-a406-9ec3f046a664","f1edd715-074f-46aa-a729-c3f06c2be3be","5814a292-0f1c-4ff8-aee5-9d4baa929d7a","258a2c29-acc9-4012-96af-01b70cdcad58","81fe4599-094a-413f-8a58-f584360f8361","b829a157-1f72-4aaa-af2c-8c8fe2ca2259","5b095e47-3542-478a-a862-6d8d5c101a43","db782a22-090a-46d2-808a-8727cde6f273","3942ceb2-3661-4065-bec5-9dc8dfe7d09d","25803bdf-1de3-4098-8b6b-2e35374fe134","7548f89b-7cbb-437a-b137-b1ec440e2d1b","eebb3aeb-e7e6-4052-b9a4-f4b2077f5863","db72cedb-5c9a-4d59-bdae-7dee4b75e781","0d498a02-4a0f-4aa1-9c76-cc46c64f00bf","febe1839-7b15-4e16-9f86-8c99b0b96179","e66d737b-f051-4411-ab7f-2ab94c6b3a0b","d54727a5-1cfa-49a3-b69b-7dfac548c1ca","d0453795-cdd9-443a-a84d-6cdd1e1bf90d","659a831f-a616-4754-b024-c4980a1c6cda","c52f100a-2c08-458a-a210-acf262e593c1","14443c58-a3cf-4a84-bd34-91fff0647e98","97f79dc4-f68d-4643-bd61-0b481d855dc6","b422e895-372d-4694-ad0d-89b4dfda3b1d","e18fff5a-b595-4a13-9383-3a1de17a0dab","691f9d7b-eb83-48b2-91de-8ad64d13a48b"],"benchmarkVersion":"4-llm-observability-platforms-2026-07-27-models-64232fd32583","providerMatrixVersion":"64232fd32583"}{"corpusVersion":"llm-observability-platforms-2026-07-27","runArtifactIds":["ff51f5d1-1720-45ed-9fea-0b8b7e85abcc","419fb026-eb99-42c7-8981-6ab5eac178c0","db2a70e7-c946-482b-9234-5d119aa96991","1145f959-a5a9-410b-a3cb-f724506487d8","992cb25e-12e3-496e-beef-fe28743bccf4","3bff15b2-2d3c-46e0-b2a9-60cc0f4214df","06c1bb63-4d7a-46e2-8d34-8d6959751467","aedc1b9a-4fe5-4cdc-92fe-6ad8067f03d3","0bb004dc-9a4e-45ec-9e2b-873494c3c74d","8827ccfa-97cd-4c5e-8f8f-c2e5e1053c7a","2156c8f0-72ae-46f1-93e1-d0fc01117c2c","d9e9c763-c3dd-44fa-a406-9ec3f046a664","f1edd715-074f-46aa-a729-c3f06c2be3be","5814a292-0f1c-4ff8-aee5-9d4baa929d7a","258a2c29-acc9-4012-96af-01b70cdcad58","81fe4599-094a-413f-8a58-f584360f8361","b829a157-1f72-4aaa-af2c-8c8fe2ca2259","5b095e47-3542-478a-a862-6d8d5c101a43","db782a22-090a-46d2-808a-8727cde6f273","3942ceb2-3661-4065-bec5-9dc8dfe7d09d","25803bdf-1de3-4098-8b6b-2e35374fe134","7548f89b-7cbb-437a-b137-b1ec440e2d1b","eebb3aeb-e7e6-4052-b9a4-f4b2077f5863","db72cedb-5c9a-4d59-bdae-7dee4b75e781","0d498a02-4a0f-4aa1-9c76-cc46c64f00bf","febe1839-7b15-4e16-9f86-8c99b0b96179","e66d737b-f051-4411-ab7f-2ab94c6b3a0b","d54727a5-1cfa-49a3-b69b-7dfac548c1ca","d0453795-cdd9-443a-a84d-6cdd1e1bf90d","659a831f-a616-4754-b024-c4980a1c6cda","c52f100a-2c08-458a-a210-acf262e593c1","14443c58-a3cf-4a84-bd34-91fff0647e98","97f79dc4-f68d-4643-bd61-0b481d855dc6","b422e895-372d-4694-ad0d-89b4dfda3b1d","e18fff5a-b595-4a13-9383-3a1de17a0dab","691f9d7b-eb83-48b2-91de-8ad64d13a48b"],"benchmarkVersion":"4-llm-observability-platforms-2026-07-27-models-64232fd32583","providerMatrixVersion":"64232fd32583"}{"corpusVersion":"llm-observability-platforms-2026-07-27","runArtifactIds":["ff51f5d1-1720-45ed-9fea-0b8b7e85abcc","419fb026-eb99-42c7-8981-6ab5eac178c0","db2a70e7-c946-482b-9234-5d119aa96991","1145f959-a5a9-410b-a3cb-f724506487d8","992cb25e-12e3-496e-beef-fe28743bccf4","3bff15b2-2d3c-46e0-b2a9-60cc0f4214df","06c1bb63-4d7a-46e2-8d34-8d6959751467","aedc1b9a-4fe5-4cdc-92fe-6ad8067f03d3","0bb004dc-9a4e-45ec-9e2b-873494c3c74d","8827ccfa-97cd-4c5e-8f8f-c2e5e1053c7a","2156c8f0-72ae-46f1-93e1-d0fc01117c2c","d9e9c763-c3dd-44fa-a406-9ec3f046a664","f1edd715-074f-46aa-a729-c3f06c2be3be","5814a292-0f1c-4ff8-aee5-9d4baa929d7a","258a2c29-acc9-4012-96af-01b70cdcad58","81fe4599-094a-413f-8a58-f584360f8361","b829a157-1f72-4aaa-af2c-8c8fe2ca2259","5b095e47-3542-478a-a862-6d8d5c101a43","db782a22-090a-46d2-808a-8727cde6f273","3942ceb2-3661-4065-bec5-9dc8dfe7d09d","25803bdf-1de3-4098-8b6b-2e35374fe134","7548f89b-7cbb-437a-b137-b1ec440e2d1b","eebb3aeb-e7e6-4052-b9a4-f4b2077f5863","db72cedb-5c9a-4d59-bdae-7dee4b75e781","0d498a02-4a0f-4aa1-9c76-cc46c64f00bf","febe1839-7b15-4e16-9f86-8c99b0b96179","e66d737b-f051-4411-ab7f-2ab94c6b3a0b","d54727a5-1cfa-49a3-b69b-7dfac548c1ca","d0453795-cdd9-443a-a84d-6cdd1e1bf90d","659a831f-a616-4754-b024-c4980a1c6cda","c52f100a-2c08-458a-a210-acf262e593c1","14443c58-a3cf-4a84-bd34-91fff0647e98","97f79dc4-f68d-4643-bd61-0b481d855dc6","b422e895-372d-4694-ad0d-89b4dfda3b1d","e18fff5a-b595-4a13-9383-3a1de17a0dab","691f9d7b-eb83-48b2-91de-8ad64d13a48b"],"benchmarkVersion":"4-llm-observability-platforms-2026-07-27-models-64232fd32583","providerMatrixVersion":"64232fd32583"}