Published method
Public AI Developer Tools brand benchmark
4-ai-developer-tools-2026-07-27-models-64232fd32583
Version
Jul 27, 2026
Published
7
Boards
public-ai-developer-tools
Method ID
Where the facts come from
- Providers
- Provider
openai
- Configured Model
openai/gpt-4o-mini
- Provider
anthropic
- Configured Model
anthropic/claude-haiku-4-5
- Provider
gemini
- Configured Model
google/gemini-2.5-flash
- Provider Views
- Provider
openai
- Board Slug
ai-developer-tools-brand-openai-visibility
- Primary Metric Slug
public-prompt-openai-brand-recommendation-presence
- Provider
anthropic
- Board Slug
ai-developer-tools-brand-anthropic-visibility
- Primary Metric Slug
public-prompt-anthropic-brand-recommendation-presence
- Provider
gemini
- Board Slug
ai-developer-tools-brand-gemini-visibility
- Primary Metric Slug
public-prompt-gemini-brand-recommendation-presence
- Provider Matrix Version
64232fd32583
How the order is produced
recommendation-prompt presence descending; mention coverage, engine breadth, mention share, citation share, then entity slug
When the method reruns
- The prompt boards are re-run in rotation, about one category a day, so each board refreshes every few weeks and shows the date of its snapshot.
Boards
Boards using this version
| Board | Primary measure | Rows | Confidence | Snapshot | Board version | Refresh | Board |
|---|---|---|---|---|---|---|---|
| AI developer tool rank | public-prompt-brand-recommendation-presence | 16 | 100% | Sep 16, 2026 | 4-ai-developer-tools-2026-07-27-models-64232fd32583 | Rotating schedule | Open the board: AI developer tool rank |
| AI developer tool presence | public-prompt-brand-mention-coverage | 16 | 100% | Sep 16, 2026 | 4-ai-developer-tools-2026-07-27-models-64232fd32583 | Rotating schedule | Open the board: AI developer tool presence |
| AI developer tool citation share | public-prompt-brand-citation-share | 16 | 100% | Sep 16, 2026 | 4-ai-developer-tools-2026-07-27-models-64232fd32583 | Rotating schedule | Open the board: AI developer tool citation share |
| AI developer tool engine breadth | public-prompt-brand-engine-breadth | 16 | 100% | Sep 16, 2026 | 4-ai-developer-tools-2026-07-27-models-64232fd32583 | Rotating schedule | Open the board: AI developer tool engine breadth |
| Developer tools in OpenAI model API answers | public-prompt-openai-brand-recommendation-presence | 16 | 100% | Sep 16, 2026 | 4-ai-developer-tools-2026-07-27-models-64232fd32583 | Rotating schedule | Open the board: Developer tools in OpenAI model API answers |
| Developer tools in Anthropic model API answers | public-prompt-anthropic-brand-recommendation-presence | 16 | 100% | Sep 16, 2026 | 4-ai-developer-tools-2026-07-27-models-64232fd32583 | Rotating schedule | Open the board: Developer tools in Anthropic model API answers |
| Developer tools in Gemini model API answers | public-prompt-gemini-brand-recommendation-presence | 16 | 100% | Sep 16, 2026 | 4-ai-developer-tools-2026-07-27-models-64232fd32583 | Rotating schedule | Open the board: Developer tools in Gemini model API answers |
Versioned contract
Complete measurement ledger
Cohort
Not specified.
Prompts
- Slug
best-ai-coding-agent-large-codebase
- Text
What are the best AI coding agents for making reliable changes across a large existing codebase?
- Intent
recommendation
- Slug
ai-code-editor-fast-autocomplete
- Text
Recommend an AI-first code editor with fast autocomplete, multi-file editing, repository context, and model choice.
- Intent
recommendation
- Slug
background-coding-agent-pull-requests
- Text
Which coding agent is best for taking an issue, working in the background, running tests, and returning a reviewable pull request?
- Intent
recommendation
- Slug
terminal-coding-agent-local-workflow
- Text
Recommend a terminal-based coding agent that can inspect files, edit code, run commands, and ask for approval before risky actions.
- Intent
recommendation
- Slug
enterprise-ai-coding-security-governance
- Text
Which AI development tool is strongest for an enterprise that needs privacy controls, auditability, policy enforcement, and SSO?
- Intent
recommendation
- Slug
parallel-software-engineering-agents
- Text
What developer tool should a team use to run multiple software engineering agents in parallel across isolated tasks?
- Intent
recommendation
- Slug
ai-code-review-and-security
- Text
Recommend an AI developer platform for pull-request review, test generation, bug finding, and secure coding guidance.
- Intent
recommendation
- Slug
legacy-application-modernization-agent
- Text
Which AI coding tool is best for understanding and modernizing a large legacy application with strong test coverage?
- Intent
recommendation
- Slug
ai-developer-tools-buying-criteria
- Text
Compare AI developer tools on code quality, repository context, autonomy, latency, model choice, privacy, and integration depth.
- Intent
commercial
- Slug
coding-agent-pricing-and-limits
- Text
How should a software team compare coding-agent pricing, usage limits, premium-model access, and total cost at scale?
- Intent
commercial
- Slug
coding-agent-evaluation-scorecard
- Text
Create a proof-of-concept scorecard for evaluating AI coding tools on real repository tasks without relying on vendor claims.
- Intent
commercial
- Slug
ai-coding-tool-lock-in-portability
- Text
Which criteria reveal lock-in and portability risk when choosing an AI coding tool, including editor, model, data, and workflow control?
- Intent
commercial
Category
ai-developer-tools
Providers
- Provider
openai
- Configured Model
openai/gpt-4o-mini
- Provider
anthropic
- Configured Model
anthropic/claude-haiku-4-5
- Provider
gemini
- Configured Model
google/gemini-2.5-flash
Cost Policy
- Cost Basis
Provider-reported LLM cost returned by the existing AI Rank provider/cache layer.
- Maximum Daily Billed Cost Usd
2.00
- Maximum Daily Provider Calls
60
- Maximum Daily Provider Attempts Including Retries
72
Limitations
- This is one response per prompt/provider pair in each run; model output can vary between runs.
- The fixed 12-prompt AI Developer Tools category does not estimate general market share or brand awareness.
- Presence share and citation share are relative only to the reviewed 16-brand universe; untracked brands are excluded from those denominators.
- OpenAI, Anthropic, and Google are both evaluated brands and configured model providers; no self-provider bias correction is applied.
Rank Formula
recommendation-prompt presence descending; mention coverage, engine breadth, mention share, citation share, then entity slug
Answer Policy
- Published Evidence
answer hashes, deterministic bounded brand counts, and deduplicated URL-derived citation counts
- Full Provider Answers Published
No
- Full Provider Answers Stored In Public Index
No
Corpus Version
ai-developer-tools-2026-07-27
Provider Views
- Provider
openai
- Board Slug
ai-developer-tools-brand-openai-visibility
- Primary Metric Slug
public-prompt-openai-brand-recommendation-presence
- Provider
anthropic
- Board Slug
ai-developer-tools-brand-anthropic-visibility
- Primary Metric Slug
public-prompt-anthropic-brand-recommendation-presence
- Provider
gemini
- Board Slug
ai-developer-tools-brand-gemini-visibility
- Primary Metric Slug
public-prompt-gemini-brand-recommendation-presence
Runner Version
4
Canonical Brands
- Name
Cursor
- Aliases
- Cursor
- Cursor AI
- Entity Slug
cursor
- Primary Domain
cursor.com
- Citation Domains
- cursor.com
- docs.cursor.com
- Case Sensitive Aliases
- Cursor
- Name
GitHub Copilot
- Aliases
- GitHub Copilot
- Copilot coding agent
- Entity Slug
github-copilot
- Primary Domain
github.com
- Citation Domains
- github.com
- docs.github.com
- Case Sensitive Aliases
- Name
Claude Code
- Aliases
- Claude Code
- Entity Slug
claude-code
- Primary Domain
anthropic.com
- Citation Domains
- anthropic.com
- docs.anthropic.com
- Case Sensitive Aliases
- Name
OpenAI Codex
- Aliases
- OpenAI Codex
- Codex
- Entity Slug
openai-codex
- Primary Domain
openai.com
- Citation Domains
- openai.com
- developers.openai.com
- Case Sensitive Aliases
- Codex
- Name
Windsurf
- Aliases
- Windsurf
- Windsurf Editor
- Entity Slug
windsurf
- Primary Domain
windsurf.com
- Citation Domains
- windsurf.com
- docs.windsurf.com
- Case Sensitive Aliases
- Name
Kiro
- Aliases
- Kiro
- Kiro IDE
- Entity Slug
kiro
- Primary Domain
kiro.dev
- Citation Domains
- kiro.dev
- Case Sensitive Aliases
- Kiro
- Name
Gemini Code Assist
- Aliases
- Gemini Code Assist
- Entity Slug
gemini-code-assist
- Primary Domain
cloud.google.com
- Citation Domains
- cloud.google.com
- docs.cloud.google.com
- Case Sensitive Aliases
- Name
JetBrains AI Assistant
- Aliases
- JetBrains AI Assistant
- JetBrains Junie
- Junie
- Entity Slug
jetbrains-ai-assistant
- Primary Domain
jetbrains.com
- Citation Domains
- jetbrains.com
- Case Sensitive Aliases
- Junie
- Name
Amp
- Aliases
- Amp
- Amp Code
- Entity Slug
amp-code
- Primary Domain
ampcode.com
- Citation Domains
- ampcode.com
- Case Sensitive Aliases
- Amp
- Name
Devin
- Aliases
- Devin
- Devin AI
- Entity Slug
devin
- Primary Domain
cognition.ai
- Citation Domains
- cognition.ai
- docs.devin.ai
- Case Sensitive Aliases
- Devin
- Name
Replit Agent
- Aliases
- Replit Agent
- Replit AI
- Entity Slug
replit-agent
- Primary Domain
replit.com
- Citation Domains
- replit.com
- docs.replit.com
- Case Sensitive Aliases
- Name
Augment Code
- Aliases
- Augment Code
- Augment
- Entity Slug
augment-code
- Primary Domain
augmentcode.com
- Citation Domains
- augmentcode.com
- docs.augmentcode.com
- Case Sensitive Aliases
- Augment
- Name
Tabnine
- Aliases
- Tabnine
- Entity Slug
tabnine
- Primary Domain
tabnine.com
- Citation Domains
- tabnine.com
- docs.tabnine.com
- Case Sensitive Aliases
- Name
Qodo
- Aliases
- Qodo
- Qodo Merge
- Entity Slug
qodo
- Primary Domain
qodo.ai
- Citation Domains
- qodo.ai
- docs.qodo.ai
- Case Sensitive Aliases
- Name
Cline
- Aliases
- Cline
- Entity Slug
cline
- Primary Domain
cline.bot
- Citation Domains
- cline.bot
- docs.cline.bot
- Case Sensitive Aliases
- Cline
- Name
Roo Code
- Aliases
- Roo Code
- RooCode
- Entity Slug
roo-code
- Primary Domain
roocode.com
- Citation Domains
- roocode.com
- docs.roocode.com
- Case Sensitive Aliases
Benchmark Version
4-ai-developer-tools-2026-07-27-models-64232fd32583
Evaluation Surface
- Search
A common Rank.ai web-search tool is available to all three configured models.
- Gateway
Rank.ai's configured OpenRouter-compatible gateway
- Not Consumer Products
Results measure the configured model/API runs, not the ChatGPT, Claude, or Gemini consumer application interfaces.
Strict Completeness
- Prompt Count
12
- Provider Count
3
- Required Successful Runs
36
Measurement Semantics
- Confidence
A value of 1.0 means the complete frozen cohort passed the deterministic extraction and publication gates; it is not a statistical confidence interval.
- Citation Share Denominator
Distinct answer-level HTTP(S) citation URLs whose URL-derived hostname matches any reviewed brand domain.
- Presence Share Denominator
The sum of reviewed-brand answer-presences. One answer may contribute presence to multiple brands.
- Mention Coverage Denominator
36 answers: all 12 prompts multiplied by 3 configured providers.
- Provider Citation Share Denominator
Distinct reviewed-brand-domain citations within the named configured model API provider's 20-answer cohort.
- Recommendation Presence Denominator
24 answers: recommendation-intent prompts multiplied by 3 configured providers.
- Provider Mention Coverage Denominator
12 prompts for the named configured model API provider.
- Provider Recommendation Presence Denominator
8 recommendation-intent prompts for the named configured model API provider.
Provider Matrix Version
64232fd32583
Recommendation Semantics
Presence means mentioned or cited in an answer to a recommendation-intent prompt. It does not claim positive recommendation, endorsement, or sentiment.
See how often AI names you.
Enter your website. In about two minutes, Rank.ai asks ChatGPT, Claude and Gemini 12 questions your customers ask and grades how often they name you.
- Your grade out of 100How often AI names you, cites your site, and how high it ranks you.
- Who gets namedEvery competitor in the answers, most named first.
- The pages AI readsThe sources behind each answer.
- Three fixesWhat to fix first, with a brief for the first article.