Tokens per second

Observed throughput by model, accelerator, framework, and concurrency.

SOURCE-GATED

No unverified rows are shown.

This URL is reserved for the sourced, revision-tracked table. It stays out of search results until Rank.ai has publishable observations.