Benchmark Almanac

Arenas

We track 141 arenas and match leagues. In some, people vote between two answers. In others, models play each other in games and contests. Ratings move as new models join, so compare a rating only with others from the same arena. Tests with fixed answers are on the Benchmarks page.

97 ranked by votes 44 ranked by matches 1 in use 52 with a leaderboard here Scores refreshed 2 Nov 2026
141 arenas
Arena Run by Kind Ranked by Status Leader Models
rated
Released Last
added
LMArena (Elo) People chat with two anonymous models side by side and vote for the better reply. Votes become Elo-style ratings for each model. Arena (formerly LMArena) Overall chat quality Votes Fading Gemini 4 Carbon 1,528 333 May 2023 Oct 2026
SnakeBench Two language models each steer a snake on a shared board in a turn-based game, and the one that survives longest wins. Ratings come from many head-to-head games. ARC Prize Foundation (Greg Kamradt) Multi-agent games Matches Not in cards GPT-5.1-Codex-Max 38 183 Feb 2025 Sep 2026
Vision Arena People send an image with a prompt, compare answers from two anonymous vision-language models, and vote for the better one. Votes become Bradley-Terry ratings. Arena (formerly LMArena) General visual questions Votes Not in cards Claude Fable 5 1,309 136 Jun 2024 Oct 2026
Code Arena v2 Models act as coding agents that build web apps from user prompts, and users vote between two results. Votes yield Elo-style ratings. Arena (formerly LMArena) Web and app front ends Votes In use Claude Opus 5.5 1,810 124 Nov 2025 Oct 2026
LLM Chess Models play chess in multi-turn dialogs against a random player or the Komodo Dragon engine. The board reports wins, Elo and game duration, which tracks instruction following. Maxim Saplin Puzzles and chess Matches Not in cards GPT-6 Astra 1,614 124 Sep 2024 Oct 2026
LMArena Text-to-Image Arena Image generation models answer the same user prompt side by side and anonymously. Community votes between the two images give Elo-style ratings. Arena (formerly LMArena) Image generation and editing Votes Not in cards GPT-Image-2.5 Sunburst 1,427 76 Dec 2024 Oct 2026
Step Race Several models talk in public, then secretly pick moves in a race where colliding moves cancel. The game tests cooperation and deception. Lech Mazur Multi-agent games Matches Not in cards GPT-5 5 59 Jan 2025 Dec 2025
Elimination Game Models play a multi-player game of public and private talk, alliances and votes to eliminate each other. A jury of eliminated players picks the winner. Lech Mazur Multi-agent games Matches Not in cards GPT-5.2 8 56 Feb 2025 Dec 2025
LMArena Image Edit Arena Image editing models apply the same user edit request to the same image, anonymously and side by side. Community votes give Elo-style ratings. Arena (formerly LMArena) Image generation and editing Votes Not in cards GPT-Image-2.5 Sunburst 1,517 56 Jun 2025 Oct 2026
VoxelBench Language models turn text or image prompts into voxel structures. Voters compare anonymous builds from the same prompt, and Glicko-2 ratings rank the models. VoxelBench Spatial reasoning and counting Votes Not in cards GPT-6 Astra 2,757 56 Sep 2025 Oct 2026
Image-to-WebDev Arena Users upload a screenshot, wireframe or mockup, two anonymous models build the website in Code Arena, and users vote for the better result. Votes become ratings with bootstrapped confidence intervals. Arena (formerly LMArena) Web and app front ends Votes Not in cards Claude Opus 5.5 1,753 55 Apr 2026 Oct 2026
Agent Arena Arena ranks models as the orchestrator in real Agent Mode sessions on arena.ai. Scores use behavioral signals such as file downloads, disapproval events, retries and steerability. Arena (formerly LMArena) General assistants Votes System cards only Claude Opus 5.5 0.21 53 Jun 2026 Oct 2026
LMArena Text-to-Video Arena Video generation models make clips from the same text prompt, anonymously and side by side. Votes from logged-in users give Elo-style ratings. Arena (formerly LMArena) Video generation Votes Not in cards Gemini Omni 1.1 Flash 1,516 45 Jan 2026 Sep 2026
LMArena Image-to-Video Arena Video generation models animate the same input image with the same prompt, anonymously and side by side. Votes give Elo-style ratings. Arena (formerly LMArena) Video generation Votes Not in cards MiniMax H3 1,495 44 Jan 2026 Sep 2026
Game Arena Chess Language models play full chess games against each other with the board given as FEN and PGN text. Ratings come from many games between each pair. Kaggle and Google DeepMind Puzzles and chess Matches Not in cards Gemini 3.8 Flash 1,453 39 Aug 2025 Oct 2026
Kaggle Game Arena Language models play each other in board, card and word games through a text harness. One leaderboard ranks models across all Game Arena games. Kaggle and Google DeepMind Multi-agent games Matches Not in cards Gemini 4 Argon 535 39 Aug 2025 Oct 2026
Game Arena Checkers Language models play American checkers against each other, with forced jumps and crowned kings. Ratings come from head-to-head games. Kaggle and Google DeepMind Puzzles and chess Matches Not in cards GPT-6 Astra 1,338 38 Jun 2026 Oct 2026
Game Arena Dark Hex Language models play Hex without seeing the opponent's stones, so they must probe cells to learn the hidden board while building a path. Kaggle and Google DeepMind Puzzles and chess Matches Not in cards Gemini 3.8 Flash 612 38 Jun 2026 Oct 2026
Game Arena Four in a Row Language models play a Connect Four style game and try to line up four of their tokens before the opponent does. Kaggle and Google DeepMind Puzzles and chess Matches Not in cards Gemini 4 Argon 923 38 Feb 2026 Oct 2026
Document Arena People upload their own PDFs with a question, compare answers from two anonymous models, and vote for the better one. Votes become Bradley-Terry ratings. Arena (formerly LMArena) Reasoning over long documents Votes Not in cards Claude Fable 5 1,499 37 Mar 2026 Sep 2026
Game Arena Dots and Boxes Language models take turns drawing lines between dots on a grid. Closing the fourth side of a box claims it. Kaggle and Google DeepMind Puzzles and chess Matches Not in cards GPT-6 Astra 1,219 37 Jun 2026 Oct 2026
Game Arena Bargaining Two language models negotiate how to split a pool of items, each with private item values. Each side tries to reach a good deal without giving away its values. Kaggle and Google DeepMind Multi-agent games Matches Not in cards GPT-5.5 277 36 Jul 2026 Oct 2026
Game Arena Clobber Language models play Clobber, where every move captures an adjacent enemy stone. The player who makes the last legal move wins. Kaggle and Google DeepMind Puzzles and chess Matches Not in cards GPT-6 Astra 847 36 Jun 2026 Oct 2026
Game Arena Go Language models play Go against each other through the Game Arena text harness. Ratings come from head-to-head games. Kaggle and Google DeepMind Puzzles and chess Matches Not in cards GPT-6 Astra 1,762 36 Sep 2026 Oct 2026
Game Arena Lines of Action Language models play Lines of Action, where a piece moves as far as the number of pieces on its line. The goal is to join all of one's pieces into one group. Kaggle and Google DeepMind Puzzles and chess Matches Not in cards Gemini 4 Argon 1,185 36 Jul 2026 Oct 2026
Game Arena Nine Men's Morris Language models play Nine Men's Morris. Forming a row of three, called a mill, lets a player remove one of the opponent's pieces. Kaggle and Google DeepMind Puzzles and chess Matches Not in cards Claude Opus 5 1,022 36 Aug 2026 Oct 2026
Game Arena Reversi Language models play Reversi, also called Othello, flipping the opponent's disks that they flank in a line. Kaggle and Google DeepMind Puzzles and chess Matches Not in cards Gemini 4 Argon 1,102 36 Aug 2026 Oct 2026
Game Arena Ultimate Tic-Tac-Toe Language models play nine linked tic-tac-toe boards. Each move decides which small board the opponent must play next. Kaggle and Google DeepMind Puzzles and chess Matches Not in cards GPT-6 Astra 608 36 Jul 2026 Oct 2026
Game Arena Word Association Teams of language models give one-word clues and guess linked words, in a game like Codenames, against an opposing team. Kaggle and Google DeepMind Multi-agent games Matches Not in cards Gemini 4 Argon 596 36 May 2026 Oct 2026
LMArena Search Arena People compare answers from two anonymous search-augmented models on their own questions and vote for the better one. Votes become Bradley-Terry ratings. Arena (formerly LMArena) Deep research Votes Fading GPT-5.6 Sol 1,258 35 Apr 2025 Sep 2026
Game Arena Coin Game Two language models move on a grid and pick up coins. Each should collect the coins that score for it and avoid the rest. Kaggle and Google DeepMind Multi-agent games Matches Not in cards GPT-5.5 514 35 Jul 2026 Oct 2026
Game Arena Word Art Language models take turns drawing a word as ASCII art and guessing what the other model drew. Kaggle and Google DeepMind Multi-agent games Matches Not in cards Gemini 4 Argon 2,473 35 Aug 2026 Oct 2026
Vending-Bench Arena Several agents each run a vending machine at the same location in the Vending-Bench 2 environment. They can email, pay and trade with each other, but each is scored on its own money balance. Andon Labs Simulated companies Matches Not in cards Gemini 4 Carbon $15,962 32 Nov 2025 Oct 2026
Game Arena Poker Language models play heads-up no-limit Texas Hold'em against each other. Models are ranked by mean big blinds won per 100 hands. Kaggle and Google DeepMind Multi-agent games Matches Not in cards GPT-5.6 Sol 30.3 31 Feb 2026 Sep 2026
PACT Two models bargain over 20 rounds as buyer and seller, each with a hidden private value. Matches across many pairings rank the models. Lech Mazur Multi-agent games Matches Not in cards GPT-5.5 1,607 26 Jul 2025 Jun 2026
ArtifactArena Models design robot bodies, controllers and strategy for a simulated sumo-style arena. Artifacts fight head-to-head and models get Elo ratings. MIT CSAIL + MIT Media Lab + NYU + UCSF Simulated robots Matches Not in cards GPT-6 Astra 1,539 21 Sep 2026 Sep 2026
Game Arena Five in a Row Language models play a gomoku-style game and try to line up five of their tokens before the opponent does. Kaggle and Google DeepMind Puzzles and chess Matches Not in cards Gemini 3.1 Pro 1,131 20 Apr 2026 Jun 2026
CivBench Models play full games of Civilization V with the Vox Populi mod against each other on matched maps and seeds. Pairwise skill ratings rank long-term strategy. Vox Deorum Video games Matches Not in cards GLM-5.3 1,634 18 Oct 2026 Sep 2026
Agent Poker Bench Models play 10-seat no-limit Texas Hold'em tournaments against each other. Chip counts and elimination order feed TrueSkill ratings. Vals AI (with The Graphite Group) Multi-agent games Matches Not in cards GPT-5.2 1,132 17 Jan 2026 Dec 2025
Game Arena Chess Openings Language models play chess against each other from varied two-move openings sampled from 20 popular human openings. The board is given as text. Kaggle and Google DeepMind Puzzles and chess Matches Not in cards Gemini 3 Flash 1,263 11 Feb 2026 Dec 2025
OCR Arena Users upload a document, compare two anonymous OCR or vision-language models side by side, and vote. Votes become Elo ratings. Extend Documents, charts and text in images Votes Not in cards Claude Opus 4.5 1,791 11 Nov 2025 Feb 2026
LMArena Video Edit Arena Video editing models apply the same edit request to the same clip, anonymously and side by side. Community votes give Elo-style ratings. Arena (formerly LMArena) Video generation Votes Not in cards Wan 3.0 1,414 10 Aug 2026
StarSkirmish Bench Each model gets one hour in its lab's own CLI to write a StarCraft: Brood War bot in C++. The score is its win rate against human-written bots. Kai McPheeters Video games Matches Not in cards GPT-6 Astra 57.3% 9 Oct 2026 Oct 2026
CodeClash Models build and improve their own codebases over many rounds, then compete in arenas such as Halite, poker and BattleSnake. Results give Elo ratings. SWE-bench team (Stanford University and Princeton University) Building whole projects Matches Not in cards Claude Sonnet 4.5 1,385 8 Nov 2025 Sep 2025
Game Arena Werewolf Teams of language models play the social deduction game Werewolf in natural language. Villagers must find the hidden werewolves, who try to deceive them. Kaggle and Google DeepMind Multi-agent games Matches Not in cards GPT-5.4 0 8 Feb 2026 Mar 2026
Honesty human feedback win rate (Anthropic) Crowdworkers try to make models say something false and pick the more honest reply in head-to-head chats. Score is the win rate against a baseline. Anthropic Hallucination rates Votes System cards only Claude 3 Sonnet 69% 6 Sep 2025 Feb 2026
Brood War Bench Coding agents play StarCraft: Brood War against each other in real time. Systems are ranked by win rate over matches, with cost per game. Ben Swerdlow Video games Matches Not in cards GPT-6 Astra 100% 6 Sep 2026 Sep 2026
ChangeMyView Models write rebuttals to r/ChangeMyView posts that human raters score for persuasiveness. Scored as percentile against human responses. OpenAI Dangerous capabilities Votes System cards only o1 89.1% 5 Sep 2024 Feb 2025
K-Sort Arena Users rank outputs from K image or video generation models at once instead of a pair. Bayesian updates turn the rankings into ratings. Li et al. (UC Berkeley and collaborators) Image generation and editing Votes Not in cards GPT-Image-1 31 5 Aug 2024
Harmlessness human feedback win rate (Anthropic) Raters probe models in adversarial chats and pick the more harmless reply in head-to-head comparisons. Score is the win rate against a baseline model. Anthropic Refusing harmful requests Votes System cards only Claude 3 Sonnet 87% 4 Jun 2024 Oct 2024
Political Persuasion Parallel Generation Human raters pick the more persuasive of two short political social media posts. Scored as win rate against GPT-4o. OpenAI Dangerous capabilities Votes System cards only o1-preview 53.8% 4 Sep 2024 Jan 2025
RoboArena Double-blind pairwise A/B trials of generalist DROID policies on real Franka arms, free-form tasks by volunteer evaluators. Elo-style rating. UC Berkeley + Stanford + UPenn + others Real robots Votes Not in cards π0.5 1,608 3 Jun 2025 Apr 2025
Red Teaming Network pairwise safety comparison Red teamers compare anonymized responses from two models in free-form risky conversations. Scored as the share of ratings where a model is safer. OpenAI Refusing harmful requests Votes System cards only o1 59.8% 2 Dec 2024 Feb 2025
3DCodeBench Agentic procedural 3D modeling via code: author engine-ready 3D assets through software APIs. Graded for executability and shape fidelity. Google DeepMind + Google Research + University of Southern California CAD models Votes System cards only Grok 4.6 54% 2 May 2026 Aug 2026
Qwen Chinese human evaluation Three annotators rank chat model answers to 300 Chinese instructions on knowledge, language, writing, math and coding. Results are win rates against GPT-3.5. Qwen Team, Alibaba Group Overall chat quality Votes System cards only Qwen-14B 30.7% 2 Sep 2023 Sep 2023
Apple side-by-side human evaluation Apple's in-house graders compare two models' responses to locale-specific text and image prompts and pick the preferred one. Results are win, tie and loss fractions per comparison. Apple Overall chat quality Votes Fading AFM 3 Cloud 64.7% 1 Jun 2025 Jun 2026
Cohere enterprise human evaluation Trained annotators blindly compare two models' answers on enterprise tasks such as HR FAQs, technical FAQs and workplace assistants. They judge accuracy, instruction following and style. Results are win, tie and loss rates. Cohere Running a business Votes Dropped Cohere Command A 51.7% 1 Mar 2025 Apr 2025
DeepSeek Chinese functional writing evaluation Models answer 3,170 everyday Chinese writing prompts such as reports, emails and speeches. Pairwise judging against a baseline model gives a win rate. DeepSeek Taste and style Matches System cards only DeepSeek-V4-Pro 62.6% 1 Apr 2026 Apr 2026
DeepSeek Chinese white-collar tasks evaluation Agents complete 30 Chinese professional analysis, document generation and editing tasks across 13 industries. Blind human annotators compare outputs against a baseline model. DeepSeek Documents and spreadsheets Votes System cards only DeepSeek-V4-Pro 53% 1 Apr 2026 Apr 2026
DeepSeek complex instruction following and multi-turn writing evaluation Models answer 196 hard Chinese writing prompts with complex constraints or several turns. Pairwise judging against a baseline model gives a win rate. DeepSeek Multi-turn conversation Matches System cards only DeepSeek-V4-Pro 45.9% 1 Apr 2026 Apr 2026
DeepSeek search Q&A evaluation Models answer objective and subjective Chinese search questions with retrieval or agentic search. Pairwise judging gives win, loss and tie rates. DeepSeek Questions that need search Matches System cards only DeepSeek-V4-Pro 28.1% 1 Apr 2026 Apr 2026
Expert Red Teaming for Violent Attack Planning Expert red teamers compare anonymized responses from two models on violent attack planning prompts. Scored as the win rate for being safer. OpenAI Refusing harmful requests Votes System cards only GPT-5 65.1% 1 Aug 2025 Aug 2025
Kimi Webdev Bench Models build games, 3D scenes and website clones from real prompts. Blind experts compare two outputs and report win, tie and loss rates. Moonshot AI Web and app front ends Votes System cards only Kimi K3 58.6% 1 Jul 2026 Jul 2026
MAI human side-by-side evaluation Paid raters compare two models' answers to 1,276 English prompts from experts and Copilot logs on a 7-point scale from -1.5 to 1.5. Microsoft AI Overall chat quality Votes System cards only MAI-Thinking-1 0.07 1 Jun 2026 Jun 2026
Pairwise Bioweaponization Campaign Red teamers with biology PhDs compare anonymized responses from two models on bioweaponization prompts. Scored as the win rate for being safer. OpenAI Refusing harmful requests Votes System cards only GPT-5 60% 1 Aug 2025 Aug 2025
Preference on ChatGPT and API prompts Human labelers compare model responses to 5,214 prompts sent to ChatGPT and the OpenAI API. Scored as win rate against a baseline model. OpenAI Overall chat quality Votes System cards only GPT-4 70.2% 1 Mar 2023 Mar 2023
Human feedback win rates (Anthropic) Raters chat with two models on tasks such as coding, documents and creative writing and pick the better reply. Score is the win rate. Anthropic Overall chat quality Votes System cards only Mar 2024 Oct 2024
Llama 2-Chat helpfulness human evaluation (Meta) Three human raters compare Llama 2-Chat with a rival chat model on about 4,000 single and multi-turn helpfulness prompts. Meta Overall chat quality Votes System cards only Jul 2023 Jul 2023
Pairwise safety red teaming Red teamers compare anonymized responses from several models and pick the least safe. Scored as ELO or win rate. OpenAI Refusing harmful requests Votes System cards only Apr 2025 Apr 2025
CC-Bench Claude Code runs realistic frontend, backend, tooling and data coding tasks in fresh containers. Humans compare models head-to-head (win rate). Zhipu AI (Z.ai) Building whole projects Votes System cards only Jul 2025 Aug 2025
DeepSeek Chinese creative writing evaluation Models write Chinese fiction, prose, poetry and lyrics for 2,837 prompts. Pairwise judging gives separate win rates for instruction following and writing quality. DeepSeek Creative writing Matches System cards only Apr 2026 Apr 2026
Kimi Chinese in-house open-ended benchmark Models answer held-out Chinese prompts drawn from real user queries. Outputs are compared pairwise against another model to give win, tie and loss rates. Moonshot AI Overall chat quality Matches System cards only Jul 2025 Jul 2025
Llama 3 pairwise human evaluation (Meta) Human raters compare Llama responses with a rival model on about 7,000 prompts across six capabilities and three multiturn sets. Meta Overall chat quality Votes System cards only Jul 2024 Nov 2024
LLMBoxing People see one question with two anonymous model answers and pick the better one. The site counts preferences between model pairs. llmboxing.com Overall chat quality Votes System cards only Oct 2023 Oct 2023
3D Arena Users compare two 3D models generated from the same input and vote for the better one. A live leaderboard ranks the generators. Hugging Face (Dylan Ebert) Spatial reasoning and counting Votes Not in cards
AA-3D Agents in an offline sandbox turn a written brief into an interactive three.js scene. A recruited human panel votes on blind pairs, and votes become Elo ratings. Artificial Analysis Web and app front ends Votes Not in cards Oct 2026
AA-Image-Editing Validated private evaluators compare two image edits made from the same instruction and vote blind. Votes become Elo ratings. Artificial Analysis Image generation and editing Votes Not in cards
AA-Video-Editing Voters compare two edits of the same video made from one instruction and pick the better one. Votes become Elo ratings. Artificial Analysis Video generation Votes Not in cards
Agent Arena (Gorilla) Users give a task, two agents built from different models, tools and frameworks run it, and users vote. A Bradley-Terry extension rates models, tools and frameworks. UC Berkeley Gorilla team with LMSYS General assistants Votes Not in cards Oct 2024
AI Diplomacy Models play the board game Diplomacy against each other, one power each. They negotiate, form alliances and betray each other in written messages. Good Start Labs (Alex Duffy) Multi-agent games Matches Not in cards Feb 2025
Artificial Analysis Image Arena Voters compare images from two text-to-image models for the same prompt and pick the better one. Votes become Elo ratings. Artificial Analysis Image generation and editing Votes Not in cards
Artificial Analysis Speech Arena Voters listen to two speech clips made from the same text and pick the more natural one. Votes become Elo ratings. Artificial Analysis Audio understanding and voice Votes Not in cards
Artificial Analysis Video Arena Voters compare videos from two text-to-video models for the same prompt and pick the better one. Votes become Elo ratings. Artificial Analysis Video generation Votes Not in cards
BigCodeArena Users ask for code, both models' programs run in a sandbox, and users try the results before voting for the better answer. Votes give Elo ratings. BigCode project (Monash University and collaborators) Function-level problems Votes Not in cards Oct 2025
CATArena Code agents write programs that play board and card games in repeated tournaments. Between rounds they refine their code through self-reflection and by studying rivals' code, and scores separate first-round skill from improvement. AGI-Eval (Meituan) Building whole projects Matches Not in cards Oct 2025
CompassArena Users chat with two anonymous models side by side, mostly in Chinese, and vote for the better answer. A Bradley-Terry model turns the votes into Elo-style ratings. OpenCompass (Shanghai AI Laboratory) with ModelScope Overall chat quality Votes Not in cards May 2024
Cooperate to Compete (C2C) Multi-player conquest game with private non-binding negotiation and secret asymmetric objectives. LM agents scored by win rate against humans and other agents. UC Berkeley Multi-agent games Matches Not in cards Apr 2026
Copilot Arena Developers inside their IDE see paired code completions from two models and pick one. Pairwise votes give an Elo-style ranking of code models. Arena (formerly LMArena) with Carnegie Mellon University Function-level problems Votes Not in cards Nov 2024
DesignArena 3D Design Models build an interactive 3D scene that runs in the browser as a single HTML file. Users explore the scenes and vote for the better one. DesignArena (Intelligence) Web and app front ends Votes Not in cards
DesignArena Agentic Game Dev Coding agents build multi-file games from a user prompt. Users play the final games and vote, and the logs keep tool calls, retries and failures. DesignArena (Intelligence) Building whole projects Votes Not in cards
DesignArena Agentic Image to HTML Coding agents turn a user-uploaded image into a self-contained HTML website. Users compare how well each page reproduces the design and vote. DesignArena (Intelligence) Web and app front ends Votes Not in cards
DesignArena Android (Kotlin) Models build native Android apps in Kotlin from real user prompts. The apps run in an Android emulator, and users compare them and vote. DesignArena (Intelligence) Building whole projects Votes Not in cards
DesignArena ASCII Art Models draw a requested picture using only text characters. Users compare the ASCII art and vote for the better one. DesignArena (Intelligence) Creative writing Votes Not in cards
DesignArena Audio Realism Bench Voice models produce conversational speech, and users vote on which sounds more real. DesignArena built it because 1 to 5 opinion scores for TTS had saturated. DesignArena (Intelligence) Audio understanding and voice Votes Not in cards
DesignArena Builder AI app builders make full-stack web and mobile apps from the same user prompt. Users compare the results and vote for the better one. DesignArena (Intelligence) Building whole projects Votes Not in cards
DesignArena Code Users give a prompt, and anonymous models each build a website, UI component, browser game, data visualization or 3D scene as one HTML file. Users vote, and votes become Bradley-Terry ratings. DesignArena (Intelligence) Web and app front ends Votes Not in cards Jul 2025
DesignArena Data Visualization Models turn a user prompt and its data into an interactive visualization as a single HTML file. Users compare the rendered charts and vote. DesignArena (Intelligence) Data science and SQL Votes Not in cards
DesignArena Frontend Web App Coding agents build multi-file React frontends from real user prompts. Users compare the running apps and vote, and the run logs record agent behavior. DesignArena (Intelligence) Web and app front ends Votes Not in cards
DesignArena Full Stack Coding agents build complete React apps with sign-in, databases and backend code from real user prompts. Users try the apps and vote for the better one. DesignArena (Intelligence) Building whole projects Votes Not in cards
DesignArena Game Dev Models build a playable browser game as a single HTML file from a real user prompt. Users play the games and vote for the better one. DesignArena (Intelligence) Web and app front ends Votes Not in cards
DesignArena Godot Game Dev Coding agents build complete Godot projects with GDScript, scenes and generated assets, exported to run in the browser. Users play the games and vote. DesignArena (Intelligence) Building whole projects Votes Not in cards
DesignArena HTML Slides Agents write a self-contained HTML slide deck that is converted to PPTX. Users compare the decks and vote for the better one. DesignArena (Intelligence) Documents and spreadsheets Votes Not in cards
DesignArena Image Image models generate a picture from a user prompt. Users compare two anonymous images and vote for the better one. DesignArena (Intelligence) Image generation and editing Votes Not in cards
DesignArena Image Editing Image models edit a user image following a text instruction. Users compare the two edits and vote for the better one. DesignArena (Intelligence) Image generation and editing Votes Not in cards
DesignArena Image to Frontend Coding agents turn a reference image into a multi-file frontend web app. Users compare the running apps and vote for the better one. DesignArena (Intelligence) Web and app front ends Votes Not in cards
DesignArena Image to HTML Models recreate a reference image or mockup as a working single-file HTML website. Users compare the rendered pages and vote for the closer, better one. DesignArena (Intelligence) Web and app front ends Votes Not in cards
DesignArena Image to Video Video models animate a user image into a short video. Users compare two anonymous videos and vote for the better one. DesignArena (Intelligence) Video generation Votes Not in cards
DesignArena Multi-Image to Video Video models compose one video from several reference images. Users compare two anonymous videos and vote for the better one. DesignArena (Intelligence) Video generation Votes Not in cards
DesignArena Multimodal to Video Video models make a video from a mix of text, images and other inputs. Users compare two anonymous videos and vote for the better one. DesignArena (Intelligence) Video generation Votes Not in cards
DesignArena Proprietary Harness Slides Slide-making products build a presentation from a user prompt in their own harness. Users compare the decks and vote for the better one. DesignArena (Intelligence) Documents and spreadsheets Votes Not in cards
DesignArena Python-PPTX Slides Agents build PowerPoint decks with python-pptx from a user prompt. Users compare narrative, visual design and structure and vote for the better deck. DesignArena (Intelligence) Documents and spreadsheets Votes Not in cards
DesignArena React Native Models build cross-platform mobile apps in React Native from real user prompts. Users compare the running apps and vote for the better one. DesignArena (Intelligence) Building whole projects Votes Not in cards
DesignArena Speech-to-Speech Voice models answer spoken input with speech. Users listen to two anonymous replies and vote for the better one. DesignArena (Intelligence) Audio understanding and voice Votes Not in cards
DesignArena Spreadsheet Agents build spreadsheets such as financial models, budgets and trackers as Excel or CSV workbooks. Users compare accuracy, structure and formatting and vote. DesignArena (Intelligence) Documents and spreadsheets Votes Not in cards
DesignArena SVG Models write SVG code for a design request such as an icon, logo, badge or illustration. Users compare the rendered graphics and vote. DesignArena (Intelligence) Web and app front ends Votes Not in cards
DesignArena Text-to-Speech Speech models read the same text aloud. Users listen to two anonymous clips and vote for the more natural one. DesignArena (Intelligence) Audio understanding and voice Votes Not in cards
DesignArena UI Component Models build one interface component as a single HTML file from a real user prompt. Users compare the rendered components and vote for the better one. DesignArena (Intelligence) Web and app front ends Votes Not in cards
DesignArena Video Arena Users compare videos from anonymous video generation models for the same prompt and vote for the better one. Votes become Elo ratings. DesignArena (Intelligence) Video generation Votes Not in cards
DesignArena Video Editing Video models edit a user video following a text instruction. Users compare the two results and vote for the better one. DesignArena (Intelligence) Video generation Votes Not in cards
DesignArena Video to Website Models watch a reference video and recreate its content as a working single-file HTML website. Users compare the rendered pages and vote. DesignArena (Intelligence) Web and app front ends Votes Not in cards
DesignArena Website Models build a complete website as one HTML file from a real user prompt. Users compare the rendered pages and vote for the better one. DesignArena (Intelligence) Web and app front ends Votes Not in cards
GenAI-Arena Users compare outputs from two anonymous models for image generation, image editing and video generation, and vote. Votes give Elo ratings. TIGER-Lab (University of Waterloo) Image generation and editing Votes Not in cards Jun 2024
LLM Colosseum Two models each control a fighter in Street Fighter III and choose moves from text descriptions of the game. Wins give Elo ratings. phospho (OpenGenerativeAI) Video games Matches Not in cards Mar 2024
MC-Bench Models write code that builds a Minecraft structure from a prompt. Users vote between two builds without knowing the models. MC-Bench (Aditya Singh and volunteers) Spatial reasoning and counting Votes Not in cards Mar 2025
MineBench Models turn a prompt into a Minecraft-style voxel build as raw 3D coordinates or tool calls. Users compare builds blind, and votes become rankings. Ammaar Alam Spatial reasoning and counting Votes Not in cards Jan 2026
MTEB Arena Users compare retrieval, clustering and similarity results from two anonymous embedding models and vote for the better one. MTEB community Other Votes Not in cards Jul 2024
Music Arena Users write a music prompt, listen to tracks from two text-to-music systems, and vote. Preferences, listening data and feedback feed a leaderboard. Carnegie Mellon University (G-CLef) with Arena and Sony researchers Audio understanding and voice Votes Not in cards Jul 2025
PokeAgent Challenge Agents compete in Pokemon battles under partial observability in a Battling Track and play the Pokemon RPG in a Speedrunning Track that needs long-horizon planning. Princeton University and collaborators Video games Matches Not in cards Mar 2026
RedTeam Arena Players get 60 seconds to make a model say a target word. An extended Elo ranks players, models and target prompts, with models ranked by resistance. Arena (formerly LMArena) Jailbreaks and prompt injection Matches Not in cards Sep 2024
RepoChat Arena Users give a GitHub repository link and a question. A retriever model picks files, two answer models reply, and users vote for the better answer. Arena (formerly LMArena) Fixing real repositories Votes Not in cards Jan 2025
RSI Arena Ten frontier agents each post-train the same Nemotron base model on a shared GPU cluster for six days. People then rank the resulting models in blind side-by-side votes, and agents retrain on that feedback. Bake AI Machine learning engineering Votes Not in cards Sep 2026
SciArena Researchers ask scientific literature questions and vote between two models' long cited answers. Votes give Elo ratings. Yale NLP and Allen Institute for AI Science questions Votes Not in cards Jul 2025
SEAL Showdown Users of Scale's Playground app chat with a model and sometimes compare its reply with a random opponent's reply. Scale ranks models with a Bradley-Terry model that controls for length and formatting. Rankings can be split by region, profession and age. Scale AI Overall chat quality Votes Not in cards Sep 2025
Slop Arena Site collecting writing-preference data to tune slop detection to a user's taste, paired with the slop-guard tool. Taste and style Votes Not in cards Mar 2026
TextArena Collection of competitive text games for LLM eval and RL, with an online Elo leaderboard. TextArena Multi-agent games Matches Not in cards Apr 2025
TTS Arena Users listen to two anonymous text-to-speech models read the same text and vote for the more natural one. Votes become Elo ratings. TTS-AGI (Hugging Face community) Audio understanding and voice Votes Not in cards Feb 2024
Web UI Bench Many models build the same 12 app UIs from one shared prompt. Outputs are shown side by side for people to compare. No automatic score. Eric Zakariasson (Cursor) Taste and style Votes Not in cards May 2026
WildArtifactBench Agents produce real deliverables in any format, from audio analysis and medical video reads to 3D meshes and kitchen layouts. Human and agent judges compare them with a baseline agent's work to give win rates and Elo. Meta (Meta Superintelligence Labs) Tasks from real jobs Votes Not in cards Aug 2026
WildVision Arena Users upload an image with a question, compare answers from two anonymous vision-language models, and vote. Votes give Elo ratings. Allen Institute for AI and UCSB General visual questions Votes Not in cards Feb 2024
Xbench Measures firsthand X posts about frontier models and coding harnesses. An LLM labels each post's sentiment, aggregated per model per week. Nico Christie (offpolicyinc) Other Votes Not in cards Sep 2026
Yupp VIBE Score People use Yupp for real tasks, see answers from two or more models, and pick the one they prefer. The preferences become VIBE scores for each model. Yupp (Ber Sarai Labs) Overall chat quality Votes Not in cards Jun 2025

Arena leaderboards

Top five in each of the 9 arenas with the most rated models.

How an arena differs from a benchmark

Fixed answersArenas
What decides a score An answer key, unit tests, or a check of the final state Votes between two answers, or wins and losses in matches, turned into Elo-style ratings
What it captures Whether the model gets a defined task right Taste, helpfulness, style and strategy
What can go wrong Leaked test sets, and saturation once the best score nears the ceiling Length and formatting win votes, and ratings shift as new models arrive
How scores compare On an absolute scale, so 2023 and 2026 scores compare directly Relative to the other models in the pool at the time