Benchmark Almanac

FinQA

FinQA submission: wbin 75.4% tops its leaderboard
Not in model cards

Models answer numerical questions about company earnings reports that mix tables and text. Financial experts wrote 8,281 question and answer pairs, each with a gold reasoning program. Answers are checked by execution accuracy and program accuracy.

EMNLP 2021. Alibaba's DianJin-R1 report evaluates on FinQA and trains on it. Snorkel's FinQA RL environment, cataloged separately, is built on this data. About 410 GitHub stars.

Released
September 2021
Kind
Finance
Level
University
Scored
Checked automatically
Answers
Short answer
Tasks
All public

In the authors’ words

The sheer volume of financial statements makes it difficult for humans to access and analyze a business's financials. Robust numerical reasoning likewise faces unique challenges in this domain. In this work, we focus on answering deep questions over financial data, aiming to automate the analysis of a large corpus of financial documents. In contrast to existing tasks on general domain, the finance domain includes complex numerical reasoning and understanding of heterogeneous representations. To facilitate analytical progress, we propose a new large-scale dataset, FinQA, with Question-Answering pairs over Financial reports, written by financial experts. We also annotate the gold reasoning programs to ensure full explainability. We further introduce baselines and conduct comprehensive experiments in our dataset. The results demonstrate that popular, large, pre-trained models fall far short of expert humans in acquiring finance knowledge and in complex multi-step numerical reasoning on that knowledge. Our dataset – the first of its kind – should therefore enable significant, new community research into complex application domains. The dataset and code are publicly availablehttps://github.com/czyssrs/FinQA.

Abstract of FinQA: A Dataset of Numerical Reasoning over Financial Data (arXiv:2109.00122, CC0)
4
Entries on its own leaderboard, 0 models we track

FinQA submission: wbin tops the leaderboard with 75.4%

Best score per entry from the benchmark's own leaderboard, read on November 12th, 2026. Where a model ran with several settings or harnesses, we keep its best. Names in gray aren't in our model list: fine-tunes, agent systems, products and older models. They don't count toward leaders.

  1. 1 FinQA submission: wbin Public-test competition 1846; submitted score 75.4%
  2. 2 FinQA submission: dlc-lls Public-test competition 1846; submitted score 70%
  3. 3 FinQA submission: qinhui99 Public-test competition 1846; submitted score 69.8%
  4. 4 FinQANet-Roberta-large Corrected baseline; execution accuracy 61.2%

Source: Official FinQA leaderboard

#EntryScoreSettingDateSource
1 FinQA submission: wbin 75.4% Public-test competition 1846; submitted score Official leaderboard
2 FinQA submission: dlc-lls 70% Public-test competition 1846; submitted score Official leaderboard
3 FinQA submission: qinhui99 69.8% Public-test competition 1846; submitted score Official leaderboard
4 FinQANet-Roberta-large 61.2% Corrected baseline; execution accuracy Official leaderboard

No lab model card reports it yet

We read the headline results of 522 launch posts from 52 labs, and none of them list this benchmark.

More in Law, finance and medicine

All 179 in Law, finance and medicine
  • MedXpertQA-MM In use Models answer expert-level medical exam questions that combine images with clinical records and test results. Scoring is accuracy. Qwen 3.8 Max 80.4%
  • HealthBench Professional In use 525 physician-authored tasks from real clinician chats (care consult, documentation, research) with physician-adjudicated rubrics. Claude Sonnet 5.5 69.2%
  • HealthBench In use 5,000 realistic health conversations graded against physician-written rubrics. A length-adjusted variant penalizes verbosity. GPT-5 67.2%
  • FinSearchComp In use Agents search the web to fetch live financial data, look up history, and run multi-step investigations, across 635 expert-written questions. Scored by answer accuracy. Ling-3.1-flash 81.7%
  • KBL In use Models answer Korean legal knowledge and reasoning tasks and Korean bar exam questions. It has 7 knowledge tasks, 4 reasoning tasks and 2,510 bar exam items. Solar Pro 4 77.5%
  • KorMedMCQA In use Models answer 7,469 multiple-choice questions from Korean licensing exams for doctors, nurses, pharmacists and dentists, held from 2012 to 2024. Solar Pro 4 93.2%