Benchmark Almanac

Mol-Instructions Multi-choice

Mol-Instructions (LLaMA3-instruct) 96.1% tops its leaderboard
Not in model cards

Models answer biomedical multiple-choice questions. The score is test-set accuracy.

One track of Mol-Instructions. The Mol-Instructions record keeps lab scores that combine tracks.

Released
June 2023
Kind
Genomics and life sciences
Level
Expert
Scored
Checked automatically
Answers
Short answer
Tasks
All public

In the authors’ words

Large Language Models (LLMs), with their remarkable task-handling capabilities and innovative outputs, have catalyzed significant advancements across a spectrum of fields. However, their proficiency within specialized domains such as biomolecular studies remains limited. To address this challenge, we introduce Mol-Instructions, a comprehensive instruction dataset designed for the biomolecular domain. Mol-Instructions encompasses three key components: molecule-oriented instructions, protein-oriented instructions, and biomolecular text instructions. Each component aims to improve the understanding and prediction capabilities of LLMs concerning biomolecular features and behaviors. Through extensive instruction tuning experiments on LLMs, we demonstrate the effectiveness of Mol-Instructions in enhancing large models' performance in the intricate realm of biomolecular studies, thus fostering progress in the biomolecular research community. Mol-Instructions is publicly available for ongoing research and will undergo regular updates to enhance its applicability.

Abstract of Mol-Instructions: A Large-Scale Biomolecular Instruction Dataset for Large Language Models (arXiv:2306.08018, CC0)
9
Entries on its own leaderboard, 0 models we track

Mol-Instructions (LLaMA3-instruct) tops the leaderboard with 96.1%

Best score per entry from the benchmark's own leaderboard, read on November 12th, 2026. Where a model ran with several settings or harnesses, we keep its best. Names in gray aren't in our model list: fine-tunes, agent systems, products and older models. They don't count toward leaders.

  1. 1 Mol-Instructions (LLaMA3-instruct) 96.1%
  2. 2 Mol-Instructions (LLaMA2-chat) 64.9%
  3. 3 PMC_LLaMa 62.5%
  4. 4 Galactica 31.2%
  5. 5 LLaMa 29.7%
  6. 6 Vicuna 29%
  7. 7 Alpaca 28.6%
  8. 8 Baize 23.7%
  9. 9 ChatGLM 22.3%

Source: Official Mol-Instructions Multi-choice leaderboard

#EntryScoreSettingDateSource
1 Mol-Instructions (LLaMA3-instruct) 96.1% Official leaderboard
2 Mol-Instructions (LLaMA2-chat) 64.9% Official leaderboard
3 PMC_LLaMa 62.5% Official leaderboard
4 Galactica 31.2% Official leaderboard
5 LLaMa 29.7% Official leaderboard
6 Vicuna 29% Official leaderboard
7 Alpaca 28.6% Official leaderboard
8 Baize 23.7% Official leaderboard
9 ChatGLM 22.3% Official leaderboard

No lab model card reports it yet

We read the headline results of 522 launch posts from 52 labs, and none of them list this benchmark.

More in Biology and chemistry

All 108 in Biology and chemistry
  • GeneBench Pro In use Agents analyze messy simulated genomics and biology datasets to estimate a decision-relevant quantity across 129 problems. Scored automatically against known answers. GPT-5.6 Sol 31.5%
  • SUPERChem In use Models solve 500 expert-written chemistry reasoning problems, offered in multimodal and text-only forms. Expert solution paths also allow a reasoning path score. Tencent Hy4 preview 66.4%
  • LifeSciBench In use Models complete 750 expert-written life science research tasks, often with attached figures, tables, or sequence files. Graded against expert rubrics as score and pass rate. GPT-Rosalind-6 61.3%
  • MedChemBench (OpenAI) In use Models answer chemistry questions from an OpenAI internal set, grouped with OpenAI's life science research evaluations. OpenAI has not published the task format. GPT-Rosalind-6 49.6%
  • ProtocolQA Open-Ended In use Models correct errors in published lab protocols using open-ended questions adapted from LAB-Bench ProtocolQA. Scored as pass@1. GPT-6 Cyber 47.2%
  • MolecularIQ In use Models answer questions about molecular graphs, such as counting, indexing and constrained generation, and a symbolic checker verifies each answer. gpt-oss-120b 47.5%