Benchmark Almanac

Amazon

8 models 5 model cards read amazon.science

What its model cards measure

Tall ticks are Amazon model cards that list the benchmark in their headline table. Gray dots are cards that leave it out. Rows are the benchmarks the lab listed most, at least twice each, in the order it started using them.

Model cards

Every Amazon model