GPQA Diamond — Übersicht

GPQA Diamond ist ein Subset des GPQA-Benchmarks (Graduate-Level Google-Proof Questions and Answers) mit den 198 anspruchsvollsten Multiple-Choice-Fragen aus dem GPQA Datensatz. Der Benchmark umfasst Themen aus der Biologie, Physik und Chemie. Das Diamond-Subset enthält ausschließlich die Fragen, bei denen die beiden Experten. die den Benchmark validiert haben, korrekt geantwortet haben, während die Mehrheit der Nicht-Experten falsch lag. Die Fragen aus GPQA-Diamond sind auf Bachelor-Niveau konzipiert und "Google-proof". Das bedeutet, dass selbst hochqualifizierte Nicht-Experten trotz uneingeschränktem Internetzugang nur 22,1% Genauigkeit in GPQA-Diamond erreichen.

Paper (arXiv)Dataset GitHub Leaderboard

GPQA Diamond Leaderboard

Ranking aller getesteten Modelle im GPQA Diamond Benchmark, sortiert nach Score.

‌

#	Modell⇅	Score
1	Claude Mythos Preview	94,5 %
2	Gemini 3.1 Pro	94,3 %
3	Claude Opus 4.7	94,2 %
4	Gemini 3 Deep Think	93,8 %
5	GPT-5.5	93,6 %
6	GPT-5.2 Pro	93,2 %
7	GPT-5.4	92,8 %
8	GPT-5.2	92,4 %
9	Gemini 3 Pro	91,9 %
10	Claude Opus 4.6	91,3 %
11	Kimi K2.6	90,5 %
12	DeepSeek-V4-Pro (Preview)	90,1 %
13	Claude Sonnet 4.6	89,9 %
14	Muse Spark	89,5 %
15	GPT-5 Pro	88,4 %
16	GPT-5.1	88,1 %
17	Kimi K2.5 (Thinking)	87,6 %
18	GPT-5	87,3 %
19	Claude Opus 4.5	87 %
20	Gemini 3.1 Flash-Lite	86,9 %
21	Gemini 2.5 Pro	86,4 %
22	GLM-5.1	86,2 %
23	GLM-5	86 %
24	DeepSeek-v3.2 Speciale	85,7 %
25	GLM-4.7	85,7 %

‌

Beispielaufgaben aus dem GPQA Diamond Benchmark

Die folgenden Beispielaufgaben zeigen typische Fragestellungen, die im GPQA Diamond Benchmark vorkommen.

Two quantum states with energies E1 and E2 have a lifetime of 10^-9 sec and 10^-8 sec, respectively. We want to clearly distinguish these two energy levels. Which one of the following options could be their energy difference so that they can be clearly resolved? (A) 10^-4 eV (B) 10^-11 eV (C) 10^-8 eV (D) 10^-9 eV

(A) 10^-4 eV

1 out of every 400 people has a cancer caused by a completely recessive allele, b. Assuming the population is in Hardy-Weinberg equilibrium, which of the following is the expected proportion of individuals who carry the b allele but are not expected to develop the cancer? (A) 1/400 (B) 19/400 (C) 20/400 (D) 38/400

(D) 38/400

A Fe pellet of 0.056g is first dissolved in 10mL of hydrobromic acid HBr (0.1M). The resulting solution is then titrated by KMnO4 (0.02M). How many equivalence points are there? (A) Two points, 25ml and 35ml (B) One point, 25mL (C) One point, 10ml (D) Two points, 25ml and 30ml

(A) Two points, 25ml and 35ml

Two chemists walk into a lab. One of them asks the other "So, how did it go?" The second chemist replies, "Not well - my compounds are on top of each other." What is the second chemist most likely referring to? (A) The compounds they are working with have similar polarities. (B) The compounds they are working with have similar boiling points. (C) The compounds they are working with are bonding to each other through non-covalent/van der Waals interactions. (D) The compounds they are working with have similar optical rotations.

(A)

Mutations of which of the mitochondrial proteins listed below are least likely to be genetically transmitted from a father to his children? (A) Translocase of inner mitochondrial membrane 17B (B) ATP binding cassette subfamily B member 8 (C) NADH dehydrogenase 2 (D) Tu translation elongation factor, mitochondrial

GPQA Diamond — Übersicht

GPQA Diamond Leaderboard

Beispielaufgaben aus dem GPQA Diamond Benchmark

Ähnliche Benchmarks

AA-Omniscience

AIME 2025

AIME 2026

ARC-AGI-2

Arena.ai

Artificial Analysis Intelligence Index