mmlu-pro

Here are 5 public repositories matching this topic...

cotenthusiast / choicebench

ChoiceBench is a lightweight framework for MCQ evaluation-method research on LLMs, with built-in support for answer-order bias analysis and mitigation methods.

python benchmarking research asyncio multiple-choice positional-bias llm prompting mmlu llm-evaluation arc-challenge mmlu-pro order-sensitivity

Updated Sep 27, 2026
Python

mhmdaskari / llm-confidence-scoring

Star

Proper scoring rules, reduces LLM overconfidence in multiple-choice QA.

calibration hallucination confidence-estimation abstention selective-prediction llm mmlu proper-scoring-rules mmlu-pro simpleqa

Updated Jun 13, 2026
Python

butiploka / mimo-bench-arena

Star

Open LLM leaderboard featuring Xiaomi MiMo v2.5 & MiMo 100T head-to-head with GPT-5, Claude, Gemini, DeepSeek, Llama 4. ARC-AGI · SWE-Bench · MMLU-Pro · GPQA · HumanEval · BFCL.