Specification for a reproducible, provenance-bound multi-lane LLM benchmark suite.
-
Updated
Sep 27, 2026 - Python
#
ifeval
Here are 8 public repositories matching this topic...
Prompt-only boundary prediction for IFEval-style instruction-checker pass/fail behavior.
pytorch calibration instruction-following selective-prediction vllm llm-evaluation ifeval boundary-prediction
-
Updated
Jun 16, 2026 - Python
Reproducing a published IFEval score on one shared GPU - three arms, a pre-registration chain, and a paired test that killed my own conclusion
benchmark statistics transformers reproducibility agents pre-registration instruction-following llm-evaluation mcnemar-test ifeval
-
Updated
Sep 24, 2026 - Python
Code, per-item results and figures for a study dissociating prompt quality from response compliance in automated prompt-engineering assessment. Four-agent MATLAB evaluator on a locally hosted Qwen 2.5-7B judge, over 498 prompts from IFEval, LMSYS-Chat-1M and WildChat.
matlab automated-assessment ai-in-education instruction-following equivalence-testing construct-validity prompt-engineering ollama qwen llm-evaluation educational-assessment llm-as-a-judge open-weights ifeval verbosity-bias
-
Updated
Sep 19, 2026 - MATLAB
Task-dependent benchmark gap between /v1/completions and /v1/chat/completions on instruction-tuned LLMs -- two case studies on Qwen3.x GGUFs, reproduction recipe, and probes.
benchmarking methodology instruction-following llm llama-cpp qwen gguf chat-completions lm-eval-harness ifeval
-
Updated
May 16, 2026 - Python
Benchmark the LM Studio models you already have - speed, answer quality and GPU thermals at several concurrency levels. Windows app, results stay local.
electron react desktop-app windows benchmark typescript model-evaluation llm gsm8k local-llm local-ai lm-studio gguf llm-evaluation ifeval
-
Updated
Sep 23, 2026 - TypeScript
LoRA-based parameter-efficient fine-tuning for TinyLlama instruction following and ALBERT IMDb sentiment classification.
nlp sentiment-analysis text-classification transformers pytorch albert peft huggingface llm instruction-tuning vllm tinyllama supervised-fine-tuning lora-fine-tuning ifeval
-
Updated
Aug 18, 2026 - Jupyter Notebook
Parameter-efficient instruction tuning of TinyLlama-1.1B with LoRA, evaluated on IFEval.
-
Updated
Jun 28, 2026 - Jupyter Notebook
Add this topic to your repo
To associate your repository with the ifeval topic, visit your repo's landing page and select "manage topics."