add molecular_iq evaluation

#2431 opened Apr 9, 2026 by yusun-nlp Contributor Loading…

[BugFix] Fix gsm8k postprocess

#2426 opened Mar 30, 2026 by Hibbert133 Loading…

6 tasks done

1

feat: upgrade MiniMax provider with M2.7 models and OpenAI-compatible API

#2418 opened Mar 20, 2026 by octo-patch Loading…

2 of 3 tasks

[Fix] CEval ModelScope load and HF generate for causal LMs

#2416 opened Mar 19, 2026 by DeliWang Loading…

6 tasks

[Fix] Fix eval stage is extremely slow

#2409 opened Mar 5, 2026 by xming521 Loading…

6 tasks

fix: correct typo 'seperated' to 'separated'

Update README.md for mmlu

#2374 opened Dec 29, 2025 by freemedom Loading…

[Dataset] Add dataset arena-hard-v2

#2362 opened Dec 16, 2025 by Myhs-phz Collaborator Loading…

[Fix] fix eval_postprocess in gpqa

#2357 opened Dec 11, 2025 by qianyp18 Loading…

#2344 opened Dec 3, 2025 by RonalddMatias Loading…

[Fix] Rename smolinstruct_pp_acc_0_shot_instruct dataset list as {}_datasets

#2340 opened Dec 2, 2025 by cnlnpjhsy Loading…

feat(config): add Meta-Llama-3.1-8B-Instruct for MMLU benchmark

#2325 opened Nov 25, 2025 by 6taco Loading…

6 tasks

Refactor backend switch logic with support for SGLang and OpenAI backends

[fix] Handle None value for max_out_len parameter in HuggingFace model

#2271 opened Sep 15, 2025 by Nexround Loading…

Reasonzoo

#2256 opened Sep 1, 2025 by epsilondylan Contributor Loading…

2 tasks

[Feature] Support pass@1 evaluation for multi predictions in MathEvaluator

#2253 opened Aug 28, 2025 by BeingIsA Loading…

[Update] compassbench subjective config

#2238 opened Aug 14, 2025 by Myhs-phz Collaborator Loading…

feat: Add Zebra Grid dataset support with ZeroEval alignment

#2234 opened Aug 11, 2025 by max-yue Loading…

[fix] switch think mode

#2233 opened Aug 10, 2025 by Tianhao-Peng Loading…

2 of 6 tasks

[Fix] add tqdm for BlueLMAPI

#2226 opened Aug 1, 2025 by Myhs-phz Collaborator Loading…

[Feature] Support eval for C-Eval test split

#2218 opened Jul 24, 2025 by HYZ17 Loading…

[Fix] Modify error handling and fix typo

#2216 opened Jul 24, 2025 by Owen-Qin Loading…

[Fix] Deprecate unused and error formated math500 gen file

#2206 opened Jul 17, 2025 by liushz Collaborator Loading…

6 tasks