Commit e403abe
committed
Enhance majority voting plugin and update eval config
Upgrades the majority voting plugin with category-aware answer extraction, adaptive temperature control, improved normalization, response quality filtering, and smart fallback strategies. Updates the default test-time compute configuration in eval_optillmbench.py to use 5 candidates instead of 8 for fairer comparison and memory efficiency, and revises related reporting logic and documentation.1 parent a2cd56c commit e403abe
File tree
2 files changed
+335
-206
lines changed- optillm/plugins
- scripts
2 files changed
+335
-206
lines changed
0 commit comments