Repository navigation
Assessment: Configuration & Versioning with Batch API Support #1098
Description
Is your feature request related to a problem?
There is currently no way to save assessment configurations the way we do for LLM-call configurations, which limits reusability. This forces assessment parameters to be re-specified on every call or submission, making the process inefficient across assessment runs.
Describe the solution you'd like
- Extend the existing Configuration & Versioning module to support assessment configuration blobs.
- Let clients save an entire assessment configuration, with all sub-modules included.
- Ensure compatibility with the pre-filter modules and the assessment/feedback modules.
- Support both BATCH and RESPONSE modes in a mode-agnostic way.
Metadata
Metadata
Assignees
Labels
Type
Projects
- Status
Activity
[-]Assessment: Configuration and Versioning[/-][+]Configuration: Save assessment settings[/+][-]Configuration: Save assessment settings[/-][+]Assessment: Configuration and Versioning[/+][-]Assessment: Configuration and Versioning[/-][+]Assessment: Batch API Client[/+][-]Assessment: Batch API Client[/-][+]Assessment: Configuration & Versioning with Batch API Support[/+]github-actions commentedon Aug 12, 2026
🎉 This issue has been resolved in version 1.4.0-main.12 🎉
The release is available on GitHub release
Your semantic-release bot 📦🚀