-
Notifications
You must be signed in to change notification settings - Fork 7
Open
1 / 11 of 1 issue completedLabels
enhancementNew feature or requestNew feature or request
Description
Is your feature request related to a problem? Please describe.
Right now, evaluations can be run by passing either a config (model, prompt, vector store) or an assistant ID. The problem is there's no way to version these configs, so we can't easily track which settings produced which results.
Describe the solution you'd like
Add version control for evaluation configs. When running an evaluation, users should be able to reference a specific versioned config. This way we have a clear link between the config used and the results it produced.
Screenshots

Prajna1999
Sub-issues
Metadata
Metadata
Assignees
Labels
enhancementNew feature or requestNew feature or request
Type
Projects
Status
In Progress