Skip to content

Kaapi Konsole: Using Config #467

@AkhileshNegi

Description

@AkhileshNegi

Is your feature request related to a problem? Please describe.
Right now, evaluations can be run by passing either a config (model, prompt, vector store) or an assistant ID. The problem is there's no way to version these configs, so we can't easily track which settings produced which results.

Describe the solution you'd like
Add version control for evaluation configs. When running an evaluation, users should be able to reference a specific versioned config. This way we have a clear link between the config used and the results it produced.

Screenshots

Image

Sub-issues

Metadata

Metadata

Assignees

Labels

enhancementNew feature or request

Type

No type

Projects

Status

In Progress

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions