Skip to content

OpenAI API-compatible eval script #1

@tranhd95

Description

@tranhd95

Hi,

is there any uncommited OpenAI API-compatible evaluation script since there are also closed-source models in the table? The provided Jupyter Notebook seems to work with local HF models only. OpenAI API-compatible script would allow (simplify) contributing the final results to The Table. I can probably vibecode it and open a PR but I guess you already have something?

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions