Skip to content

Evaluation UI: Show cost #39

Closed

Description

@AkhileshNegi

Is your feature request related to a problem?

After running an evaluation, the cost information is available in Langfuse but not visible in our UI. This is valuable information for
users to understand the expense of their evaluation runs.

Describe the solution you'd like

Display evaluation cost in the UI. Two approaches:

  1. Fetch from Langfuse - Retrieve cost data from Langfuse API when fetching results
  2. Calculate locally - Compute cost ourselves once results are returned, based on token usage and model pricing

Additional context

Cost visibility helps users make informed decisions about running large evaluations and tracking expenses.

Activity

  1. AkhileshNegi commented on Apr 10, 2026

    @AkhileshNegi
    ContributorAuthor

    we went with approach 2, as we want to remove langfuse dependency

  2. linked a pull request that will close this issueEvaluation: Show cost #113on Apr 17, 2026
  3. moved this to To Do in Kaapi-devon Apr 17, 2026
  4. moved this from To Do to Closed in Kaapi-devon Apr 17, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

  • Status
    Closed

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions