Skip to content

Kaapi: Opt-in Langfuse tracing #930

Closed

Description

@AkhileshNegi

Is your feature request related to a problem?
Kaapi enables Langfuse tracing by default when Langfuse credentials are added. While Langfuse is also required to run evaluations, it can lead to high-volume orgs quickly exhausting their Langfuse rate-limit/credit budget on traces alone. This results in 429 errors during evaluation resync, especially on the free tier. So there is no option of using solely evaluations without enabling tracing

Describe the solution you'd like
Add a flag to enable/disable Langfuse tracing per project, making tracing opt-in.

  • Tracing should be off by default (or explicitly toggleable) for a project
  • Orgs needing only evaluations can keep tracing disabled to save their rate-limit/credit budget
  • Orgs wanting full observability can enable it when necessary

Activity

  1. self-assigned this
    on Jun 12, 2026
  2. changed the title [-]Langfuse tracing[/-] [+]Kaapi: Opt-in Langfuse tracing[/+] on Jun 12, 2026
  3. moved this from To Do to In Progress in Kaapi-devon Jul 3, 2026
  4. moved this from In Progress to Closed in Kaapi-devon Jul 7, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

enhancementNew feature or request

Type

No type

Projects

  • Status
    Closed

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions