You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Is your feature request related to a problem?
We lack a centralized analytics dashboard to track and analyze provider-wise usage, costs, LLM call usage, organization-level usage, and evals-related consumption. This requires manual data retrieval when organizations request their monthly usage or eval costs, leading to operational overhead.
Describe the solution you'd like
Build backend APIs for a centralized analytics dashboard
Show all relevant data in one dashboard
Original issue
Describe the current behavior
Currently, we do not have a centralized analytics dashboard where we can track and analyze:
• provider-wise usage,
• provider-wise costs,
• LLM Call Usage
• Organization-level usage,
• and evals-related consumption details.
Because of this, whenever organizations ask for their monthly usage or total evals cost, we currently need to manually calculate or fetch the data, which creates operational dependency and overhead.
To solve this, we need to build backend APIs for a centralized analytics dashboard that can provide usage and cost insights across providers, organizations, and different workflows.
Describe the enhancement you'd like
Need to create the one dashboard where we can show all the data.
Activity
[-]Dashboard: Analytics for data consuming monitoring[/-][+]Analytics Dashboard: Centralized usage tracking[/+]