Repository navigation
Analytics: APIs for Analytics Dashboard #851
Description
Summary
Currently, we do not have a centralized analytics dashboard where we can track and analyze:
- provider-wise usage,
- provider-wise costs,
- LLM Call Usage
- organization-level usage,
- and evals-related consumption details.
Because of this, whenever organizations ask for their monthly usage or total evals cost, we currently need to manually calculate or fetch the data, which creates operational dependency and overhead.
To solve this, we need to build backend APIs for a centralized analytics dashboard that can provide usage and cost insights across providers, organizations, and different workflows.
Problem Statement
Right now:
- there is no single place to analyze provider usage,
- we cannot easily track which provider incurred the highest cost,
- there is no monthly cost comparison,
- org-level evals usage is not directly visible,
- and support/ops teams need to manually investigate usage-related queries.
This becomes difficult as more organizations start using Kaapi.
Goal
Build backend APIs that will power an analytics dashboard for:
- provider usage tracking,
- provider cost analysis,
- organization-level usage tracking,
- evals usage reporting,
- and monthly cost trends.
Activity
[-]Analytics Dashboard[/-][+]Analytics Dashboard: Redesign for clarity[/+][-]Analytics Dashboard: Redesign for clarity[/-][+]Analytics: APIs for Analytics Dashboard[/+]Ayush8923 commentedon May 22, 2026
@PritamSGB @kartpop For now, in the analytics dashboard, we can start by showing the following usage metrics:
If you have any thoughts or suggestions on which stats should be prioritized and shown in the dashboard, please let me know.
PritamSGB commentedon May 22, 2026
Sharing as per priority I am thinking