Repository navigation
Evaluation: Add latency metric #1040
Description
Is your feature request related to a problem?
We lack important metrics like latency for fast evaluations, which impacts decision-making processes. The absence of these metrics can lead to suboptimal choices.
Describe the solution you'd like
- Add latency as a metric for fast evaluations
- Note that cost metrics have already been added
Original issue
- Latency as metric to add for Fast evals
- Cost is already added
Metadata
Metadata
Assignees
Labels
No labels
Type
Projects
- Status
Activity
[-]Need of more metrics for decision making like Latency, cost during the Eval runs besides accuracy[/-][+]Evaluation: Add latency metric[/+]