Repository navigation
Monitoring: Alerting for API thresholds #803
Description
Is your feature request related to a problem?
There are currently no alerts for when the per API key request rate exceeds defined thresholds. This can lead to unexpected usage spikes and potential service disruptions.
Describe the solution you'd like
Add alerting for the following per API key request rate thresholds:
- llm/call/ > 15/min
- evaluations/ > 3/min
- collections/ > 3/min
Send a notification to Discord upon any threshold breach.
Original issue
Add alerting when per API key request rate exceeds defined thresholds:
- llm/call/ > 15/min
- evaluations/ > 3/min
- collections/ > 3/min
Send notification to Discord on threshold breach.
Activity
[-]Observability: Per-API key rate limit alerts with Discord notification[/-][+]Monitoring: Alerting for API thresholds[/+]