You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Is your feature request related to a problem?
The lack of an answer relevance validator leads to uncertainty in evaluating the quality of answers. This causes frustration in ensuring that responses meet expected standards.
Describe the solution you'd like
Create an answer relevance validator that utilizes a custom judge based on the LLM (Language Model) approach.
Original issue
Is your feature request related to a problem? Please describe.
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]
Create the answer relevance validator which uses a custom judge (LLM as a judge approach).
Describe the solution you'd like
A clear and concise description of what you want to happen.
Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.
Additional context
Add any other context or screenshots about the feature request here.
Activity
[-]Answer Relevance Validator[/-][+]Evaluation: Answer relevance validator[/+]