Skip to content

Evaluation: Answer relevance validator #120

Closed

Description

@rkritika1508

Is your feature request related to a problem?
The lack of an answer relevance validator leads to uncertainty in evaluating the quality of answers. This causes frustration in ensuring that responses meet expected standards.

Describe the solution you'd like
Create an answer relevance validator that utilizes a custom judge based on the LLM (Language Model) approach.

Original issue

Is your feature request related to a problem? Please describe.
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]
Create the answer relevance validator which uses a custom judge (LLM as a judge approach).

Describe the solution you'd like
A clear and concise description of what you want to happen.

Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.

Additional context
Add any other context or screenshots about the feature request here.

Activity

  1. changed the title [-]Answer Relevance Validator[/-] [+]Evaluation: Answer relevance validator[/+] on May 18, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions