Metrics

Subpackages

• Answer Relevance
  • Submodules
    • Answer Relevance Decorator
      • AnswerRelevanceDecorator
    • Answer Relevance Metric
      • AnswerRelevanceMetric
• Answer Similarity
  • Submodules
    • Answer Similarity Decorator
      • AnswerSimilarityDecorator
    • Answer Similarity Metric
      • AnswerSimilarityMetric
• Average Precision
  • Submodules
    • Average Precision Decorator
      • AveragePrecisionDecorator
    • Average Precision Metric
      • AveragePrecisionMetric
      • AveragePrecisionResult
• Context Relevance
  • Submodules
    • Context Relevance Decorator
      • ContextRelevanceDecorator
    • Context Relevance Metric
      • ContextRelevanceMetric
      • ContextRelevanceResult
• Evasiveness
  • Submodules
    • Evasiveness Decorator
      • EvasivenessDecorator
    • Evasiveness Metric
      • EvasivenessMetric
      • EvasivenessResult
• Faithfulness
  • Submodules
    • Faithfulness Decorator
      • FaithfulnessDecorator
    • Faithfulness Metric
      • FaithfulnessMetric
• Hap
  • Submodules
    • Hap Decorator
      • HAPDecorator
    • Hap Metric
      • HAPMetric
      • HAPResult
• Harm
  • Submodules
    • Harm Decorator
      • HarmDecorator
    • Harm Metric
      • HarmMetric
      • HarmResult
• Harm Engagement
  • Submodules
    • Harm Engagement Decorator
      • HarmEngagementDecorator
    • Harm Engagement Metric
      • HarmEngagementMetric
      • HarmEngagementResult
• Hit Rate
  • Submodules
    • Hit Rate Decorator
      • HitRateDecorator
    • Hit Rate Metric
      • HitRateMetric
      • HitRateResult
• Jailbreak
  • Submodules
    • Jailbreak Decorator
      • JailbreakDecorator
    • Jailbreak Metric
      • JailbreakMetric
      • JailbreakResult
• NDCG
  • Submodules
    • NDCG Decorator
      • NDCGDecorator
    • NDCG Metric
      • NDCGMetric
      • NDCGResult
• Pii
  • Submodules
    • Pii Decorator
      • PIIDecorator
    • Pii Metric
      • PIIMetric
      • PIIResult
• Profanity
  • Submodules
    • Profanity Decorator
      • ProfanityDecorator
    • Profanity Metric
      • ProfanityMetric
      • ProfanityResult
• Prompt Safety Risk
  • Submodules
    • Prompt Safety Risk Decorator
      • PromptSafetyRiskDecorator
    • Prompt Safety Risk Metric
      • PromptSafetyRiskMetric
      • PromptSafetyRiskResult
• Reciprocal Rank
  • Submodules
    • Reciprocal Rank Decorator
      • ReciprocalRankDecorator
    • Reciprocal Rank Metric
      • ReciprocalRankMetric
      • ReciprocalRankResult
• Retrieval Precision
  • Submodules
    • Retrieval Precision Decorator
      • RetrievalPrecisionDecorator
    • Retrieval Precision Metric
      • RetrievalPrecisionMetric
      • RetrievalPrecisionResult
• Sexual Content
  • Submodules
    • Sexual Content Decorator
      • SexualContentDecorator
    • Sexual Content Metric
      • SexualContentMetric
      • SexualContentResult
• Social Bias
  • Submodules
    • Social Bias Decorator
      • SocialBiasDecorator
    • Social Bias Metric
      • SocialBiasMetric
      • SocialBiasResult
• Text Grade Level
  • Submodules
    • Text Grade Level Decorator
      • TextGradeLevelDecorator
    • Text Grade Level Metric
      • TextGradeLevelMetric
      • TextGradeLevelResult
• Text Reading Ease
  • Submodules
    • Text Reading Ease Decorator
      • TextReadingEaseDecorator
    • Text Reading Ease Metric
      • TextReadingEaseMetric
      • TextReadingEaseResult
• Tool Call Accuracy
  • Submodules
    • Tool Call Accuracy Decorator
      • ToolCallAccuracyDecorator
    • Tool Call Accuracy Metric
      • ToolCallAccuracyMetric
• Tool Call Parameter Accuracy
  • Submodules
    • Tool Call Parameter Accuracy Decorator
      • ToolCallParameterAccuracyDecorator
    • Tool Call Parameter Accuracy Metric
      • ToolCallParameterAccuracyMetric
• Tool Call Relevance
  • Submodules
    • Tool Call Relevance Decorator
      • ToolCallRelevanceDecorator
    • Tool Call Relevance Metric
      • ToolCallRelevanceMetric
• Tool Call Syntactic Accuracy
  • Submodules
    • Tool Call Syntactic Accuracy Decorator
      • ToolCallSyntacticAccuracyDecorator
    • Tool Call Syntactic Accuracy Metric
      • ToolCallSyntacticAccuracyMetric
• Topic Relevance
  • Submodules
    • Topic Relevance Decorator
      • TopicRelevanceDecorator
    • Topic Relevance Metric
      • TopicRelevanceMetric
      • TopicRelevanceResult
• Unethical Behavior
  • Submodules
    • Unethical Behavior Decorator
      • UnethicalBehaviorDecorator
    • Unethical Behavior Metric
      • UnethicalBehaviorMetric
      • UnethicalBehaviorResult
• Unsuccessful Requests
  • Submodules
    • Unsuccessful Requests Decorator
      • UnsuccessfulRequestsDecorator
    • Unsuccessful Requests Metric
      • UnsuccessfulRequestsMetric
      • UnsuccessfulRequestsResult
• Violence
  • Submodules
    • Violence Decorator
      • ViolenceDecorator
    • Violence Metric
      • ViolenceMetric
      • ViolenceResult

Submodules

• Base Metric Decorator
  • BaseMetricDecorator
    • BaseMetricDecorator.compute_helper()
    • BaseMetricDecorator.validate()