> ## Documentation Index
> Fetch the complete documentation index at: https://arizeai-433a7140.mintlify.site/llms.txt
> Use this file to discover all available pages before exploring further.

# SDK Eval Metrics

> Ready-to-use evaluation metrics for measuring LLM application quality

Phoenix provides pre-built evaluation metrics that can be used out of the box to assess LLM application quality. These metrics are available in both Python and TypeScript and are designed to work seamlessly with Phoenix's tracing and experiment infrastructure.

All LLM evaluation templates are tested against golden datasets and achieve an F1 score of 85% or higher on benchmarks.

## LLM Evaluators

LLM evaluators use a judge model to assess the quality of outputs. These are useful for subjective or nuanced evaluations where simple rules don't suffice.

> [card] [Faithfulness](https://arizeai-433a7140.mintlify.site/docs/phoenix/evaluation/pre-built-metrics/faithfulness.md)
>
> Measures whether a response is faithful to (grounded in) the provided context. Detects hallucinations and unsupported claims.

> [card] [Hallucination](https://arizeai-433a7140.mintlify.site/docs/phoenix/evaluation/pre-built-metrics/hallucination.md)
>
> Detects claims in a response that are unsupported by, or contradict, the conversation. The conversation-level counterpart to Faithfulness.

> [card] [Completeness](https://arizeai-433a7140.mintlify.site/docs/phoenix/evaluation/pre-built-metrics/completeness.md)
>
> Checks whether every active user request in a conversation was actually completed, not merely acknowledged.

> [card] [Conciseness](https://arizeai-433a7140.mintlify.site/docs/phoenix/evaluation/pre-built-metrics/conciseness.md)
>
> Evaluates whether a response is concise and free of unnecessary content like filler, hedging, and meta-commentary.

> [card] [Correctness](https://arizeai-433a7140.mintlify.site/docs/phoenix/evaluation/pre-built-metrics/correctness.md)
>
> Evaluates the general correctness of an LLM response.

> [card] [Retrieval Relevance](https://arizeai-433a7140.mintlify.site/docs/phoenix/evaluation/pre-built-metrics/retrieval-relevance.md)
>
> Assesses whether externally retrieved information is relevant to the request, from any source: RAG, tools, MCP, or web search.

> [card] [Tool Selection](https://arizeai-433a7140.mintlify.site/docs/phoenix/evaluation/pre-built-metrics/tool-selection.md)
>
> Determines whether the correct tool was selected for a given context from the available options.

> [card] [Tool Invocation](https://arizeai-433a7140.mintlify.site/docs/phoenix/evaluation/pre-built-metrics/tool-invocation.md)
>
> Checks if a tool was invoked correctly with proper arguments, formatting, and safe content.

> [card] [Tool Response Handling](https://arizeai-433a7140.mintlify.site/docs/phoenix/evaluation/pre-built-metrics/tool-response-handling.md)
>
> Evaluates whether an agent correctly processed a tool's result, including error handling, data extraction, and safe information disclosure.

> [card] [Refusal](https://arizeai-433a7140.mintlify.site/docs/phoenix/evaluation/pre-built-metrics/refusal.md)
>
> Detects when an LLM refuses, declines, or avoids answering a user query.

> [card] [User Friction](https://arizeai-433a7140.mintlify.site/docs/phoenix/evaluation/pre-built-metrics/user-friction.md)
>
> Detects corrections, retries, frustration, and challenges expressed in a user's follow-up message.

> [card] [PII Detection](https://arizeai-433a7140.mintlify.site/docs/phoenix/evaluation/pre-built-metrics/pii-detection.md)
>
> Screens a conversation record for personally identifiable information.

> [card] [Toxicity](https://arizeai-433a7140.mintlify.site/docs/phoenix/evaluation/pre-built-metrics/toxicity.md)
>
> Detect hateful, demeaning, abusive, or threatening text in model outputs or user inputs.

## Code Evaluators

Code evaluators use deterministic logic for evaluation. These are faster, cheaper, and provide consistent results for objective criteria.

> [card] [Exact Match](https://arizeai-433a7140.mintlify.site/docs/phoenix/evaluation/pre-built-metrics/exact-match.md)
>
> Checks if the output exactly matches an expected value. Supports optional normalization.

> [card] [Matches Regex](https://arizeai-433a7140.mintlify.site/docs/phoenix/evaluation/pre-built-metrics/matches-regex.md)
>
> Validates that output matches a specified regular expression pattern.

> [card] [Precision / Recall / F-Score](https://arizeai-433a7140.mintlify.site/docs/phoenix/evaluation/pre-built-metrics/precision-recall-fscore.md)
>
> Computes precision, recall, and F1 scores for comparing predicted vs actual values.

> [!NOTE]
>
> Looking to create custom evaluators? See the [Building Custom Evaluators](https://arizeai-433a7140.mintlify.site/docs/phoenix/evaluation/how-to-evals/custom-llm-evaluators.md) guide.
