Glossary · Evals & quality

LLM benchmark

A standardized dataset and scoring methodology used to compare model capabilities across providers.

Related terms

• Chatbot Arena
• Elo rating (LLM)
• LLM observability
• LLM-as-judge
• MMLU
• PII detection

Vynaris is an inference gateway that routes each request to the cheapest right-sized model and shows the receipt. Get an API key or read the docs.