Glossary · Evals & quality

MMLU

A widely cited benchmark (Massive Multitask Language Understanding) testing model knowledge across dozens of academic subjects.

Related terms

• Chatbot Arena
• Elo rating (LLM)
• LLM benchmark
• LLM observability
• LLM-as-judge
• PII detection

Vynaris is an inference gateway that routes each request to the cheapest right-sized model and shows the receipt. Get an API key or read the docs.