Glossary · Routing & cost

LLM gateway

A proxy layer sitting between an application and one or more LLM providers that handles routing, caching, auth, logging, and cost control.

Related terms

• AI gateway
• BYOK (bring your own key)
• LLM router
• LLM unit economics
• cascading inference
• cost ceiling

Vynaris is an inference gateway that routes each request to the cheapest right-sized model and shows the receipt. Get an API key or read the docs.