Glossary · Inference & serving

Ollama

A developer tool for downloading, running, and serving open-weight LLMs locally with a simple CLI and API.

Related terms

• FlashAttention
• KV cache
• PagedAttention
• SGLang
• autoscaling (inference)
• batch API

Vynaris is an inference gateway that routes each request to the cheapest right-sized model and shows the receipt. Get an API key or read the docs.