Glossary · Training & tuning

QLoRA

A memory-efficient variant of LoRA that fine-tunes a quantized (typically 4-bit) base model, drastically cutting the GPU memory needed.

Related terms

• Hugging Face Transformers
• LoRA (low-rank adaptation)
• alignment (LLM)
• direct preference optimization (DPO)
• extended thinking
• fine-tuning

Vynaris is an inference gateway that routes each request to the cheapest right-sized model and shows the receipt. Get an API key or read the docs.