subcluster
Multi-Model
2 articles
Articles
May 30, 2026
The Guide to Serving Fine-Tuned LLMs in Production
Training a model is no longer the hard part. Serving fine-tuned models at scale requires avoiding memory bottlenecks and excessive costs for idle GPUs.
April 19, 2026
Multi-Model Serving on Single GPUs with vLLM and PagedAttention
Dedicating a high-end GPU to a single model often leaves most of the card idle and the unit economics unsustainable. Modern inference stacks now allow for concurrent model execution on a single H100 or B200 node without the latency penalties of traditional context switching.