NVIDIA PAIR Turns Idle Home PCs Into a Private AI Cluster, Cutting Cloud Inference Bills
NVIDIA unveils PAIR, a software router that distributes AI inference across devices on a home network to create a private, cloud-free AI cluster. It auto-discovers machines, uses secure MTLS, and proxies via Ollama and LM Studio, with cross-platform support (Windows, Linux, macOS) and an open-source Apache 2.0 beta release. By routing idle GPU/CPU workloads to available nodes and avoiding apps like gaming on busy machines, PAIR aims to reduce cloud API usage—statements suggest substantial savings (e.g., around $1,200/month in cloud credits for certain workloads)—while keeping data and prompts local. It does not merge VRAM or tensor-split models; instead it uses a queue-based scheduler for multi-agent workflows, multi-tasking, and system offload, with planned future enhancements.