Infer Ring

Infer Ring enables local LLM inference by combining the memory of multiple iOS and macOS devices. Just run the app on each device to pool their RAM and unlock models that wouldn’t fit on a single machine. Infer Ring works over both Wi-Fi and wired connections — simply connecting devices with a USB cable lets you immediately utilise their combined power. Supports both tensor and pipeline parallelism.