​

llama-cpp

Runs LLM inference on CPU, Apple Silicon, and consumer GPUs without NVIDIA hardware. Use for edge deployment, M1/M2/M3 Macs, AMD/Intel GPUs, or when CUDA is unavailable. Supports GGUF quantization (1.5-8 bit) for reduced memory and 4-10× speedup vs PyTorch on CPU.

​

Install

npx research-agent-skills install llama-cpp
npx skills add KalarisLabs/research-agent-skills --skill llama-cpp

​

When to use it

​

Full playbook