Drex 2.0 runs locally on Apple Silicon, with a 21.2 GB model and 36 GB memory requirement
Nace AI’s Drex 2.0 decision model can run locally on Apple Silicon through Kapitsa or Nace’s modified llama.cpp and Ollama engines; stock versions of llama.cpp and Ollama cannot serve its decision endpoint. The model file is 21.2 GB, and the setup requires a Mac with at least 36 GB of unified memory. In Nace’s separate test, the 4-bit version matched the full-precision model’s top answer on 96.97% of 2,710 questions.
Bottom line — The 4-bit Drex 2.0 scored 80.42% on a 2,710-question subset, against 80.51% for full precision.