Every article tagged "local-ai".
Colibri is a pure-C, zero-dependency inference engine that runs Mixture-of-Experts models as large as 744 billion parameters on consumer hardware with 25GB of RAM. It works by streaming expert weights