#GGUF

3 articles with this tag

llamafile v0.10.5 Ships With Big Local Models
Artificial Intelligence

llamafile v0.10.5 Ships With Big Local Models

Llamafile v0.10.5 adds support for two large local AI models, Ternary Bonsai 27B and Laguna-S-2.1, by updating its core llama.cpp integration.

3 months ago
Mozilla.ai Unveils transcribe.cpp
Technology

Mozilla.ai Unveils transcribe.cpp

Mozilla.ai launches transcribe.cpp, an open-source C/C++ library for fast, GPU-accelerated speech-to-text inference with broad model support.

4 months ago
Run LLMs Locally with Llama.cpp
Artificial Intelligence

Run LLMs Locally with Llama.cpp

Cedric Clyburn explains how Llama.cpp makes running large language models locally on consumer hardware possible, highlighting GGUF format and optimized kernels for efficiency and accessibility.

8 months ago