llama.cpp
Free
Run LLMs on CPU with quantization
3.0
3.0(1 reviews)About
llama.cpp enables running large language models on consumer hardware using CPU with optimized quantization techniques. Supports many model formats.
Categories
Reviews (1)
A
Admin
Good start but needs more features to compete with established options.