GPT4All

Ollama

Run LLMs locally with ease

llama.cpp

Run LLMs on CPU with quantization

llama.cpp

Run LLMs on CPU

Text Generation WebUI

LLM inference interface