Text Generation WebUI

Ollama

Run LLMs locally with ease

llama.cpp

Run LLMs on CPU

llama.cpp

Run LLMs on CPU with quantization

LM Studio

Run local LLMs with a GUI