Local LLM Guide
Welcome!
This guide serves as a starting point for anyone interested in running a Large Language Model (LLM) using their own computer and text-generation-webui.
Text-generation-webui is a free, open-source GUI for running local text generation, and a viable alternative for cloud-based AI assistant services.
The guide will take you step by step through installing text-generation-webui, selecting your first model, loading and using it to chat with an AI assistant. You will learn how to configure the model to your liking, and what sort of hardware capabilities will you need.
Text-generation-webui is still in active development. It is, however, one of the most feature-rich and user friendly GUIs for text generation. While this guide covers only the basics, you can find many advanced features in the official documentation and on the community forums.
A PDF version of this guide is also available here.