Who it's for
For people comfortable with a terminal who want to run AI models on their own computer, private and offline. You need a Mac, Windows or Linux computer, ideally with a graphics card or an Apple silicon chip, and Python for the code examples.
Lessons
- 1Ollama tutorial: run AI models on your own computerAn Ollama tutorial for Windows, macOS and Linux: install it, download and chat with a first local model, then list, stop and remove models and move their files.
- 2Ollama API: call a local model from your codeCall a local model from code with the Ollama API: /api/generate and /api/chat with curl and Python, streaming, the OpenAI-compatible endpoint and a Modelfile.
- 3LM Studio tutorial: run local models in a desktop appAn LM Studio tutorial: check your hardware, get a model from the built-in search, chat with it and your files, then run its OpenAI-compatible server and lms.
- 4Local LLM hardware requirements: how much VRAM a model needsLocal LLM hardware requirements, worked out: how parameters and GGUF quantization set a model size, how much VRAM it needs, and what CPU, GPU or a Mac changes.
Frequently asked questions
Do I need a GPU for this course?
No, but it helps. Ollama and LM Studio can run models on the processor from system RAM, only slower. Ollama recommends 8 GB of VRAM, or unified memory on a Mac, for its quickstart model, and lesson 4 shows how to size any other model.
Does the course use Ollama or LM Studio?
Both. Lessons 1 and 2 use Ollama from the terminal and through its API, and lesson 3 uses the LM Studio app, its server and its lms command. Both run GGUF models through llama.cpp, so the sizing in lesson 4 applies to either.
Is running a model locally private?
The model runs on your machine, so the prompts and files you give it stay there. Downloads, app updates and any cloud features you turn on still use the internet, and a server you share on your network is open to other devices.
What should I learn after this course?
The Hugging Face course is next. It starts with the Hub, where the models and GGUF files used in this course are published.
