The Local AI Handbook

By TechCortado · Edition 1, · 183 pages

Cover of The Local AI Handbook: a laptop with an AI chip on the screen and a document beside it

Run private AI on your own computer, from your first document chat to a server you can trust. This free handbook shows what to install, what hardware you need and how to keep it safe.

It is plain language from start to finish, with worksheets, commands you can copy and a project directory. No sign-up needed to download.

Free. PDF for print and desktop (183 pages, 6 x 9 in). EPUB for e-readers and phones.

Also on Internet Archive and Leanpub.

What's inside

  • Start here: chat with your own documents, privately, in an afternoon
  • How local AI actually works, explained without the jargon
  • Hardware that runs it well: memory, graphics cards, Macs and used parts
  • Choosing your software and models: Ollama, AnythingLLM, llama.cpp and more
  • Engines and serving: running a model for the whole home or office
  • Document AI you can trust, plus images, voice and other media
  • Agents and coding assistants, and how to keep them on a short leash
  • Big models on small machines, and measuring what you really get
  • Security, privacy and running it well; teaching a model new tricks
  • When it goes wrong, worksheets, a project directory, a glossary and sources

Also free: The Laptop Security Handbook, 145 pages on locks, encryption, backups and what to do after a theft.

Licence

© 2026 TechCortado. All rights reserved. Free to share in complete, unmodified form. Please don't modify it, excerpt it, resell it or reuse its text, images or design without written permission. The latency probe in Appendix C is under the MIT License, as printed in the book. Third-party photos stay under their own licences, listed in the Image credits at the back of the book.

Stay in the loop

Follow TechCortado: