Setting Up Local LLMs on macOS

Fri, 21 Aug 2026 00:00:00 +0000

In this post, I’ll go over how to set up local LLMs on macOS, though the same steps should also work on Windows if using Windows Subsystem for Linux (WSL). More on that in the next blog post, which will be about setting up Windows 11 for development!

There are some reasons why it might be nice to have local LLMs on your computer, and one reason is that it is completely yours. Cloud-based LLMs like ChatGPT, Gemini, Grok, etc, tend to be very limiting because you are subject to the company’s policies on what you can and can’t do with it. It also offers complete privacy, the ability to access it offline, and no billing or usage limitations.

Ollama on Vivek Kumar

Setting Up Local LLMs on macOS