Ollama

Get up and running with large language models. Run Llama 3, Mistral, Gemma, and other models. Customize and create your own.

A very convenient way to run different LLMs locally on your Mac. You can chat via Terminal or use GUIs like Ollamac, Enchanted LLM, or MindMac. In addition you can use it with NotesOllama together with Apple Notes or with the help of plugins in Obsidian.

ollama.com/