Lesson 4.6 — Moving to the Mac Mini
Introduction to AI · Module 4: Local LLMs · About 60 min · Mac Mini (Apple Silicon), Terminal
Goal: run local models on the Mac Mini, rerun your 4 tasks from Lesson 4.1, and compare speed with the 4090.
Before you start
Step 1 · How much memory? (⏱ 0:00–0:05)
sysctl -n hw.memsize | awk '{print $1/1073741824 " GB"}'You should see e.g. 32 GB. Pick from this table:
| Mac memory | Use |
|---|---|
| 16 GB | qwen3:8b or deepseek-r1:8b |
| 24–32 GB | qwen3:14b or deepseek-r1:14b |
| 48 GB+ | qwen3.8:27b and deepseek-r1:32b (same as the PC) |
Step 2 · Install Ollama (⏱ 0:05–0:15)
Download Ollama for macOS from https://ollama.com/download, open the file and drag Ollama into Applications. Open it once from Applications, then in Terminal:
ollama --versionYou should see ollama version is 0.40.x (or newer).
Step 3 · Pull your model (⏱ 0:15–0:30)
ollama pull qwen3:14b
ollama list(Use the model from your Step 1 choice.) While it downloads, put your task files in a folder:
mkdir -p ~/llm-test && open ~/llm-testDrag t1.txt–t4.txt into that folder.
Step 4 · Speed check (⏱ 0:30–0:35)
ollama run qwen3:14b --verbose "Explain VRAM in 2 sentences"
ollama psYou should see eval rate: ... tokens/s and 100% GPU in ollama ps (on a Mac, GPU means Apple's Metal).
Step 5 · Rerun the 4 tasks (⏱ 0:35–0:50)
This is the Mac (zsh) version of the 4.1 loop. Paste it all:
cd ~/llm-test
M=qwen3:14b
for t in 1 2 3 4; do
echo "Running task $t..."
start=$(date +%s)
ollama run "$M" "$(cat t$t.txt)" > "mac-${M//:/_}-t$t.md"
echo " done in $(( $(date +%s) - start )) s"
done
echo "ALL DONE"You should see 4 "done in ... s" lines, then ALL DONE.
Step 6 · Compare (⏱ 0:50–1:00)
| PC (4090) | Mac Mini | |
|---|---|---|
| Model | ||
| Speed (tokens/s) | ||
| Avg quality (1–5) on 4 tasks | ||
| Noise / power |
Write: "On the Mac I'll use for ; heavy jobs go to ."
✅ Pass check
Troubleshooting
| Problem | Fix |
|---|---|
ollama: command not found | Open the Ollama app from Applications once, then open a new Terminal window. |
| Very slow or the Mac freezes | The model is too big for your memory: use the next size down. Close Safari/Chrome. |
ollama ps shows CPU | Memory is too tight. Use a smaller model. |
| Can the Mac use the PC's model? | Yes, later: it needs network setup on the PC (OLLAMA_HOST) plus a firewall rule. Ask Skills Coach; don't open it to the whole network. |
Finish this lesson
Nice work! Pick your next step: