Skills Night › Introduction to AI

Lesson 4.6 — Moving to the Mac Mini

Introduction to AI · Module 4: Local LLMs · About 60 min · Mac Mini (Apple Silicon), Terminal

Goal: run local models on the Mac Mini, rerun your 4 tasks from Lesson 4.1, and compare speed with the 4090.

On a Mac, the model lives in unified memory (shared RAM), not a separate graphics card. A model needs its size plus a few GB of headroom.

Before you start

Step 1 · How much memory? (⏱ 0:00–0:05)

sysctl -n hw.memsize | awk '{print $1/1073741824 " GB"}'

You should see e.g. 32 GB. Pick from this table:

Mac memoryUse
16 GBqwen3:8b or deepseek-r1:8b
24–32 GBqwen3:14b or deepseek-r1:14b
48 GB+qwen3.8:27b and deepseek-r1:32b (same as the PC)

Step 2 · Install Ollama (⏱ 0:05–0:15)

Download Ollama for macOS from https://ollama.com/download, open the file and drag Ollama into Applications. Open it once from Applications, then in Terminal:

ollama --version

You should see ollama version is 0.40.x (or newer).

Step 3 · Pull your model (⏱ 0:15–0:30)

ollama pull qwen3:14b
ollama list

(Use the model from your Step 1 choice.) While it downloads, put your task files in a folder:

mkdir -p ~/llm-test && open ~/llm-test

Drag t1.txt–t4.txt into that folder.

Step 4 · Speed check (⏱ 0:30–0:35)

ollama run qwen3:14b --verbose "Explain VRAM in 2 sentences"
ollama ps

You should see eval rate: ... tokens/s and 100% GPU in ollama ps (on a Mac, GPU means Apple's Metal).

Step 5 · Rerun the 4 tasks (⏱ 0:35–0:50)

This is the Mac (zsh) version of the 4.1 loop. Paste it all:

cd ~/llm-test
M=qwen3:14b
for t in 1 2 3 4; do
  echo "Running task $t..."
  start=$(date +%s)
  ollama run "$M" "$(cat t$t.txt)" > "mac-${M//:/_}-t$t.md"
  echo "  done in $(( $(date +%s) - start )) s"
done
echo "ALL DONE"

You should see 4 "done in ... s" lines, then ALL DONE.

Step 6 · Compare (⏱ 0:50–1:00)

PC (4090)Mac Mini
Model
Speed (tokens/s)
Avg quality (1–5) on 4 tasks
Noise / power

Write: "On the Mac I'll use for ; heavy jobs go to ."

✅ Pass check

Troubleshooting

ProblemFix
ollama: command not foundOpen the Ollama app from Applications once, then open a new Terminal window.
Very slow or the Mac freezesThe model is too big for your memory: use the next size down. Close Safari/Chrome.
ollama ps shows CPUMemory is too tight. Use a smaller model.
Can the Mac use the PC's model?Yes, later: it needs network setup on the PC (OLLAMA_HOST) plus a firewall rule. Ask Skills Coach; don't open it to the whole network.
Stuck? Ask Skills Coach. Send a screenshot or paste the error plus the step number. Don't stay stuck on one step for more than 10 minutes.

Finish this lesson

← Previous (4.5)