Private AI on Your Own Computer

Module 2 — Getting Started

Lesson 4: Choosing a First Model

Last updated: 2026-10-09

There are thousands of open models. You only need one or two. Pick a well-known family, a size that fits your memory, and a version made for chat, then try it on your real tasks.

Lesson 4: Choosing a First Model

Blackboard

Start with a known family

12 min
Concept 1

Well-known families

Start with a model family that many people use, from a recognised publisher: Google's Gemma, Alibaba's Qwen, Mistral, Meta's Llama and Muse models, DeepSeek and others. The apps' built-in model lists and Ollama's library highlight popular ones. Popular models are better tested, better supported and easier to get help with.

Concept 2

Chat or instruct versions

Many models come as a 'base' version and an 'instruct' or 'chat' version. For an assistant, you want the instruct or chat one. Some are also labelled for vision (they can read images), coding, or reasoning (they think step by step before answering, which is slower but better on hard problems).

Concept 3

Licences

Open-weight models come with licences. Some, such as Apache 2.0 or MIT, allow almost any use including commercial. Others add conditions, such as limits for very large companies or acceptable-use rules. For personal use this rarely matters; for business use, read the licence on the model page before you build on it.

Concept 4

Test on your own tasks

Benchmarks tell you little about your work. Run your three real tasks on two candidate models and compare: accuracy, tone, speed, and whether it follows instructions. Keep the winner, delete the other to save disk space, and check again in a few months, because new models arrive constantly.

Pause and Think

What three tasks would you most like a private assistant to do well? Write them down; they are your test.

Flashcards

Key Terms

Click or press Enter to flip a card. Review these before the practice question.

Additional Resources
Practice Question

You want a local assistant for drafting emails. Which version should you download?

Does not count for certificate
Choose one answer, use the hint if needed, then check your answer.
Use the hint before checking if you need a nudge.