SSkilvy

There are many open models — and they are good

The world of open models is rich: there are many quality models of various sizes and purposes — language models, embedders, image models, speech models. They are published in open hubs from which they can be downloaded. The gap with closed models is narrowing, and for many tasks open models are quite enough. Let us cover how the ecosystem works and how to navigate the choice.

Open modelsHubs and communitiesDownload and use Ecosystem A rich choice
There is a rich ecosystem of open models of various sizes and purposes — they can be downloaded.

What is in the ecosystem

  • Language models (LLMs): open analogs of ChatGPT-like, of various sizes.
  • Embedders: open models for embeddings (semantic search, RAG — from the vector-search course).
  • Models for images, speech, other tasks: open models for CV, speech recognition/synthesis etc.
  • Model hubs: community platforms where open models are published and downloaded.
How to navigate the open-model ecosystem and how to choose a model?
The open-model ecosystem is rich and develops fast. How to navigate and choose: 1) Model diversity: — By task type: language models (LLMs for text), embedders (for semantic search/RAG), image models (generation, CV), speech (recognition/synthesis), multimodal. For your task there are almost certainly open models. — By size: from compact (fast, modest requirements, can run even on an ordinary computer/laptop) to large (more powerful but requiring serious hardware, usually a GPU). Size is a key selection parameter (more on this later). — By specialization: universal models and ones tuned for the specific (code, a certain language, a domain). 2) Where to get them: open models are published in model hubs — community platforms where they can be found, the description viewed and downloaded. There too is model info (size, purpose, requirements, license), often examples and discussions. These are like "stores" of open models. 3) How to choose a model (practical criteria): — Task: what the model is for (an LLM for text? an embedder? for images?). Take a model for your task type. — Size vs your resources: KEY. A large model is more powerful but requires more memory/computation (often a GPU). Make sure the model fits your hardware. Often it is sensible to take a smaller model that copes with the task and runs on available hardware (not chasing the biggest). — Quality for the task: not "the most powerful in general" but "good enough for YOUR task". For many tasks a compact open model suffices. — Language: make sure the model works well with your language — some open models are stronger in English (as discussed for embedders in the vector-search course). — License (IMPORTANT): open models have licenses defining how they can be used (including commercially). Not all "open" models can be freely used in business — CHECK the license before commercial use. This is an important legal point (a link to the law course). — Reputation/support: popular, well-documented models with an active community are easier to use and more reliable. 4) The gap with closed ones is narrowing: previously open models were noticeably inferior to closed, now the gap is decreasing, and good open models are quite competitive for many practical tasks. Do not consider open = "worse" — for your task an open one may be an excellent choice (and with the privacy/control/cost pluses from the previous lesson). 5) Ready tools for running: the ecosystem includes not only models but tools easing their download and running (the next module). You do not need to be a researcher — there are convenient ways to take a ready open model and use it. Practical rule: the open-model ecosystem is rich — for most tasks there are quality open models of various sizes, available in hubs. Choose for the TASK and for YOUR RESOURCES (model size vs your hardware — the key balance), check LANGUAGE support and necessarily the LICENSE (can it be used commercially). Often a compact open model that copes with the task on available hardware is a better practical choice than chasing the biggest. The gap with closed models is narrowing, so open ones are a real, not a "backup" option.

Size vs your resources — the key balance

The main practical selection parameter is model size versus your resources. Models range from compact (fast, modest requirements, run even on an ordinary computer) to large (more powerful but requiring serious hardware, usually a GPU). A large model is more powerful but must fit your hardware. Often it is more sensible to take a smaller model that copes with the task on available hardware than to chase the biggest. Choose not "the most powerful in general" but "good enough for your task" — for many tasks a compact open model suffices.

Check the language and the license

Two mandatory points when choosing. Language: make sure the model works well with your language — some open models are stronger in English (like embedders in the vector-search course). License (legally important): open models have licenses defining how they can be used, including commercially. Not all "open" models can be freely used in business — check the license before commercial use (a link to the law course). Models are published in community hubs with a description, requirements, license. The gap with closed ones is narrowing — open models are a real, not a "backup" option.

Rule: the open-model ecosystem is rich (LLMs, embedders, for images/speech, of various sizes). Choose for the task and your resources (size vs hardware — the key balance), check the language and necessarily the license (commercial use).

🧠 What must you check before commercially using an open model?