Weightless Add to Chrome ↗

Blog ·

An AI that never leaves your computer: Gemini Nano and Ollama

A contract, a medical file, a sensitive email? With Gemini Nano or Ollama, Weightless AI runs the AI on your own machine. Nothing goes online, and there is no key to create.

When you ask an AI to fix an email, the text usually goes to an online provider. For a shopping list, who cares. For a contract, a payslip or a very personal message, you would rather keep the text at home.

That is exactly what local AI is for in Weightless AI: the model runs on your computer, and your text never leaves your machine.

With local AI, everything stays home
IA
Your computer
Internetnothing goes out

Two local AIs to choose from

In the assistant (Alt + W), click the engine badge at the top of the window: engines are sorted into two groups, “Local (private)” and “Online”. The first group contains:

  • Gemini Nano, the AI built into Google Chrome: nothing to install apart from the model, no key, no account;
  • Ollama, free software you install on your computer, which runs open models (Llama, Mistral, Gemma…).

And since each conversation tab keeps its own engine, you can use online Gemini in one tab for research and Nano in the next for a confidential text.

Gemini Nano: the AI already inside Chrome

Gemini Nano works with no key and no connection. You need:

  • Google Chrome 148 or later, on a computer (Windows, Mac or Linux with Google Chrome; on a Chromebook, only recent, powerful models, not standard Chromebooks; not on phones);
  • about 20 GB of free disk space, the model itself weighing 2.7 to 4 GB.

In the assistant settings, the “Download the model” button starts the download, once. After that, Nano answers even offline.

Good to know: Chrome removes the model by itself if it hasn’t been used for 30 days, or if your disk drops below 5 GB free. Just download it again.

Nano is a small model: shorter answers, shorter texts (about 4,000 characters of page), no web search, no PDFs. To fix, rephrase or translate a message, it is plenty.

Ollama: your own AI server, at home

Ollama installs on Windows, Mac, Linux, and even on a Chromebook in the Linux environment. Weightless AI detects it automatically at the usual address (http://localhost:11434) and picks a model you have already installed.

One precaution: allow the extension to talk to it. The FAQ inside the assistant gives the exact command for each system, for example on Mac and Windows:

OLLAMA_ORIGINS=chrome-extension://*

On a Chromebook, the address to enter in the “Ollama URL (local)” setting is http://penguin.linux.test:11434, and the FAQ provides a ready-made command to paste into the Linux terminal.

With Ollama, you can handle longer texts than with Nano (about 8,000 characters of page), depending on how powerful your machine is.

When should you pick local AI?

  • Contract, health, HR, client data: local AI (Nano or Ollama);
  • an everyday email: either, as you prefer;
  • current events, research with sources: online Gemini;
  • summarising a long PDF: online Gemini.

And where does Weightless AI fit in?

Whether you choose an online or a local engine, Weightless AI has no server: there is nowhere we could receive your texts. With local AI, the chain is simply as short as it gets: your keyboard, your computer, and that’s it.

← All articles

Add
to Chrome