Run open models on your own computer (or a cheap host) for simple jobs
Open-weight models can run on your own computer with a free tool like Ollama, so routine jobs cost nothing per message. Some hosts also run open models for a fraction of big-model prices.
What the bot does
- Installs a local model runner like Ollama on your computer.
- Downloads an open model that fits your machine.
- Points your bot's simple, private jobs (sorting, summarizing notes) at the local model.
- Keeps a paid cloud model only for jobs the local one can't handle.
What you end up with
Routine bot jobs that run on your own hardware with no per-message bill, and your private text staying on your machine.
Copy-paste prompt
Fill in the [brackets]. Then paste it into any tool below.
Help me run [task, e.g. 'sort my notes into categories'] on a local model. My computer: [Mac/Windows, RAM, graphics card if known]. Suggest one open model that fits, the exact Ollama commands to install and run it, and a short test so I can check the quality before relying on it.
Tools that can do it today
- localOllama (local models)Runs open models locallyFree to download; runs open models on your own computer
- automationn8nCan call a local model from a workflowFree to self-host; paid cloud plans
Plans and limits change; check each tool's page.
Watch out
- Local models are usually less capable than top cloud models. Test on real examples first.
- Your computer has to be on, and big models need a lot of memory.
- Licences vary. Mistral says its open-weight models are Apache 2.0 for research and individual use, while commercial deployments need a Mistral licence.
Questions people ask
Which AI tools can do this?
Ollama (local models) or n8n can do this today. Paste the copy-paste prompt on this page into any of them and fill in the [brackets].
How hard is it to set up?
It's rated Advanced. Start with the steps under “What the bot does”.
What should I watch out for?
Local models are usually less capable than top cloud models. Test on real examples first.
Sources
- articleOllama: "Run AI models locally and in the cloud"; prompts "never stored or trained on"
- docsGroqCloud models and prices: hosted open-weight gpt-oss-120b at $0.15 / $0.60 per million tokens
- docsMistral pricing FAQ: self-hosting and open-weight licences
Last checked Oct 21, 2026. Self-reported results from posts are the poster's own claims.