Repository navigation
Ollama cloud models: say where they run and what they cost; docs with setup and prices - #144
Merged
Merged
Conversation
… setup and prices Tags ending in 'cloud' (minimax-m3.1-flash:cloud) run on ollama.com through the local Ollama. lcode used them like any installed model, but the stronger-model panel said 'free: it runs on this machine' for them, Ollama's bare 'Unauthorized' gave no hint, and lcode tried to load them into memory and checked them against the GPU. Now the panel says ollama.com and shows the cost; a refused request says to run ollama signin (with the Docker container's name when Ollama runs in one); lcode doctor, the start of a session and /model say that what lcode sends goes to ollama.com; and the local loading and GPU checks are skipped for them. docs/models.md gets a 'Cloud models through Ollama' section: what changes, the setup for a normal and a Docker install, using one as the main or the stronger model, and the cloud models that call tools with their prices (ollama.com, 2026-10-20), published Terminal-Bench 2.1 scores and the cost of one question to the stronger model. Co-Authored-By: Claude Opus 5.5 <[email protected]>
Merged
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Why
The user wants to use Ollama's cloud models (tags ending in
cloud, e.g.minimax-m3.1-flash:cloud) with lcode, mainly as a cheap stronger model to ask when stuck. They asked for the setup in the docs, plus a list of cheap models that are strong at coding.Trying it showed four problems. lcode used a cloud model like any installed model, but:
Where: … on this machineandCost: free: it runs on this machine, while the brief actually goes to ollama.com and is billed per token.Ollama error 401: {"error":"Unauthorized"}.lcode doctorgave no warning. It showed a green ✓ with no sign that the model runs in the cloud or needs a sign-in.What changes
lcode/cloud.py:is_cloud(name)(the tag iscloudor ends with-cloud), the sign-in command (docker exec -it <container> ollama signinwhenupdate.find_containerfinds the Docker container serving that Ollama, elseollama signin), and the user-facing texts.…". This applies to both streaming and plain requests.ollama/<model>:cloudadvisor now counts as paid, so the cost comes fromescalate_price. Its label is "… (Ollama cloud)", and where it goes reads "ollama.com, through this machine's Ollama" (or through theescalate_urlhost).lcode doctor, session start and/modelnow say that what lcode sends goes to ollama.com and is billed per token. Doctor also gives the sign-in command.docs/models.md, new "Cloud models through Ollama" section):--context) or as the stronger one (escalate_model+escalate_price), and troubleshooting;usage.md(stronger model) andconfiguration.md(escalate_model).Checks
tests/test_cloud.py(5 tests):/modelnotice.minimax-m3.1-flash:cloudpulled but not signed in:/api/showreportscompletion, tools, thinking, visionand a 1,000,000-token context;lcode -pgives the sign-in hint, naming that container;lcode doctorprints the note;/modelsby number.🤖 Generated with Claude Code