IssueRaiser

Rate limit download speed on pulling new models

Is there interest in implementing a rate limiter in the `pull` command? I'm open to working on this, this is the syntax I have in mind for now: `ollama pull modelname --someflagname 1024` <-- this would limit to 1024 kbps I took a look at the code in server/download.go, and I think I can do this with the x/time/rate applied to the downloadChunk method of the blob downloader. This feature, or something like this that accomplishes this would be quite useful for me. Ollama is able to saturate my network faster than bit torrent or anything else I've tried.

Posted by donuts-are-good on Jan 15, 2024, 3:02 PM

Tags

Related issues

Raise real-world problems, find people facing the same issue, and discuss solutions.2,000 issues0 comments

github (Network)

Rate limit download speed on pulling new models

donuts-are-goodJan 15, 2024, 3:02 PM

Is there interest in implementing a rate limiter in the `pull` command? I'm open to working on this, this is the syntax I have in mind for now: `ollama pull modelname --someflagname 1024` <-- this would limit to 1024 kbps I took a look at the code in server/download.go, and I think I can do this with the x/time/rate applied to the downloadChunk method of the blob downloader. This feature, or something like this that accomplishes this would be quite useful for me. Ollama is able to saturate my network faster than bit torrent or anything else I've tried.

Comments (0)

No comments yet. Start the discussion.

Comment on this issue