About slowdowns...
About slowdowns... I have this theory that if they sneak some sleep(1) calls while processing medium to complex prompts they can serve more clients. But I think "context switching" between 2 different prompts might be too expensive for GPUs to be worth it for LLM providers. Who knows.
Posted by hu3 on Apr 25, 2026, 1:56 PM
Tags
Related issues
- Yeah, the plan is far too expensive for what it provides.
- Crashed demand after one of the big AI labs (probably Anthropic because they focus way too hard on expensive frontier models) become inso...
- /dev/random is much too expensive for this.
- Yeah, this always bugged me.
- A year ago, I had the opinion that it'd be too expensive for developers to support offline mode, peer to peer, or community servers after...
- The weird thing about this product is that its biggest competitor is "an old ipad." I feel like most of their target customer base alread...
Raise real-world problems, find people facing the same issue, and discuss solutions.2,000 issues0 comments
pricing (Other)
Yeah, the plan is far too expensive for what it provides.
NewCrashed demand after one of the big AI labs (probably Anthropic because they focus way too hard on expensive frontier models) become inso...
New/dev/random is much too expensive for this.
Yeah, this always bugged me.
A year ago, I had the opinion that it'd be too expensive for developers to support offline mode, peer to peer, or community servers after...
The weird thing about this product is that its biggest competitor is "an old ipad." I feel like most of their target customer base alread...
There's a talk from Travis Kalanick recently on a podcast about this.
>nobody ever bought German cars for their low prices, except the Beetle Huh?
About slowdowns...
About slowdowns... I have this theory that if they sneak some sleep(1) calls while processing medium to complex prompts they can serve more clients. But I think "context switching" between 2 different prompts might be too expensive for GPUs to be worth it for LLM providers. Who knows.
Comments (0)
No comments yet. Start the discussion.