IssueRaiser

The biggest problem with this is that I can't run my company's own internal benchmarks against this API, because they will be trained int...

The biggest problem with this is that I can't run my company's own internal benchmarks against this API, because they will be trained into the next version of the model, making them worthless.

Posted by aftbit on Oct 17, 2026, 4:17 PM

Tags

Related issues

Raise real-world problems, find people facing the same issue, and discuss solutions.2,000 issues0 comments

hackernews (Other)

The biggest problem with this is that I can't run my company's own internal benchmarks against this API, because they will be trained int...

aftbitOct 17, 2026, 4:17 PM

The biggest problem with this is that I can't run my company's own internal benchmarks against this API, because they will be trained into the next version of the model, making them worthless.

Comments (0)

No comments yet. Start the discussion.

Comment on this issue