Show HN: Gentrace – connect to your LLM app code and run/eval it from a UI
Hey HN - Doug from Gentrace here. We originally launched via Show HN in August of 2023 as evaluation and observability for generative AI: https://news.ycombinator.com/item?id=37238648 Since then, everyone from the model providers to LLM ops companies built a prompt playground. We had one too, until we realized this was totally the wrong approach: - It's not connected to your application code - They don't support all models - You have to rebuild evals for just this one prompt (can't use your end-to-end evals) In other words, it was a ton of work and time to use these to actually make your app better. So, we built a new experience and are relaunching around this idea: Gentrace is a collaborative LLM app testing and experimentation platform that brings together engineers, PMs, subject matter experts, and more to run and test your actual end-to-end app. To do th
Why it failed
Hey HN - Doug from Gentrace here. We originally launched via Show HN in August of 2023 as evaluation and observability for generative AI: https://news.ycombinator.com/item?id=37238648 Since then, everyone from the model providers to LLM ops companies built a prompt
- Kind
- startup
- Status
- Shut down
- Inventor
- dsaffy
- Ended
- 2024
- Source
- hackernews