add /metrics endpoint
It would be nice of ollama had a /metrics endpoint for collecting metrics for prometheus or other monitoring tools. https://prometheus.io/docs/guides/go-application/ Some metrics to include might be, GPU utilization, memory utilization, CPU utilzation, layers used, request counts, etc.
Posted by codearranger on Mar 14, 2024, 4:39 PM
Tags
Related issues
- struct's lifetime requirements can be bypassed via covariant field assignment
- Proposal to Reorganize the Moderation Team and Review Moderation Policies
- Progressive FPS degradation appears to be related to dota2.com — blocking the domain prevents the performance loss
- proposal: container/...: generic collection types
- Better Custom Endpoint BYOK
- A concrete policy for backward compatibility until Godot 5.0
Raise real-world problems, find people facing the same issue, and discuss solutions.2,000 issues0 comments
github (Other)
struct's lifetime requirements can be bypassed via covariant field assignment
Proposal to Reorganize the Moderation Team and Review Moderation Policies
Progressive FPS degradation appears to be related to dota2.com — blocking the domain prevents the performance loss
proposal: container/...: generic collection types
Better Custom Endpoint BYOK
A concrete policy for backward compatibility until Godot 5.0
New MTP models not supported
Tracking: 429 / Capacity Issues
add /metrics endpoint
It would be nice of ollama had a /metrics endpoint for collecting metrics for prometheus or other monitoring tools. https://prometheus.io/docs/guides/go-application/ Some metrics to include might be, GPU utilization, memory utilization, CPU utilzation, layers used, request counts, etc.
Comments (0)
No comments yet. Start the discussion.