LLM observability + app/infra monitoring platforms?
95% matchcurrai.app
You ShippedNow Time to Market
r/OpenTelemetryu/Common_Departure_6594 months agoPosts
Im looking for a LLM observability platform to monitor my LLM app. It will eventually go into production. Ive decided to use OTel so I'm just wondering what are some popular LLM observabiltiy platform
production llm observability
r/AIQualityu/_coder23t810 months agoPosts
Which platforms can serve as alternatives to Langfuse?
95% match
LangSmith: Purpose-built for LangChain users. It shines with visual trace inspection, prompt comparison tools, and robust capabilities for debugging and evaluating agent workflows—perfect for ra
langfuse alternative
r/SaaSu/heymitul24 days agoPosts
How are you tracking LLM API costs per feature in production?
90% matchBuilding a SaaS product and started adding AI features.
First month I had no idea where my OpenAI bill was coming from, turned out one summarization feature was eating 60% of the budget and I only fo
track llm costs
r/microsaasu/heymitul24 days agoPosts
How are you tracking LLM API costs per feature in production?
90% matchBuilding a SaaS product and started adding AI features.
First month I had no idea where my OpenAI bill was coming from, turned out one summarization feature was eating 60% of the budget and I only fo
track llm costs
r/LLMDevsu/Main-Fisherman-20753 months agoPosts
Helicone was acquired by Mintlify, what are the best alternatives now?
90% matchHelicone just got acquired by Mintlify and the project is reportedly moving into maintenance mode, which means security updates will continue but active feature development is likely done.
For teams
hosted langfuse
r/LLMDevsu/Sissoka4 months agoPosts
agent observability – what tools work?
90% matchhey everyone, been lurking but finally posting cause i'm hitting a wall with our ai projects. like, last thursday i was up till 2 am debugging why our chatbot started hallucinating responses – had to
llm observability tool
r/nextjsu/ExistingCard9621a year agoPosts
Traceability without Langsmith - OS or decently priced alternative?
90% matchHey there!
I am looking for a traceability for my AI apps. I am surprised that, with so many (too many) boilerplates out there, none to them seems to care about traceability (or at least they don't t
braintrust alternative
r/LangChainu/Future_AGI2 months agoPosts
LangChain made it much easier to build agent workflows, but what should teams use for tracing, evaluation, guardrails, and testing once those workflows are live?
88% matchA lot of teams have already made the first important choice.
They picked LangChain as the orchestration layer.
That usually makes sense. It gives you a flexible way to connect models, retrievers, to
hosted langfuse
r/LLMDevsu/smallroundcirclea year agoPosts
Why the heck is LLM observation and management tools so expensive?
88% matchI've wanted to have some tools to track my version history of my prompts, run some testing against prompts, and have an observation tracking for my system. Why the hell is everything so expensive?
I'
llm observability tool
r/LangChainu/Previous_Net_11546 days agoPosts
How are you tracking per-session costs for production LLM agents?
85% matchGenuinely curious how people handle this.
We run multiple LangChain agents for different
clients. Getting the total monthly bill from
OpenAI is easy. But breaking it down by:
which agent, wh
clients. Getting the total monthly bill from
OpenAI is easy. But breaking it down by:
which agent, wh
llm session tracking
Subscribe to unlock
