llm-cost
4 articles tagged “llm-cost”.
llm-costengineeringobservabilityunder-the-hood
LLM Cost Reduction: How We Cut Our Inference Cost per Session by 6x
We build cost attribution for AI agent teams, then turned it on ourselves. How we cut LLM cost per session roughly 6x in five weeks, and what wasn't efficiency.
Dennis Zagiansky7 min read
under-the-hoodllm-costengineering
We stopped paying an LLM to answer yes/no questions: 21x cheaper with Jev
We moved session classification off a generative LLM and onto Jev. Cost went from $89 an hour to $4. Here's where the money was going and where we're cutting next.
Aviv Tabak5 min read
productengineeringtoolsragagent-reliabilityllm-cost
RAG Retrieval Optimization: The #1 Mistake AI Builders Make
Upgrading your LLM to fix hallucinations is a costly trap. Learn how RAG retrieval optimization and key evaluation metrics solve the real bottleneck.
Itamar Kramer8 min read
engineeringproductevalsllm-cost
LLM-as-a-Judge Cost: Surviving the Production Compute Tax
Scaling AI agents? LLM-as-a-judge costs can destroy your unit economics. Learn 4 strategies to optimize token usage and reduce LLM evaluation cloud spend.
Dennis Zagiansky10 min read