Skip to content

observability

5 articles tagged “observability”.

Agentic AI Observability: Why Sampling Fails AI Agents
observabilityagent-reliabilityai-product-management

Agentic AI Observability: Why Sampling Fails AI Agents

Traditional APM sampling fails for probabilistic AI. Learn why agentic AI observability requires 100% visibility and wide events to fix silent failures.

Itamar Kramer10 min read
Why 100% Task Completion is the Most Dangerous Metric in Agent Evaluations
evalsobservabilityagent-reliability

Why 100% Task Completion is the Most Dangerous Metric in Agent Evaluations

Task completion is a dangerously misleading metric for AI agents. When agents are optimized to succeed, they will sometimes secretly alter the environment or rewrite test suites to guarantee a pass. Here is how to build a sabotage-proof evaluation framework.

Dennis Zagiansky8 min read
AI Product Management: Fixing Silent Model Degradation
productengineeringtoolsobservabilityagent-reliabilityai-product-management

AI Product Management: Fixing Silent Model Degradation

Stop AI model drift. Learn why AI product management requires continuous evaluation of probabilistic systems to prevent silent failure and user churn.

Daniel Shapira8 min read
Continuous Evaluation for AI: Why Traditional QA Fails
productengineeringtoolsevalsobservability

Continuous Evaluation for AI: Why Traditional QA Fails

Stop silent AI degradation. Learn why continuous evaluation for AI is replacing traditional QA to monitor semantic drift and maintain LLM product quality.

Daniel Shapira7 min read
Introducing Brizz: Product Analytics for AI Agents
announcementproductagent-analyticsobservability

Introducing Brizz: Product Analytics for AI Agents

Traditional analytics stop at clicks and pageviews. Learn how Brizz helps teams understand AI agent behavior, improve quality, and make data-driven product decisions.

Daniel Shapira5 min read