AI Agents / Agent evaluation and observability
AI Agents: Trace redaction
Remove secrets and unnecessary personal data before trace export.
Environment and inputs: Framework-independent agent evaluation; OpenTelemetry illustrates trace correlation.
When to use it
Choose an observable task outcome before optimizing a model or prompt. Keep inputs and scoring rules stable enough to compare candidates, and inspect critical failures individually rather than hiding them inside an average quality score.
Check the result
Send synthetic secret markers through a test run and search the exported trace.
Save and compare results
Save the test input, configuration and result. Fix the failing boundary, repeat the same test and compare it with the saved working configuration.
Scope and limits
These exercises have not been tested on your systems. Check feature support and configuration names against the installed release and linked documentation.