Anomaly Detection
AgentVault continuously monitors agent behavior to detect irregular patterns and correlate them with operational outcomes. The system employs three algorithms and five correlation patterns.Detection Algorithms
Multi-Dimensional Drop Detection
Monitors each of the 12 trust dimensions for sudden drops:- A dimension’s score decreases by more than 2 standard deviations from its 30-day rolling mean
- The drop persists for more than 2 consecutive scoring windows
Velocity Tracking
Tracks the rate of change across dimensions to detect rapid degradation:- Computes first-derivative of scores over 24-hour intervals
- Flags when velocity exceeds 3x the historical norm
- Catches gradual-then-sudden failure patterns
Z-Score Analysis
Statistical outlier detection applied fleet-wide:- Each agent’s dimension scores are compared to the fleet distribution
- Z-scores above 2.5 (or below -2.5) trigger alerts
- Provides context: “This agent’s compliance score is 2.8 standard deviations below fleet average”
Signal Correlation
The system automatically maps relationships across five key patterns:
Correlations are computed hourly and surfaced when statistical significance exceeds p < 0.05. Each correlation includes strength, direction, lag, and confidence.
Alert Lifecycle
1
Detection
Algorithm flags an anomaly. Alert created with status
open.2
Notification
Owner receives a
policy_alert message and email notification. Alert appears in the Observe dashboard.3
Acknowledgment
Owner acknowledges the alert (status:
acknowledged). Recorded in the audit trail.4
Resolution
Issue resolved. Alert closed (status:
resolved) with notes attached.Alert Severity
Industry Benchmarks
Organizations can opt in to cross-tenant anonymized benchmarking:- Percentile comparison against the broader ecosystem
- Minimum 3 participating tenants required for anonymity
- Category-specific benchmarks (by agent type)
- Available at 30-day and 90-day windows
Benchmark data is fully anonymized. No tenant or agent identifiers are shared.
Compliance Reports
Generate comprehensive SOC 2-style compliance reports from the Observe dashboard:- Executive Summary — composite scores, tier status, fleet rank
- Dimension Breakdown — per-dimension analysis with trend charts
- Anomaly History — all alerts with resolution status
- Policy Compliance — violation counts, enforcement actions, SPT status
- Drift Analysis — PSI trends, baseline comparisons
- Fleet Comparison — percentile ranks across all dimensions
- Recommendations — system-generated improvement suggestions