Total Requests
1,247
↑ 12.5% from yesterday
Avg Latency
1.2s
↓ 8.3% faster
Error Rate
0.8%
↓ 0.3% from yesterday
Daily Cost
$42.50
↑ 5.2% from yesterday
Tokens Today
847K
↑ 15.1% from yesterday
Active Alerts
3
1 Critical, 2 Medium
Request Volume (24h)
Latency Distribution
Token Usage by Model
Cost Breakdown
LLM Observability Integrations
🔷 LangSmith
Connected
LangSmith provides end-to-end tracing for LLM applications. Track latency, cost, and quality metrics.
Enable Tracing
🟢 Arize AI
Connected
Arize provides ML model monitoring and observability. Track performance drift and data quality.
Enable Monitoring
📊 WhyLabs
Connected
WhyLabs provides log analysis and continuous monitoring. Detect anomalies and ensure data quality.
Enable Logging
Integration Health Status
| Integration | Status | Traces / Logs Sent | Latency | Last Sync |
|---|---|---|---|---|
| LangSmith | ● Healthy | 12,847 traces | 45ms | Just now |
| Arize | ● Healthy | 847 predictions | 32ms | 1 min ago |
| WhyLabs | ● Healthy | 45.2K logs | 18ms | Just now |
Token Usage & Cost Tracking
Total Tokens (Today)
847,234
Prompt Tokens
523,891
61.8% of total
Completion Tokens
323,343
38.2% of total
Estimated Cost (Today)
$42.50
$0.05 per 1K tokens avg
Token Usage Trend (7 Days)
Cost by Model
Model Pricing Configuration
| Model | Prompt ($/1K) | Completion ($/1K) | Usage | Cost |
|---|---|---|---|---|
| GPT-4 | $0.03 | $0.06 | 523,000 | $28.45 |
| GPT-4 Turbo | $0.01 | $0.03 | 187,000 | $8.32 |
| GPT-3.5 Turbo | $0.001 | $0.002 | 137,234 | $5.73 |
Cost Calculator Demo
Click Calculate to see cost estimate...
Alert Management
Total Alerts
47
Active
3
Acknowledged
5
Resolved
39
Active Alerts
High P99 Latency
High Daily Cost
Slow Response Time
Alert Rules
| Rule Name | Metric | Threshold | Severity | Status | Actions |
|---|---|---|---|---|---|
| High P99 Latency | latency_p99 | > 5000ms | CRITICAL | ||
| High Error Rate | error_rate | > 5% | CRITICAL | ||
| High Daily Token Usage | token_usage_daily | > 1M tokens | MEDIUM | ||
| High Daily Cost | cost_daily | > $100 | HIGH | ||
| Slow Response Time | avg_response_time | > 3000ms | MEDIUM |
Trace Explorer
Filter Traces
| Trace ID | Operation | Duration | Tokens | Cost | Status | Time |
|---|---|---|---|---|---|---|
a1b2c3d4e5f6 |
chat | 1.2s | 2,341 | $0.12 | ● Success | Just now |
b2c3d4e5f6a1 |
memory_retrieval | 245ms | 512 | $0.02 | ● Success | 1 min ago |
c3d4e5f6a1b2 |
tool_execution | 890ms | 1,234 | $0.05 | ● Success | 2 min ago |
d4e5f6a1b2c3 |
rag | 1.8s | 3,456 | $0.18 | ● Success | 3 min ago |
e5f6a1b2c3d4 |
chat | 2.1s | 4,123 | $0.22 | ● Error | 5 min ago |
Start Trace Demo
Click "Start Trace" to begin a new trace session...