EdgeGuardAI GATEWAY

Acme AI Robotics Labs

org_demo_edgeguard

Production AI Gateway cluster routed through Cloudflare edge network with Workers KV and D1.

Current Spend
$42.68

Incurred across active models

Monthly Cap: $250.0017%
KV Cache Savings
42%
Free Hits

$38.45 saved via zero-cost cache

Avg Gateway Latency
382 ms
Sub-5ms Cache

Origin: 850ms | Edge Cache: 3ms

Total API Calls
15K
Streaming Enabled

12M tokens saved from upstream

Gateway Volume & Cost Observability

Track actual provider spend vs cost eliminated through EdgeGuard KV caching

Upstream API Spend
Saved via Edge KV Cache

Edge Cache Efficiency

Sub-5ms

Cloudflare Workers KV prompt-hash table lookup rate across worldwide points of presence.

42%HIT RATE
Cache Latency:~3 ms
Upstream Origin Latency:~850 ms
Latency Reduction:99.6% Faster

Recent Telemetry Stream

Real-time Telemetry Logs

Asynchronous Cloudflare D1 query events captured via ctx.waitUntil()

StatusCache StatusModelLatencyTokens (P / C)Cost (USD)Time
200
HITgpt-4o4 ms2100 / 750$0.00 (Free)2 minutes ago
200
MISSgpt-4o1020 ms2100 / 750$0.0127510 minutes ago
200
MISSgpt-4o-mini340 ms950 / 300$0.0003225 minutes ago
200
HITgpt-4o3 ms1800 / 800$0.00 (Free)45 minutes ago
200
MISSgpt-4o940 ms1800 / 800$0.012501 hour ago
200
MISSdeepseek-chat720 ms1500 / 600$0.000372 hours ago
200
HITclaude-3-5-sonnet-202410224 ms2800 / 1200$0.00 (Free)3 hours ago