Play 52
AI API Gateway v2
Intelligent API gateway with semantic caching and smart model routing.
Next-generation AI API gateway with semantic caching via Azure Redis, intelligent model routing between GPT-4o and GPT-4o-mini based on query complexity, and token budget enforcement per tenant. Features rate limiting, real-time usage analytics, and cost attribution dashboards. Built on Azure API Management with custom policies for AI-specific traffic patterns.
Architecture Pattern
Gateway pattern: semantic cache layer, model router, token budget enforcement
Azure Services
DevKit (.github Agentic OS)
- agent.md — root orchestrator with builder→reviewer→tuner handoffs
- 3 agents — Gateway Builder (gpt-4o), Reviewer (gpt-4o-mini), Tuner (gpt-4o-mini)
- 3 skills — deploy (232 lines), evaluate (130 lines), tune (211 lines)
- 4 prompts — /deploy, /test, /review, /evaluate with agent routing
- .vscode/mcp.json — FrootAI MCP with APIM + OpenAI key inputs + envFile
TuneKit (AI Config)
- config/openai.json — model routing thresholds, fallback config
- config/guardrails.json — rate limits, token budgets per tenant
- evaluation/eval.py — Cache hit >60%, Latency p95 <200ms
Tuning Parameters
Machine evidence
FrootAI evidence lifecycle
This is an internal evidence maturity label, not third-party certification, accreditation, legal compliance, or a production guarantee. Missing or expired evidence demotes automatically; catalog claims cannot promote a play.
This play currently has design evidence only. A runnable scenario, endpoint evaluation, and build receipts are the next contiguous gates.
Repo Intelligence
v1A no-clone, revision-pinned map for agents and humans. Observed evidence is separated from inferred flow so the output stays useful without pretending to be a full call graph.