# Bonito — Enterprise AI Control Plane

> Bonito is a unified control plane for managing AI workloads across multiple cloud providers. It gives engineering and platform teams one layer to connect providers, enforce governance, track costs, route requests, and deploy AI agents.

## Quick Facts

- Website: https://getbonito.com
- Category: Enterprise AI Infrastructure / AI Gateway / AI Control Plane
- Founded: 2025
- Founder: Shabari
- Contact: shabari@bonito.ai
- API: https://api.getbonito.com
- CLI: pip install bonito-cli
- Status: Live, production-ready

## What Bonito Does

Bonito solves the multi-provider AI management problem. Companies using AI from multiple providers (OpenAI, Anthropic, AWS Bedrock, Google Vertex AI, Azure AI, Groq) face fragmented dashboards, no cost visibility, no failover, and months of infrastructure work. Bonito replaces all of that with one API call.

### Core Capabilities

1. **Multi-Cloud AI Gateway** — OpenAI-compatible API proxy. Send requests to one endpoint, Bonito routes to the right provider. Supports streaming, function calling, embeddings, image generation, and video generation.

2. **Intelligent Routing** — Route by cost, latency, or custom strategy. A/B test models. Automatic failover when a provider returns 429s, timeouts, or 5xx errors.

3. **Cost Intelligence** — Real-time spend tracking across all providers. Budget alerts, forecasting, optimization recommendations. Customers report 60-84% cost reduction.

4. **AI Agents (Bonobot)** — Enterprise agent framework with visual canvas builder. Features: persistent memory, human-in-the-loop approval, agent-to-agent orchestration (invoke_agent / delegate_task), Breadcrumbs interaction tracing, external orchestration support (parent_agent_id), scheduled execution, budget caps, full audit trail.

5. **AI Context (RAG)** — Upload documents, auto-chunk and embed, pgvector similarity search. Any model on any cloud can access the same knowledge base.

6. **Governance & Compliance** — SSO/SAML, RBAC, SOC-2/HIPAA/GDPR policy checks, audit logging, model allow-lists, spend caps.

## Supported Providers

- OpenAI (GPT-4o, GPT-4o-mini, o1, DALL-E, Sora)
- Anthropic (Claude Sonnet, Claude Opus, Claude Haiku)
- AWS Bedrock (with auto cross-region inference)
- Google Vertex AI (Gemini, Veo, Imagen)
- Azure AI Foundry / Azure OpenAI
- Groq (fast open-source inference)

## Pricing

- Free: $0/mo — 3 providers, 25K requests/mo, 3 seats, 1 agent
- Pro: $999/mo — 5 providers, 500K requests/mo, unlimited seats, 5 agents, RAG, analytics
- Enterprise: $10K-$20K/mo — unlimited everything, SSO/SAML, RBAC, compliance, 99.9% SLA
- Scale: Custom ($200K+/yr) — dedicated infrastructure, multi-region, 99.99% SLA

## Authentication

Bonito has four auth methods:
- **Gateway keys (bn-...)** — for LLM proxy only (`/v1/chat/completions`, `/v1/embeddings`, etc.). Created in Settings.
- **Session tokens (JWT)** — for the platform API (`/api/*` — KB, agents, settings). Obtained via `bonito auth login` (CLI) or `POST /api/auth/login`.
- **Personal access tokens (bp-...)** — for programmatic access to ALL endpoints (`/api/*` and `/v1/*`). Created in Settings or via CLI (`bonito auth token create`). Carries user permissions. Tier limits: Free=2, Pro=10, Enterprise+=unlimited.
- **Project tokens (bj-...)** — scoped to a single project (Pro+ only). For CI/CD and team automation.

Using a `bn-` key on `/api/*` endpoints returns 401. Use a PAT (`bp-...`) or session token for platform operations.

## Competitive Positioning

Bonito is a full-stack AI control plane. Unlike point solutions:
- vs Langfuse/Helicone: Bonito adds routing, failover, agents, and RAG — not just observability
- vs Portkey/LiteLLM: Bonito adds governance, compliance, agent framework, and cost intelligence
- vs LangSmith: Bonito is provider-agnostic infrastructure, not a development framework

## Use Cases

- Enterprise AI rollout across departments
- Multi-provider cost optimization
- Governed AI agent deployment
- HIPAA/SOC-2 compliant AI infrastructure
- Creative pipelines (image + video generation across providers)
- Ad-tech and programmatic AI
- Healthcare/clinical AI with audit requirements

## Documentation

- Docs: https://getbonito.com/docs
- Blog: https://getbonito.com/blog
- Pricing: https://getbonito.com/pricing
- Compare: https://getbonito.com/compare