AI gateways
Bonito vs TrueFoundry AI Gateway + Agent Gateway + TrueForge
Gateway plus agent harness vs. gateway plus managed agents
Launched Agent Gateway (June 2026) and the MIT-licensed TrueForge agent harness (August 2026)
TrueFoundry is an enterprise AI gateway (LLM, MCP and agent traffic) that runs in your VPC, on-prem or air-gapped, and now ships TrueForge, an open-source agent harness with approval checkpoints and sessions. It is the closest product to Bonito. The differences are in how agents are built and run: Bonito adds a visual canvas and chat builder, schedules, integrations, managed knowledge bases and data residency pinning, all from one bonito.yaml.
TrueFoundry pricing
Developer free (3 users); Pro $25 per user per month; Enterprise custom (SSO, audit logs, VPC and on-prem). Agent Gateway and harness: custom.
Model costs
No markup. Model providers bill you directly on your own accounts.
What TrueFoundry does well
- Routing by cost, latency and geography with fallback chains over 250+ models, including self-hosted ones
- Deploys in your VPC, on-prem or air-gapped
- Agent Gateway with an agent registry, per-agent budgets and end-to-end traces across model and tool calls
- TrueForge (MIT): subagents, human approval checkpoints and persistent sessions
- GitOps with tfy apply on YAML specs, plus semantic caching scoped per user
Where Bonito goes further
- A visual agent canvas and a chat builder (Origami); no visual builder was found in TrueFoundry's docs
- Cron schedules with timezone and delivery to webhook, email or Slack
- Managed knowledge bases with upload, embedding, search and a BYO bucket; TrueFoundry's Cognita is a RAG framework you deploy
- Data residency pinning to CA, US or EU as one org setting that also constrains failover
- Native integrations (Slack, Stripe, Google Workspace, HubSpot, Notion, Twilio) bound to agents as tools, including two-way Slack chat
Where TrueFoundry is ahead of Bonito
- Self-hosting, including air-gapped installs, and an MIT-licensed harness
- Semantic caching; Bonito has none
- Self-hosted model serving alongside the gateway
Capability by capability
| Capability | Bonito | TrueFoundry |
|---|---|---|
| Agents | ||
| Build and run agents | Yes | Yescode-first TrueForge harness; no visual builder found |
| Approval queue and scheduled runs | Yes | Partialapproval checkpoints in TrueForge; no cron schedules found |
| Dollar budgets per agent | Yes | Yes |
| MCP support | Yes | Yes |
| Routing | ||
| OpenAI-compatible gateway | Yes | Yes |
| Automatic failover across providers | Yes | Yes |
| Cheaper models for simple work (cost routing) | Yes | Yes |
| Bedrock, Vertex, Azure and direct providers in one place | Yes | Partial250+ models; which clouds is not itemized in their docs |
| Semantic caching | No | Yes |
| Governance | ||
| SSO, RBAC and audit log | Yes | Yes |
| Data residency pinning | Yes | Yesgeo-aware routing plus VPC or on-prem |
| Observability and knowledge | ||
| Agent traces with cost per request and agent | Yes | Yes |
| Knowledge bases (RAG) | Yes | PartialCognita, an open-source RAG framework you deploy |
| How you run it | ||
| Whole stack from one config file | Yes | Yestfy apply on YAML specs |
| Self-hosted or open source | Partial | Yesgateway self-hosts on Enterprise; TrueForge is MIT |
| No markup on inference | Yes | Yes |
Checked against TrueFoundry's own documentation on 2026-09-27. Products change quickly; if something here is out of date, tell us at hello@trybonito.com and we will fix it.
Sources
See Bonito on your own stack
Start free, or get a report on where agents fit in your company first.