The self-hosted AI Gateway from the creators of Kubernetes

Stacklok's AI Gateway

Stacklok’s AI Gateway delivers what enterprises demand:

  • No more AI spend ‘black box’. Set and enforce AI cost controls by individual, agent, project or team, so you have a forecastable AI line item
  • Identity-based access. Tie every AI request to a real person or named agent through the organization’s identity provider
  • Pass your security review. Establish one place to rotate keys, one place to audit calls, and one surface to secure

Finance teams

  • Connect spend to productivity and define ROI
  • Attribute spend to a person, team, model, project, etc. 
  • Align reporting windows to your calendar and ledger

Security teams

  • Detect and block sensitive data exfiltration
  • Tie every AI request to a federated identity
  • Forward a complete audit stream to any SIEM

Platform teams

  • Integrate with your existing IdP
  • Monitor using OpenTelemetry and your current observability stack
  • Allow teams to experiment inside your policy guardrails

Frequently asked questions

There are two primary differences: (1) Stacklok’s AI Gateway is self-hosted. If you want (or need) to stay in full control of your data, this is the defining criteria, but also (2) Stacklok’s AI Gateway offers finer grained cost controls. Specifically, you can map controls to the structure of your existing IdP, so you can set budgets and monitor by individual, agent, project, team and more.

No. Stacklok’s AI Gateway works for any AI client that makes LLM API calls: coding assistants, drafting tools, internal chatbots, custom copilots, RAG applications, and more.

Yes, and agents often matter most: they run unattended and their spend is the hardest to track. They authenticate through the same identity system and are subject to the same budgets, data protections, and audit.

If the tool can be configured to send requests through a custom endpoint, and most enterprise-tier AI tools can, it routes through Stacklok AI Gateway. Consumer-only SaaS that sends traffic exclusively to the vendor is outside any gateway’s scope.

By removing them from the critical path for every new AI initiative. Today’s reality is that every new AI project requires a new security review, a new budget conversation, and a new integration, and the platform team is in the middle of all three. Stacklok AI Gateway centralizes the controls so new teams, tools, and agents inherit them automatically. The platform team shifts from being the bottleneck to being the reason AI scales across the business.

We’ve worked with a number of platform teams that started with an open source solution, but moved to Stacklok’s AI Gateway when they realized the amount of integration work, identity, policy, data protection, audit and more the team had to build and maintain.