Questions, answered
Do you charge for tokens or LLM usage?+
No. You bring your own provider keys and pay your LLM bill directly to OpenAI, Anthropic, and others. AISIX Cloud only charges the plan subscription — there is no markup on your tokens.
How is AISIX different from an LLM API relay or token reseller?+
AISIX is a gateway you run in your own environment, not a reseller of model access. You bring provider keys and pay providers directly. The open-source gateway provides routing and traffic policies; AISIX Cloud adds a separately hosted control plane for management, usage reporting, and budgets. Requests to external model providers and configured telemetry destinations still leave your environment, so review each data path against your requirements.
What counts toward my monthly request quota?+
Recorded requests — any call routed and logged through the gateway, including error responses. One streaming response counts as a single request.
What happens when I hit the limit?+
On Developer, your traffic keeps flowing past 100K — those extra requests simply aren't recorded, so they don't show up in your logs or analytics, and nothing is ever blocked. On Team, we automatically add $100 per additional 1M requests — traffic is never interrupted. Sustained usage over 5M/mo is a good point to move to Enterprise.
Can I self-host AISIX instead of using the cloud?+
Yes. Run the Apache-2.0 AISIX gateway in your own environment without a control plane. AISIX Cloud adds centralized management, usage reporting, and budgets. You still operate the gateway; the AISIX Cloud control plane can be hosted by your team or API7.
Which LLM providers are supported?+
More than 100 providers through one OpenAI-compatible API, including 20+ popular integrations (OpenAI, Anthropic, Gemini, DeepSeek, Groq, Mistral, Cohere, Qwen, Together, Fireworks, and more). Cloud-hosted providers — AWS Bedrock, Azure OpenAI, and GCP Vertex AI — are available on Enterprise.
How do SSO, audit logs, and compliance work?+
Organization management, SSO (SAML / OIDC), audit logs, and SOC 2 Type II / ISO 27001 / GDPR / HIPAA are part of Enterprise. Talk to sales to scope your requirements and deployment model.
Where is my data stored, and how are provider keys protected?+
With standalone AISIX, you manage the gateway and provider keys in your environment. AISIX Cloud encrypts managed provider keys at rest, while its control-plane data resides with your chosen host. Requests to external model providers and configured logs or telemetry follow their respective destinations; running the gateway yourself does not keep every data path local.
Does the gateway add latency?+
AISIX is a Rust gateway. A published no-policy, mock-upstream test reported about 28,300 requests per second on 4 vCPUs, with sub-millisecond p50 proxy overhead under the stated conditions. Measure your own traffic with the providers and policies you intend to use.