All posts tagged

Learn how a private LLM gateway secures vLLM, SGLang, and Ollama with stable model aliases, traffic policy, routing, and observability.

Learn how an MCP Registry catalogs servers, differs from a marketplace and gateway, and supports governed MCP discovery and tool execution.

Learn how an AI Gateway governs Files, Batch, and Fine-tuning APIs with secure routing, credential isolation, job lifecycle control, and usage attribution.

Learn how a multimodal AI Gateway governs image, audio, video, and realtime APIs across identity, policy, provider routing, cost, and telemetry.

AISIX 1.0.0 adds semantic guardrail testing and decision scores, with clearer failure policies and controls for production AI traffic.

Learn how AI Gateway audit logging connects requests, policy outcomes, configuration changes, retention, and exports for AI governance and investigations.

Learn how AI Gateway PII redaction detects, masks, or blocks sensitive data in LLM requests and responses before it crosses a trust boundary.

Use AISIX AI Gateway guardrails safely with monitor and block modes, input and output hooks, scoped policies, streaming controls, and failure handling.

Rotate LLM provider credentials in AISIX Cloud or open-source AISIX while keeping caller API keys and model aliases stable, tested, and recoverable.

AISIX AI Gateway now serves the stateless MCP 2026-07-28 revision alongside every 2025 revision on one endpoint, with per-server protocol pinning and a one-call-one-execution guarantee.

Compare open source AI Gateway options and learn how to evaluate AI traffic control, security, cost governance, and enterprise readiness.

AISIX model ensembles fan one chat request to a panel of LLMs, then a judge synthesizes one answer — so several low-cost models can rival a frontier model.

Learn why API7 built AISIX from scratch as an AI-native gateway for LLM workloads, with unified model access, observability, and fine-grained traffic control.