New

Announcing AISIX: The AI-Native AI Gateway for LLMs and AI AgentsLearn More

Learn More

All posts tagged

"Observability"

Bot Traffic Moves: Build API Defenses That Follow Behavior

Technology

October 20, 2026

Bot Traffic Moves: Build API Defenses That Follow Behavior

Learn why IP- and ASN-only bot controls break when automation changes providers, and build layered API gateway defenses around identity, behavior, and cost.

HTTP Connection Reuse: The Hidden API Latency Multiplier

Technology

October 20, 2026

HTTP Connection Reuse: The Hidden API Latency Multiplier

Use Go 1.27's HTTP/1 change to diagnose connection reuse across clients, API gateways, and origins without hiding protocol or pool boundaries.

LLM Monitoring with Prometheus: SLOs for AI Traffic

Technology

October 13, 2026

LLM Monitoring with Prometheus: SLOs for AI Traffic

Build LLM monitoring with Prometheus using terminal request outcomes, streaming latency, TTFT, fallback, and policy signals from AISIX 1.6.0.

AISIX 1.6.0: Make Streaming SLOs Reflect the Outcome

Products

October 12, 2026

AISIX 1.6.0: Make Streaming SLOs Reflect the Outcome

AISIX 1.6.0 records supported streamed requests when they end, so request metrics and duration histograms reflect terminal outcomes instead of response start.

API7 Gateway 3.10.8: Make Rate Limits Explain Their Decisions

Products

October 12, 2026

API7 Gateway 3.10.8: Make Rate Limits Explain Their Decisions

API7 Gateway 3.10.8 makes distributed and AI rate-limit decisions easier to account for, diagnose, and upgrade safely.

AI Gateway Observability: Metrics, Logs, Traces, Tokens, Cost, and Agent Traffic

AI Gateway Guide

September 28, 2026

AI Gateway Observability: Metrics, Logs, Traces, Tokens, Cost, and Agent Traffic

Observe AI gateway traffic across models, providers, tokens, streaming latency, cost, retries, agents, and MCP tools while protecting sensitive data.

API Gateway Log Analytics: Correlation, Queries, and Operational Signals

API Gateway Guide

September 18, 2026

API Gateway Log Analytics: Correlation, Queries, and Operational Signals

Turn API gateway logs into useful operational signals with a deliberate event model, trustworthy correlation, bounded delivery, and actionable queries.

API7 Gateway 3.10.7: Turn Upgrade Uncertainty Into Evidence

Products

September 15, 2026

API7 Gateway 3.10.7: Turn Upgrade Uncertainty Into Evidence

API7 Gateway 3.10.7 rejects indistinguishable duplicate routes, groups compatibility issues, and adds diagnostics for safer upgrades.

Native Histograms for API Gateway SLOs: A Safe Migration Guide

Technology

September 15, 2026

Native Histograms for API Gateway SLOs: A Safe Migration Guide

Learn how Prometheus native histograms improve API latency visibility and how to migrate gateway dashboards, alerts, and SLOs safely.

Speculative Decoding Changes AI Gateway Capacity Planning

Technology

September 8, 2026

Speculative Decoding Changes AI Gateway Capacity Planning

Learn how speculative decoding changes LLM throughput, latency, GPU memory, routing, and the metrics an AI Gateway should expose.

AI Gateway Audit Logging: Build Evidence for AI Governance and Compliance

Technology

September 1, 2026

AI Gateway Audit Logging: Build Evidence for AI Governance and Compliance

Learn how AI Gateway audit logging connects requests, policy outcomes, configuration changes, retention, and exports for AI governance and investigations.

LLM Routing Is Not a Pricing Spreadsheet: How to Govern Cost, Cache, and Latency

Technology

August 4, 2026

LLM Routing Is Not a Pricing Spreadsheet: How to Govern Cost, Cache, and Latency

Recent routing and cost signals show why AI platforms need gateway-side visibility into effective cost, caching, latency, and policy instead of relying on model sticker prices alone.

API7 Gateway Debug Sessions: Per-Request Tracing That Starts When the Alert Fires

Technology

July 26, 2026

API7 Gateway Debug Sessions: Per-Request Tracing That Starts When the Alert Fires

Debug sessions in API7 Gateway capture the full execution timeline of individual requests — every phase, every plugin in execution order, and the request's own log lines. An alert policy can start the capture itself, so the traffic that triggered the alert is the traffic you get to inspect.

AISIX Observability: Metrics, Logs, Headers, and Usage Events

Technology

July 7, 2026

AISIX Observability: Metrics, Logs, Headers, and Usage Events

Configure AISIX metrics, access logs, response headers, and usage events to investigate AI requests, tokens, latency, routing, and cost.

Gaining API Observability and Economics with API7 Enterprise

Technology

April 14, 2026

Gaining API Observability and Economics with API7 Enterprise

Discover how API7 Enterprise provides comprehensive API observability to overcome software economics blind spots.

Simplified Log Collection with APISIX's http-logger Plugin

Technology

April 11, 2024

Simplified Log Collection with APISIX's http-logger Plugin

Learn how to enhance development efficiency with real-time API call log monitoring using the APISIX http-logger plugin.

Unlocking the Power of API Gateway Logs

Technology

March 21, 2024

Unlocking the Power of API Gateway Logs

Discover the significance of logging in API gateway management. Learn how logging aids in monitoring, troubleshooting, performance optimization, and security.

Enhancing API Observability Series (Part 3): Tracing

Technology

March 19, 2024

Enhancing API Observability Series (Part 3): Tracing

Understand distributed tracing technology, optimize microservices architecture, tackle performance bottlenecks, and enhance system stability and observability.

Enhancing API Observability Series (Part 2): Log Analysis

Technology

March 15, 2024

Enhancing API Observability Series (Part 2): Log Analysis

Learn how to improve the observability of APIs through log analysis to quickly locate problems and optimize system performance.

Enhancing API Observability Series (Part 1): Metrics Monitoring

Technology

March 5, 2024

Enhancing API Observability Series (Part 1): Metrics Monitoring

Learn how to leverage metrics monitoring to optimize API performance, ensuring stable operations and swift detection of potential issues.

Configuring Alerts: Key Measures to Elevate API Stability

Technology

January 6, 2024

Configuring Alerts: Key Measures to Elevate API Stability

Discover how to enhance API stability through optimizing alert configuration, ensuring smooth business operations.

Transforming Log Plugins to Enhance Observability

Technology

February 24, 2023

Transforming Log Plugins to Enhance Observability

APISIX provides many log plugins to enhance the observability and system stability of API gateway.