--- title: "API7 API Gateway Performance Benchmark: P99 = 2.3 ms & 160k QPS - API7.ai" description: "Discover the detailed performance testing benchmarks of API7 Enterprise and experience high-performance API management services." url: "https://api7.ai/blog/api7-enterprise-performance-testing-benchmarks" --- [Blog](https://api7.ai/blog) [Products](https://api7.ai/category/products)[Technology](https://api7.ai/category/technology)[Ecosystem](https://api7.ai/category/ecosystem)[Case Study](https://api7.ai/category/usercase)[Team & Community](https://api7.ai/category/community) Search ⌘ + K [Blog](https://api7.ai/blog) Products # API7 API Gateway Performance Benchmark: P99 = 2.3 ms & 160k QPS [![Yilia Lin](https://github.com/Yilialinn.png)](https://github.com/Yilialinn) [Yilia Lin](https://github.com/Yilialinn) June 7, 2024 [Products](https://api7.ai/category/products) [API7 Enterprise](https://api7.ai/enterprise) is a full API lifecycle management solution based on Apache APISIX. It seamlessly integrates with DevOps and CI/CD workflows, providing excellent product performance and security, while supporting enterprise-level deployment requirements across regions. We provide detailed performance benchmark tests and performance testing suites to help users conduct performance evaluations and obtain specific, reliable, and feasible data metrics. Additionally, we offer standardized testing procedures, methods, and performance optimization techniques to ensure that users can achieve consistent test results by taking our configurations and scenarios references. We conducted targeted tests on key features such as single routing, multiple routing, authentication, and rate limiting. The test results demonstrate that API7 Enterprise performs exceptionally well in critical metrics such as concurrent requests and response latency, easily handling high-concurrency access and safeguarding enterprise-level API management. ## Performance Testing Benchmarks The tests were conducted in an AWS Kubernetes environment and comprehensively evaluated the performance of API7 Gateway in several typical scenarios, including that with no plugins enabled, with only rate limiting or authentication plugins enabled, and with multiple plugins enabled simultaneously. To accurately evaluate the performance metrics of API7 Gateway, we first conducted baseline tests and collected the results. In the baseline tests, we deployed API7 Gateway with 1 `worker_process`, NGINX upstream, and the load testing tool wrk on the same machine, using the host network mode for communication. Detailed results can be found in [*How to Establish Performance Benchmarks*](https://docs.api7.ai/enterprise/performance/benchmark). Under the interference of a networkless environment, API7 Gateway achieved a single-core QPS (queries per second) of **23,652.91** and maintained a latency of **less than 0.1 milliseconds** in a single routing configuration. Subsequently, we changed the deployment architecture to simulate the deployment method in a user's production environment. Specifically, we deployed API7 Gateway, NGINX upstream, and the load testing tool wrk on different nodes within a Kubernetes cluster. The test results show that in a scenario configuring with a single routing, API7 Gateway can support a QPS of up to **167,019.37** requests per second, with **95%** of the client request latency **below 2.16 milliseconds**. Even in complex scenarios with **100 routes and 100 consumers**, and with authentication and rate-limiting plugins enabled simultaneously, the QPS still reaches **133,782.95**, with **95%** of the client request latency **below 2.3 milliseconds**. This data fully demonstrates that API7 Gateway can maintain high performance and stability even in complex scenarios. Whether in basic or complex scenarios, API7 Gateway can provide efficient and reliable API management services. ### Performance Benchmarking Results | **Test Scenarios** | **Number of Routes/Consumers** | **Forward to Upstream** | **QPS** | **P99 (MS)** | **P95 (MS)** | | ------------------------------------------------ | ------------------------------ | ----------------------- | ---------- | ------------ | ------------ | | Only enable `mocking` plugin | 1 route, 0 consumer | False | 310,392.07 | 1.16 | 1.08 | | No plugins enabled | 1 route, 0 consumer | True | 167,019.37 | 2.3 | 2.16 | | No plugins enabled | 100 routes, 0 consumer | True | 162,753.17 | 2.31 | 2.16 | | Only enable `limit-count` plugin | 1 route, 0 consumer | True | 145,370.10 | 2.43 | 2.24 | | Only enable `limit-count` plugin | 100 routes, 0 consumer | True | 143,108.40 | 2.45 | 2.25 | | Only enable `key-auth` plugin | 1 route, 0 consumer | True | 147,869.49 | 2.41 | 2.22 | | Only enable `key-auth` plugin | 100 routes, 0 consumer | True | 145,070.93 | 2.43 | 2.25 | | Enable both `key-auth` and `limit-count` plugins | 1 route, 0 consumers | True | 136,725.47 | 2.43 | 2.26 | | Enable both `key-auth` and `limit-count` plugins | 100 routes, 0 consumer | True | 133,782.95 | 2.48 | 2.3 | ### Deployment Topology ![Typology of Deployment](https://static.api7.ai/uploads/2024/06/07/pG1NwPZB_typology.png?imageMogr2/format/webp) ### Performance Testing Suite We recognize the importance of performance for an API gateway, so we will continue to optimize and improve the performance of API7 Enterprise. In addition to referring to the [*Performance Testing Benchmarks*](https://docs.api7.ai/enterprise/performance/performance-testing), you can also access the publicly available [Performance Benchmark Repository](https://github.com/api7/api7-gateway-performance-benchmark) for API7 Enterprise. This repository provides detailed records of the resource deployment configurations used for testing and specific configuration information for various test scenarios. Through this repository, you can conduct performance benchmark testing on the API7 Gateway based on the provided guidelines to gain a more comprehensive understanding of its performance. Before conducting the tests, we strongly recommend ensuring that the [*Performance Baseline*](https://docs.api7.ai/enterprise/performance/benchmark) you are testing is consistent with the officially published testing conditions to ensure the accuracy of the test results. For environment preparation and detailed testing steps for AWS EKS, we recommend referring to the document [*How to Prepare for the AWS EKS Environment*](https://docs.api7.ai/enterprise/performance/aws-eks), which includes detailed environment preparation and testing steps. With the provided performance testing benchmarks, the related repository, and testing guidelines, we believe you will be able to better evaluate the performance of API7 Enterprise and make more informed decisions. ## Benefits of Performance Test Reports Performance testing benchmarks provide comprehensive performance references for enterprises in selecting, deploying, and optimizing API7 Enterprise, serving as an important basis for ensuring stable system operation. They showcase specific performance metrics of the product in aspects such as response time, throughput, and concurrent access capability, helping enterprises objectively assess whether the product can meet their business needs. Additionally, the data in performance testing benchmarks provides reliable guidance for enterprises to plan the hardware resource configuration and cluster scale of API7 Enterprise. These benchmarks can help enterprises identify system bottlenecks in advance and formulate response measures to avoid business interruptions. ## Embark on a Journey with API7 Enterprise API7 Enterprise provides comprehensive digital tools and solutions to help enterprises easily achieve business digitization. It enables unified data management and analysis, offers visualized business processes and collaborative work functions, and possesses robust security and compliance controls. API7 Enterprise supports flexible deployment methods and seamlessly integrates with existing IT infrastructure. With its powerful features and wide range of application scenarios, enterprises can enhance their competitiveness and adaptability, opening the door to a better digital future. Experience [API7 Enterprise](https://api7.ai/enterprise) now and embark on your digital transformation journey! Tags: [API7 Enterprise](https://api7.ai/tags/api7-enterprise) [Performance Benchmarks](https://api7.ai/tags/performance-benchmarks) Share article link Share Related Posts [![API7 Enterprise v3.5.0: Multi-Upstream Configuration](https://static.api7.ai/uploads/2025/02/19/mQ8cStKu_multi-upstream-configuration.png)](https://api7.ai/blog/api7-3.5.0-mutli-upstream-for-traffic-management) ## [API7 Enterprise v3.5.0: Multi-Upstream Configuration](https://api7.ai/blog/api7-3.5.0-mutli-upstream-for-traffic-management) [![API7 Enterprise v3.4.0: Streamlined Certificate Management via SNI](https://static.api7.ai/uploads/2025/02/13/Q7IIQt7d_sni-certificate-management.png)](https://api7.ai/blog/api7-3.4.0-sni-certificate-management) ## [API7 Enterprise v3.4.0: Streamlined Certificate Management via SNI](https://api7.ai/blog/api7-3.4.0-sni-certificate-management) Table of Contents - [Performance Testing Benchmarks](#performance-testing-benchmarks) - [Performance Benchmarking Results](#performance-benchmarking-results) - [Deployment Topology](#deployment-topology) - [Performance Testing Suite](#performance-testing-suite) - [Benefits of Performance Test Reports](#benefits-of-performance-test-reports) - [Embark on a Journey with API7 Enterprise](#embark-on-a-journey-with-api7-enterprise) ## Related Posts [![API7 Enterprise 3.10.0: Simpler Service Management, Stronger Security, and Better AI Traffic Reliability](https://static.api7.ai/uploads/2026/07/06/e8rTH3tK_api7-enterprise-3.10.webp)](https://api7.ai/blog/api7-enterprise-3-10-service-management-security-ai-reliability) Products June 1, 2026 #### [API7 Enterprise 3.10.0: Simpler Service Management, Stronger Security, and Better AI Traffic Reliability](https://api7.ai/blog/api7-enterprise-3-10-service-management-security-ai-reliability) API7 Enterprise 3.10.0 simplifies service management, strengthens security defaults, and improves AI traffic reliability for platform teams. [API7 Gateway](https://api7.ai/tags/api7-gateway) [API7 Enterprise](https://api7.ai/tags/api7-enterprise) [AI Gateway](https://api7.ai/tags/ai-gateway) [![Announcing API7 Enterprise 3.7.0](https://static.api7.ai/uploads/2025/04/22/uCwEnhC3_api7-enterprise-3.7.0.webp)](https://api7.ai/blog/release-api7-enterprise-3.7) Products April 10, 2025 #### [Announcing API7 Enterprise 3.7.0](https://api7.ai/blog/release-api7-enterprise-3.7) API7 Enterprise 3.7.0 delivers key AI plugin advancements and security enhancements with Kubernetes secrets, furthering its AI gateway vision. [API7 Enterprise](https://api7.ai/tags/api7-enterprise) [![Announcing API7 Enterprise 3.6.0](https://static.api7.ai/uploads/2025/03/25/u0IUnqd5_api7-enterprise-3.6.0.webp)](https://api7.ai/blog/release-api7-enterprise-3.6) Products March 25, 2025 #### [Announcing API7 Enterprise 3.6.0](https://api7.ai/blog/release-api7-enterprise-3.6) API7 Enterprise 3.6.0 introduces enhanced security with mTLS for upstreams, environment variables for SSO, Basic Authentication in API7 Portal, and streamlined service templates. [API7 Enterprise](https://api7.ai/tags/api7-enterprise)