We’re excited to announce the release of a powerful new feature in ERP.net rate limitng:
This feature is designed to optimize performance and manage high-demand scenarios across all user sessions. This update aims to provide a smoother experience, ensuring more stable and balanced performance.
What are Global Concurrent Requests?
In any large-scale scenario, multiple users (sessions) may be sending requests simultaneously. This can overload the system, especially when there are no limitations in place to manage these concurrent interactions at once.
Global Concurrent Requests solves this problem by introducing a cap on the total number of requests that can be processed at the same time across all active sessions. Unlike per-session rate limits, which limit each individual sesion's actions, this new feature allows you to control how many requests your instance can handle globally at once.
Why Is This Feature Important?
Rate limiting is crucial for maintaining system stability and fairness across all users, but a system-wide cap is even more essential when you're managing large deployments with high traffic.
How It Works
The default configuration for Global Concurrent Requests is set to 2 concurrent requests across all active sessions. However, this can be fine-tuned depending on your system’s capacity. The upper limit is determined by the number of processor cores on the server, allowing up to a maximum of 4 concurrent requests.
If more than 2 concurrent requests come in across sessions, an internal queue is used to manage them. The system can hold up to 5 additional requests in the queue. Once the queue limit is reached, any further requests will receive an HTTP 429 - Too Many Requests response.
Table API Support
Currently, Global Concurrent Requests is supported only in Table API.
---
More information is available in our official documentation:
https://docs.erp.net/tech/advanced/web-sites/rate-limits.html#globalconcurrentrequests
https://docs.erp.net/tech/advanced/web-sites/types/table-api.html#applicable-rate-limits
https://docs.erp.net/tech/advanced/web-sites/rate-limits.html#configuring-rate-limits
0 Comments