Skip to content

IGNITE-28305 Add backpressure for partition operations#7950

Open
EgorKuts wants to merge 7 commits intoapache:mainfrom
EgorKuts:ignite-28305
Open

IGNITE-28305 Add backpressure for partition operations#7950
EgorKuts wants to merge 7 commits intoapache:mainfrom
EgorKuts:ignite-28305

Conversation

@EgorKuts
Copy link
Copy Markdown
Contributor

@EgorKuts EgorKuts commented Apr 7, 2026

Before this change, a node could accept an unbounded number of partition operations, which could lead to the following problems:

  • Long-queued operations no longer make sense to the client by the time they are executed, forcing the node to perform useless work before it can start handling new requests.
  • That useless work still consumes node resources (CPU, memory, threads).
  • Eventually this can lead to OOM.

To prevent such scenarios, this change introduces a node-level limiter shared across the replica manager and thin-client connector that limits the total in-flight memory of partition operations to a configurable percentage of the JVM heap
(maxInFlightPartitionOperationHeapPercent).

The limit is computed as:
maxInFlightPartitionOperationHeapPercent / 100 * Runtime.getRuntime().maxMemory()

Each incoming message reserves bytes equal to its wire size. When the limit is reached, new requests are rejected immediately with ReplicaOverloadedException so clients can back off, while already accepted operations complete uninterrupted.

https://issues.apache.org/jira/browse/IGNITE-28305

@EgorKuts EgorKuts force-pushed the ignite-28305 branch 8 times, most recently from 4fd15ab to 0da1807 Compare April 10, 2026 14:13
@EgorKuts EgorKuts marked this pull request as ready for review April 10, 2026 15:25
@ptupitsyn ptupitsyn changed the title ignite-28305 backpressure to limit in flight partition operations per… IGNITE-28305 Add backpressure for client partition operations Apr 14, 2026
@ptupitsyn ptupitsyn changed the title IGNITE-28305 Add backpressure for client partition operations IGNITE-28305 Add backpressure for partition operations Apr 14, 2026
@EgorKuts EgorKuts force-pushed the ignite-28305 branch 3 times, most recently from c13db1b to f6f2e5c Compare April 16, 2026 15:00
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants