Skip to content

[raft] Possible optimizations - #1587

Draft
the-glu wants to merge 20 commits into
interuss:masterfrom
Orbitalize:reduce_raft_payload
Draft

the-glu wants to merge 20 commits into
interuss:masterfrom
Orbitalize:reduce_raft_payload

Conversation

@the-glu

@the-glu the-glu commented Jul 3, 2026 •

Copy link
Copy Markdown
Member

This PR shows a few possible optimizations for raft.

It should be split into dedicated PRs when parent PRs are merged, to be compatible with the latest version of the code.

Optimizations are:

  • Proposals encoded with a simple encoder
  • Optional compression of proposals above a specific threshold
  • Smaller encoding of known ovn formats
  • Removal of extra information in upsertOperationalIntentReference, moving cells computation into transaction + removing useless keys

This greatly improves performance with latency (around 10x with flightsinsub and 33ms of latency).

@barroco barroco added the dss-raft Relating to the application-layer consensus implemenation based on raft label Jul 3, 2026
@MariemBaccari
MariemBaccari force-pushed the reduce_raft_payload branch 2 times, most recently from dcfa69d to 49c0f64 Compare October 8, 2026 09:25
@MariemBaccari

Copy link
Copy Markdown
Contributor

Optimizations 1 and 2 are addressed by #1765 and #1766 (using protobuf is simpler and only adds a few bytes to binary encoding).
The 4th optimization was partially addressed by PRs that define custom payloads and partially outdated since we have decided to precompute the cells coverage and include them in the payload instead of the raw 4d volume.

NB: I will update my comment when optimization 3 is addressed and this PR can be closed.

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

dss-raft Relating to the application-layer consensus implemenation based on raft

Projects

Status: No status

Development

Successfully merging this pull request may close these issues.

3 participants