Skip to content

fix(mem-wal): install conflicts with concurrent schema-changing merge - #8539

Merged
wkalt merged 2 commits into
lance-format:mainfrom
wkalt:ticket/oss-2043/memwal-merge-conflict
Aug 14, 2026
Merged

fix(mem-wal): install conflicts with concurrent schema-changing merge#8539
wkalt merged 2 commits into
lance-format:mainfrom
wkalt:ticket/oss-2043/memwal-merge-conflict

Conversation

@wkalt

@wkalt wkalt commented Aug 14, 2026

Copy link
Copy Markdown
Contributor

initialize_mem_wal validates schema-dependent state -- sharding fields and
maintained indexes -- so a Merge that commits concurrently invalidates what
the install validated, yet both interleavings committed: check_create_index_txn
accepted any Merge and check_merge_txn accepted any CreateIndex. Both arms now
conflict when the CreateIndex carries the MemWAL index; ordinary column-index
builds stay compatible with Merge.

initialize_mem_wal validates schema-dependent state -- sharding fields and
maintained indexes -- so a Merge that commits concurrently invalidates what
the install validated, yet both interleavings committed: check_create_index_txn
accepted any Merge and check_merge_txn accepted any CreateIndex. Both arms now
conflict when the CreateIndex carries the MemWAL index; ordinary column-index
builds stay compatible with Merge.
@github-actions github-actions Bot added the bug Something isn't working label Aug 14, 2026
@github-actions

Copy link
Copy Markdown
Contributor

ACTION NEEDED
Lance follows the Conventional Commits specification for release automation.

The PR title and description are used as the merge commit message. Please update your PR title and description to match the specification.

For details on the error please inspect the "PR Title Check" action.

@wkalt wkalt changed the title fix: MemWAL install conflicts with concurrent schema-changing Merge fix(mem-wal): install conflicts with concurrent schema-changing merge Aug 14, 2026

@lance-gatekeeper lance-gatekeeper Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Gate recommendation: approve.

MemWAL initialization depends on schema and index state validated at its read version. The symmetric conflict rule closes both Merge/CreateIndex interleavings without broadening conflicts for ordinary index builds.

@lance-gatekeeper lance-gatekeeper Bot added the K-approved Latest Gatekeeper recommendation permits acceptance. label Aug 14, 2026
@wkalt
wkalt merged commit c3ae07a into lance-format:main Aug 14, 2026
39 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

bug Something isn't working K-approved Latest Gatekeeper recommendation permits acceptance.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants