Skip to content

feat: support read deletion vector to arrow#141

Open
luoyuxia wants to merge 1 commit intoapache:mainfrom
luoyuxia:support-read-dv-table-to-arrow
Open

feat: support read deletion vector to arrow#141
luoyuxia wants to merge 1 commit intoapache:mainfrom
luoyuxia:support-read-dv-table-to-arrow

Conversation

@luoyuxia
Copy link
Contributor

@luoyuxia luoyuxia commented Mar 16, 2026

Purpose

Linked issue: close #140

Support reading deletion-vector tables through the Arrow read path.

Brief change log

  • add split-level deletion vector loading and row filtering in ArrowReader
  • reject reading primary-key tables without deletion-vectors.enabled
  • fix manifest add/delete merging to use full file identity via ManifestEntry::identifier()
  • introduce lightweight CoreOptions accessors for deletion-vector and split-size options
  • update integration/dev helpers and table read tests to cover DV table reads

Tests

API and Format

No storage format change. The read path now supports deletion-vector filtering for Arrow reads and returns an explicit unsupported error for primary-key tables without deletion vectors.

Documentation

No documentation update.

@luoyuxia luoyuxia force-pushed the support-read-dv-table-to-arrow branch from 5ab0cea to f2e8136 Compare March 16, 2026 23:54
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

support read dv enable primary key table to arrow

1 participant