Skip to content

feat: implement BinaryRow deserialization for partition bytes#133

Merged
JingsongLi merged 2 commits intoapache:mainfrom
QuakeWang:feat/binary-row-deserialization
Mar 16, 2026
Merged

feat: implement BinaryRow deserialization for partition bytes#133
JingsongLi merged 2 commits intoapache:mainfrom
QuakeWang:feat/binary-row-deserialization

Conversation

@QuakeWang
Copy link
Contributor

Purpose

Linked issue: close #126

Implement BinaryRow deserialization primitives so partition binary bytes from Paimon manifests can be decoded in Rust.

This PR focuses on the BinaryRow capability itself only. Wiring manifest _PARTITION bytes into TableScan / TableRead is intentionally left to #131, and partition path generation is handled separately in #127.

Brief change log

Tests

API and Format

This change adds BinaryRow decoding APIs but does not change the external storage format.

The implementation follows Java Paimon's existing BinaryRow binary layout, including null-bit layout and inline / variable-length encoding semantics.

Documentation

@QuakeWang
Copy link
Contributor Author

@luoyuxia @JingsongLi PTAL 👀

Copy link
Contributor

@luoyuxia luoyuxia left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@QuakeWang Thanks. Left minor comments.

Copy link
Contributor

@luoyuxia luoyuxia left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1

Copy link
Contributor

@JingsongLi JingsongLi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1

@JingsongLi JingsongLi merged commit 0065e7d into apache:main Mar 16, 2026
8 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Implement BinaryRow deserialization to decode partition binary bytes

3 participants