Skip to content

Native serialization for DynamicFlat index#281

Open
razdoburdin wants to merge 3 commits intointel:dev/razdoburdin_streamingfrom
razdoburdin:streaming/dynamicflat
Open

Native serialization for DynamicFlat index#281
razdoburdin wants to merge 3 commits intointel:dev/razdoburdin_streamingfrom
razdoburdin:streaming/dynamicflat

Conversation

@razdoburdin
Copy link
Contributor

This PR introduce native serialization for DynamicFlat index.

Main changes are:

  1. auto_dynamic_assemble now accepts lazy loader. That is mandatory for buffer-free deserialization.
  2. new class `Deserializer' is introduced. It is responsible for conditional reading of overhead data (like names of temporary files) in case of legacy models.
  3. IDTranslator is refactored to cover save and load to/from stream.

Copy link
Member

@rfsaliev rfsaliev left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGFM

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants