Skip to content

Swartzn/feat/sort by archival placement hints#287

Open
swartzn wants to merge 2 commits intomainfrom
swartzn/feat/sort-by-archival-placement-hints
Open

Swartzn/feat/sort by archival placement hints#287
swartzn wants to merge 2 commits intomainfrom
swartzn/feat/sort-by-archival-placement-hints

Conversation

@swartzn
Copy link
Copy Markdown
Contributor

@swartzn swartzn commented Jan 9, 2026

Requires ThinkParQ/protobuf#65

What does this PR do / why do we need it?

Required for all PRs.

  • Allow rst clients to provide jobrequest.SortValues so builder jobs can stream requests in a deterministic order. For now, this just supports the changes needed for s3 tape archives.
  • Adds support for ordering job requests for archived s3 objects using the storage class' placement hints. This supports efficient s3 tape restore operations.

Related Issue(s)

Required when applicable.

Where should the reviewer(s) start reviewing this?

Only required for larger PRs when this may not be immediately obvious.

Are there any specific topics we should discuss before merging?

Not required.

What are the next steps after this PR?

Not required.

Checklist before merging:

Required for all PRs.

When creating a PR these are items to keep in mind that cannot be checked by GitHub actions:

  • Documentation:
    • Does developer documentation (code comments, readme, etc.) need to be added or updated?
    • Does the user documentation need to be expanded or updated for this change?
  • Testing:
    • Does this functionality require changing or adding new unit tests?
    • Does this functionality require changing or adding new integration tests?
  • Git Hygiene:

For more details refer to the Go coding standards and the pull request process.

…rting

Add support for JobRequest SortValues.
- Generically allows RST clients to optionally provide an order string slice to sort job requests.
Add support for s3 storage class placement hints.
- Supports string, integer and float s3 metadata value types.
- Includes unit tests
Unify rst.GetRemotePathInfo return values into RemotePathInfo type.
Add warning message when builder's job request buffer exceeds memory utilization threshold.
@swartzn swartzn requested a review from a team as a code owner January 9, 2026 19:03
@swartzn swartzn self-assigned this Jan 12, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant