feat(aml): add lineage command for extracting metadata#17
Open
nvquanghuy wants to merge 1 commit intomasterfrom
Open
feat(aml): add lineage command for extracting metadata#17nvquanghuy wants to merge 1 commit intomasterfrom
nvquanghuy wants to merge 1 commit intomasterfrom
Conversation
Adds a new `holistics aml lineage` command that extracts lineage metadata from compiled AML projects and outputs a normalized JSON structure optimized for integration with data catalogs like DataHub. Features: - Parses TableModel and QueryModel entities with fields (dimensions/measures) - Extracts Dataset and Dashboard entities with chart definitions - Builds lineage edges: model->source, dataset->model, chart->model, dashboard->chart - Supports multiple table name formats (BigQuery, PostgreSQL, simple) - Options: --output file, --entities filter, --compact JSON Includes comprehensive tests with vitest. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
holistics aml lineage [path]command to extract lineage metadata from compiled AML projects--output <file>,--entities <filter>,--compactChanges
amlTest plan
npm testto verify all tests passholistics aml lineage .on a sample AML project--output,--entities, and--compactoptions🤖 Generated with Claude Code