Skip to content

Improve ergonomics for ExecutionPlanMetricsSet and MetricsSet#21762

Merged
gabotechs merged 3 commits intoapache:mainfrom
gabotechs:improve-metrics-set-ergonomics
Apr 22, 2026
Merged

Improve ergonomics for ExecutionPlanMetricsSet and MetricsSet#21762
gabotechs merged 3 commits intoapache:mainfrom
gabotechs:improve-metrics-set-ergonomics

Conversation

@gabotechs
Copy link
Copy Markdown
Contributor

Which issue does this PR close?

  • None

Rationale for this change

Sometimes, when an ExecutionPlan implementation is complex, different metrics are collected from different structs that compose the whole execution plan.

These metrics need to eventually be served from the single entrypoint ExecutionPlan::metrics() or DataSource::metrics(), and the current api does not have good methods for merging several ExecutionPlanMetricsSet coming from different sources into a single one.

What changes are included in this PR?

Add some basic conversion and iteration methods for MetricsSet and ExecutionPlanMetricsSet, in order to improve ergonomics around these structs.

Are these changes tested?

This is purely just basic std trait implementations and method exposure, so as long as the code compiles, I don't think it needs further tests.

Are there any user-facing changes?

People will see some more available methods in the MetricsSet and ExecutionPlanMetricsSet structs for ergonomics.

@github-actions github-actions Bot added the physical-expr Changes to the physical-expr crates label Apr 21, 2026
@gabotechs
Copy link
Copy Markdown
Contributor Author

Any chance for a quick review on this one? should be trivial. Maybe @comphead or @martin-g?

Comment thread datafusion/physical-expr-common/src/metrics/mod.rs Outdated
Comment thread datafusion/physical-expr-common/src/metrics/mod.rs
Comment thread datafusion/physical-expr-common/src/metrics/mod.rs Outdated
Comment thread datafusion/physical-expr-common/src/metrics/mod.rs
@gabotechs
Copy link
Copy Markdown
Contributor Author

Thanks for the quick (and quality) review @martin-g! pushed some changes

@gabotechs gabotechs force-pushed the improve-metrics-set-ergonomics branch from 81e16b4 to 0905a39 Compare April 22, 2026 11:33
@gabotechs
Copy link
Copy Markdown
Contributor Author

Thanks @martin-g for the quality review!

@gabotechs gabotechs added this pull request to the merge queue Apr 22, 2026
Merged via the queue into apache:main with commit ff844be Apr 22, 2026
35 checks passed
@gabotechs gabotechs deleted the improve-metrics-set-ergonomics branch April 22, 2026 13:16
gabotechs added a commit to DataDog/datafusion that referenced this pull request Apr 22, 2026
…#21762)

## Which issue does this PR close?

<!--
We generally require a GitHub issue to be filed for all bug fixes and
enhancements and this helps us generate change logs for our releases.
You can link an issue to this PR using the GitHub syntax. For example
`Closes apache#123` indicates that this PR will close issue apache#123.
-->

- None

## Rationale for this change

<!--
Why are you proposing this change? If this is already explained clearly
in the issue then this section is not needed.
Explaining clearly why changes are proposed helps reviewers understand
your changes and offer better suggestions for fixes.
-->

Sometimes, when an `ExecutionPlan` implementation is complex, different
metrics are collected from different structs that compose the whole
execution plan.

These metrics need to eventually be served from the single entrypoint
`ExecutionPlan::metrics()` or `DataSource::metrics()`, and the current
api does not have good methods for merging several
`ExecutionPlanMetricsSet` coming from different sources into a single
one.

## What changes are included in this PR?

<!--
There is no need to duplicate the description in the issue here but it
is sometimes worth providing a summary of the individual changes in this
PR.
-->

Add some basic conversion and iteration methods for `MetricsSet` and
`ExecutionPlanMetricsSet`, in order to improve ergonomics around these
structs.

## Are these changes tested?

<!--
We typically require tests for all PRs in order to:
1. Prevent the code from being accidentally broken by subsequent changes
2. Serve as another way to document the expected behavior of the code

If tests are not included in your PR, please explain why (for example,
are they covered by existing tests)?
-->

This is purely just basic std trait implementations and method exposure,
so as long as the code compiles, I don't think it needs further tests.

## Are there any user-facing changes?

People will see some more available methods in the `MetricsSet` and
`ExecutionPlanMetricsSet` structs for ergonomics.

<!--
If there are user-facing changes then we may require documentation to be
updated before approving the PR.
-->

<!--
If there are any breaking changes to public APIs, please add the `api
change` label.
-->

(cherry picked from commit ff844be)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

physical-expr Changes to the physical-expr crates

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants