Skip to content

chore: Add benchmarking setup to SDK#135

Merged
Abhijeet Prasad (AbhiPrasad) merged 1 commit intomainfrom
abhi-benchmarks
Mar 24, 2026
Merged

chore: Add benchmarking setup to SDK#135
Abhijeet Prasad (AbhiPrasad) merged 1 commit intomainfrom
abhi-benchmarks

Conversation

@AbhiPrasad
Copy link
Member

@AbhiPrasad Abhijeet Prasad (AbhiPrasad) commented Mar 24, 2026

resolves #134

I want to work on merging in #101

This adds a benchmarking harness to the SDK so we can make changes like this easy.

The harness itself relies completely on https://pyperf.readthedocs.io/en/latest/index.html, but I've adjusted some stuff for os compat and making it work for our repo.

Docs wise, I've updated CONTRIBUTING.md, AGENTS.md, and added a new agent skill for benchmarking.

For now these benchmarks are meant to run completely locally, but we can explore running them in CI or in a devbox.

pre-commit
pydoc-markdown
pylint
pyperf

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pin a version?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yeah we should do that for all the requirements-dev packages. Will do it in a follow up.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

done with #138

@AbhiPrasad Abhijeet Prasad (AbhiPrasad) merged commit 72adf8b into main Mar 24, 2026
33 checks passed
@AbhiPrasad Abhijeet Prasad (AbhiPrasad) deleted the abhi-benchmarks branch March 24, 2026 23:53
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Add a repeatable performance benchmark harness for tracing hot paths

2 participants