v4.4.0

What's Changed

We now collect buildtime and runtime environment data to warn users about differences in their runtime environment when comparing two runs against one another.

This data includes toolchain metadata like version and build options, as well as a list of dynamically loaded linked libraries.

• fix: fix segfault caused by multiple activate_stack_trampoline by @GuillaumeLagrange in #109
• fix: Exclude setup time from benchmark in walltime mode by @toby-coleman in #114
• feat: collect Python toolchain information via instrument hooks environment API by @GuillaumeLagrange in #108

New Contributors

• @toby-coleman made their first contribution in #114

Full Changelog: v4.3.0...v4.4.0

v4.3.0

What's Changed

This release brings support for the memory instrument, which enables you to track memory usage, heap allocations, and memory leaks in your benchmarks.

• Bump uv in CI from 0.5.20 to 0.9.5 by @edgarrmondragon in #95
• feat/improve local walltime by @adriencaccia in #97
• feat: rename instrumentation to simulation by @GuillaumeLagrange in #98
• Pin python in ci integration tests to prevent intermitent codspeed segfaults in walltime by @GuillaumeLagrange in #105
• feat: add memory profiling support by @not-matthias in #103
• feat: add .gitignore to .codspeed folder on creation by @art049 in #107

New Contributors

• @GuillaumeLagrange made their first contribution in #98

Full Changelog: v4.2.0...v4.3.0

v4.2.0

What's Changed

• Support python 3.14 by @adriencaccia in #91

Full Changelog: v4.1.1...v4.2.0

v4.1.1

What's Changed?

• fix: build on macos with instrument-hooks by @not-matthias in #90

Full Changelog: v4.1.0...v4.1.1

v4.1.0

What's New?

🚀 The new version of CodSpeedHQ/instrument-hooks will improve the quality of the walltime profiling!

Details

✨ Features

• Bump instrument-hooks (#87) by @not-matthias in #87

🐛 Bug Fixes

• Use ParamSpec in instrument definition instead of tuple and dict by @art049
• Use ParamSpec in the plugin call definition by @flying-sheep

📚 Documentation

• Add pull_request trigger comment by @adriencaccia

⚙️ Internals

• Exclude beta tags in changelog by @art049
• Switch to sharded upload (#75) by @art049 in #75
• Fix changelog generation by @art049

Full Changelog: v4.0.0...v4.1.0

v4.0.0

What's Changed

This release introduces profiling to the walltime instrument and includes several key improvements to the existing benchmark fixture API! 🎉

Warning

Since we're now using CodSpeedHQ/instrument-hooks to control the instrument state, the performance may slightly change in tiny microbenchmarks when upgrading.

🚀 Features

• Support perf profiling in Python walltime instrument by @not-matthias in #79
• Support pytest-benchmark marker attributes by @art049 in #80
• Support the pedantic API by @art049 in #81

New Contributors

• @not-matthias made their first contribution in #79

Full Changelog: v3.2.0...v4.0.0

v3.2.0

What's Changed

This release improves the reliability of the measurement, primarily focusing on the wall-time instrument.

🚀 Features

• Increase the min round time to a bigger value (+/- 1ms) by @art049

• Fix the random seed while measuring with instruments by @art049 in #48

🐛 Bug Fixes

• Use time per iteration instead of total round time in stats by @art049

🏗️ Refactor

• Replace hardcoded outlier factor for improved readability by @art049 in #67

⚙️ Internals

• Fix self-dependency by @adriencaccia in #66
• Fix uv version in CI by @adriencaccia
• Add benchmarks-walltime job to run additional performance benchmarks by @art049 in #65

⚠️ Since the wall-time instrument is still in beta, this minor release might create unexpected performance changes for this new instrument.

Full Changelog: v3.1.2...v3.2.0

v3.1.2

What's Changed

🐛 Bug Fixes

• fix: update package_data to include header and source files for valgrind wrapper by @art049 in #64

Full Changelog: v3.1.1...v3.1.2

v3.1.1

What's Changed

⚙️ Internals

• Add a py3-none-any fallback wheel by @art049 in #61

Full Changelog: v3.1.0...v3.1.1

v3.1.0

What's changed

🚀 Features

• Build the native extension during packaging to avoid runtime build issues by @art049 in #57

Full Changelog: v3.0.0...v3.1.0