Skip to content

ci: pin GitHub Actions to full-length commit SHA#1736

Open
juliendoutre wants to merge 1 commit intomainfrom
pin-github-actions-1773667913
Open

ci: pin GitHub Actions to full-length commit SHA#1736
juliendoutre wants to merge 1 commit intomainfrom
pin-github-actions-1773667913

Conversation

@juliendoutre
Copy link

@juliendoutre juliendoutre commented Mar 16, 2026

Pin GitHub Actions to SHA hashes

This automated PR pins third-party GitHub Actions references from mutable tag versions (e.g., @v4) to their corresponding SHA hashes (e.g., @abc123...). The original tag is preserved as a comment for readability. Your workflows will work exactly the same way. Internal actions (under the DataDog organization) are not pinned.

Read https://docs.github.com/en/actions/reference/security/secure-use#using-third-party-actions for more details and info on how to configure this for entire repos.

Why pin GitHub Actions?

Git tags are mutable: they can be moved to point to different commits at any time. A compromised or malicious action maintainer could update a tag to inject arbitrary code into your CI workflows (see the tj-actions incident). Pinning to SHA hashes ensures you always run the exact code you reviewed, protecting your repository from supply chain attacks such as the tj-actions incident.

What if something breaks?

If a pinned action doesn't work for your use case, you can push a commit directly to this branch to fix it. As a last resort, reach out to #sdlc-security on Slack.

Set up Dependabot or Renovate for automatic updates

Once actions are pinned to SHA hashes, you should configure Dependabot or Renovate to receive weekly update PRs when new versions are available.

In the case of Dependabot, create or update .github/dependabot.yml:

version: 2
updates:
  - package-ecosystem: "github-actions"
    directory: "/"
    schedule:
      interval: "weekly"
    groups:
      github-actions:
        patterns:
          - "*"
    open-pull-requests-limit: 10

Dependabot will automatically propose PRs that update both the SHA hash and the version comment like in this example.

This PR was automatically generated by the GitHub Actions Pinning tool, owned by #sdlc-security.

@juliendoutre juliendoutre requested a review from a team as a code owner March 16, 2026 13:32
@codecov-commenter
Copy link

codecov-commenter commented Mar 16, 2026

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 71.41%. Comparing base (06257cf) to head (f8f5269).

Additional details and impacted files 
@@            Coverage Diff             @@
##             main    #1736      +/-   ##
==========================================
- Coverage   71.43%   71.41%   -0.03%     
==========================================
  Files         430      430              
  Lines       63994    63994              
==========================================
- Hits        45715    45700      -15     
- Misses      18279    18294      +15
Components Coverage Δ
libdd-crashtracker 63.88% <ø> (ø)
libdd-crashtracker-ffi 17.72% <ø> (ø)
libdd-alloc 98.77% <ø> (ø)
libdd-data-pipeline 87.79% <ø> (ø)
libdd-data-pipeline-ffi 75.43% <ø> (ø)
libdd-common 79.73% <ø> (ø)
libdd-common-ffi 73.40% <ø> (ø)
libdd-telemetry 62.48% <ø> (ø)
libdd-telemetry-ffi 16.75% <ø> (ø)
libdd-dogstatsd-client 82.64% <ø> (ø)
datadog-ipc 80.35% <ø> (ø)
libdd-profiling 81.59% <ø> (-0.02%) ⬇️
libdd-profiling-ffi 63.65% <ø> (ø)
datadog-sidecar 32.73% <ø> (ø)
datdog-sidecar-ffi 9.11% <ø> (ø)
spawn-worker 54.69% <ø> (ø)
libdd-tinybytes 93.16% <ø> (ø)
libdd-trace-normalization 81.71% <ø> (ø)
libdd-trace-obfuscation 91.80% <ø> (ø)
libdd-trace-protobuf 68.25% <ø> (ø)
libdd-trace-utils 88.98% <ø> (ø)
datadog-tracer-flare 86.86% <ø> (ø)
libdd-log 74.69% <ø> (ø)
🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@pr-commenter
Copy link

pr-commenter bot commented Mar 16, 2026 •
edited
Loading

Benchmarks

Comparison

Benchmark execution time: 2026-03-16 13:50:30

Comparing candidate commit 06257cf in PR branch pin-github-actions-1773667913 with baseline commit 06257cf in branch main.

Found 0 performance improvements and 0 performance regressions! Performance is the same for 58 metrics, 2 unstable metrics.

Explanation

This is an A/B test comparing a candidate commit's performance against that of a baseline commit. Performance changes are noted in the tables below as:

  • 🟩 = significantly better candidate vs. baseline
  • 🟥 = significantly worse candidate vs. baseline

We compute a confidence interval (CI) over the relative difference of means between metrics from the candidate and baseline commits, considering the baseline as the reference.

If the CI is entirely outside the configured SIGNIFICANT_IMPACT_THRESHOLD (or the deprecated UNCONFIDENCE_THRESHOLD), the change is considered significant.

Feel free to reach out to #apm-benchmarking-platform on Slack if you have any questions.

More details about the CI and significant changes

You can imagine this CI as a range of values that is likely to contain the true difference of means between the candidate and baseline commits.

CIs of the difference of means are often centered around 0%, because often changes are not that big:

---------------------------------(------|---^--------)-------------------------------->
                              -0.6%    0%  0.3%     +1.2%
                                 |          |        |
         lower bound of the CI --'          |        |
sample mean (center of the CI) -------------'        |
         upper bound of the CI ----------------------'

As described above, a change is considered significant if the CI is entirely outside the configured SIGNIFICANT_IMPACT_THRESHOLD (or the deprecated UNCONFIDENCE_THRESHOLD).

For instance, for an execution time metric, this confidence interval indicates a significantly worse performance:

----------------------------------------|---------|---(---------^---------)---------->
                                       0%        1%  1.3%      2.2%      3.1%
                                                  |   |         |         |
       significant impact threshold --------------'   |         |         |
                      lower bound of CI --------------'         |         |
       sample mean (center of the CI) --------------------------'         |
                      upper bound of CI ----------------------------------'

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 06257cf 1773651892 pin-github-actions-1773667913
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 89.289µs 89.470µs ± 0.162µs 89.449µs ± 0.042µs 89.491µs 89.604µs 89.811µs 91.294µs 2.06% 7.901 81.426 0.18% 0.011µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [89.447µs; 89.492µs] or [-0.025%; +0.025%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 06257cf 1773651892 pin-github-actions-1773667913
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
ip_address/quantize_peer_ip_address_benchmark execution_time 4.952µs 5.026µs ± 0.044µs 5.010µs ± 0.027µs 5.060µs 5.102µs 5.105µs 5.106µs 1.91% 0.375 -0.977 0.87% 0.003µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark execution_time [5.020µs; 5.032µs] or [-0.120%; +0.120%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 06257cf 1773651892 pin-github-actions-1773667913
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sdk_test_data/rules-based execution_time 144.623µs 146.561µs ± 1.687µs 146.287µs ± 0.538µs 146.875µs 148.219µs 153.817µs 163.155µs 11.53% 5.932 49.606 1.15% 0.119µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sdk_test_data/rules-based execution_time [146.327µs; 146.795µs] or [-0.159%; +0.159%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 06257cf 1773651892 pin-github-actions-1773667913
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 50.209ms 50.509ms ± 1.040ms 50.367ms ± 0.058ms 50.467ms 50.610ms 52.778ms 64.194ms 27.45% 11.746 149.328 2.05% 0.074ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [50.365ms; 50.653ms] or [-0.285%; +0.285%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 06257cf 1773651892 pin-github-actions-1773667913
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching serializing traces from their internal representation to msgpack execution_time 14.046ms 14.096ms ± 0.028ms 14.090ms ± 0.013ms 14.106ms 14.139ms 14.202ms 14.258ms 1.19% 2.198 7.663 0.20% 0.002ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching serializing traces from their internal representation to msgpack execution_time [14.092ms; 14.100ms] or [-0.028%; +0.028%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 06257cf 1773651892 pin-github-actions-1773667913
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.209µs 3.208µs ± 1.423µs 2.978µs ± 0.031µs 3.011µs 3.696µs 14.022µs 14.724µs 394.40% 7.288 54.477 44.23% 0.101µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [3.011µs; 3.406µs] or [-6.146%; +6.146%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 06257cf 1773651892 pin-github-actions-1773667913
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
single_flag_killswitch/rules-based execution_time 190.959ns 193.474ns ± 1.716ns 193.551ns ± 1.006ns 194.374ns 196.512ns 198.618ns 199.561ns 3.10% 0.685 0.685 0.88% 0.121ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
single_flag_killswitch/rules-based execution_time [193.236ns; 193.712ns] or [-0.123%; +0.123%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 06257cf 1773651892 pin-github-actions-1773667913
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.389µs 2.413µs ± 0.024µs 2.402µs ± 0.005µs 2.413µs 2.465µs 2.472µs 2.473µs 2.94% 1.379 0.378 0.98% 0.002µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.409µs; 2.416µs] or [-0.137%; +0.137%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 06257cf 1773651892 pin-github-actions-1773667913
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 13.045ms 13.077ms ± 0.016ms 13.075ms ± 0.010ms 13.085ms 13.107ms 13.120ms 13.128ms 0.40% 0.700 0.331 0.12% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [13.075ms; 13.079ms] or [-0.017%; +0.017%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 06257cf 1773651892 pin-github-actions-1773667913
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
profile_add_sample2_frames_x1000 execution_time 730.164µs 731.611µs ± 0.628µs 731.536µs ± 0.452µs 732.067µs 732.743µs 732.912µs 733.270µs 0.24% 0.199 -0.514 0.09% 0.044µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
profile_add_sample2_frames_x1000 execution_time [731.524µs; 731.698µs] or [-0.012%; +0.012%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 06257cf 1773651892 pin-github-actions-1773667913
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 185.425µs 187.964µs ± 1.685µs 187.816µs ± 1.108µs 188.974µs 191.195µs 192.655µs 192.926µs 2.72% 0.717 0.282 0.89% 0.119µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 5183333.199op/s 5320594.021op/s ± 47393.858op/s 5324346.192op/s ± 31397.806op/s 5351203.141op/s 5385340.761op/s 5389954.685op/s 5393002.229op/s 1.29% -0.670 0.184 0.89% 3351.252op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 17.879µs 17.968µs ± 0.037µs 17.962µs ± 0.022µs 17.990µs 18.029µs 18.051µs 18.092µs 0.72% 0.375 0.259 0.20% 0.003µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 55273583.511op/s 55655474.466op/s ± 113999.591op/s 55672002.830op/s ± 67924.914op/s 55726818.790op/s 55825252.483op/s 55889428.903op/s 55932817.229op/s 0.47% -0.362 0.245 0.20% 8060.988op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 9.824µs 9.882µs ± 0.046µs 9.877µs ± 0.029µs 9.900µs 9.962µs 10.046µs 10.081µs 2.06% 1.427 2.844 0.46% 0.003µs 1 200
normalization/normalize_name/normalize_name/good throughput 99196952.192op/s 101192857.077op/s ± 466166.240op/s 101242889.689op/s ± 301979.872op/s 101610779.147op/s 101692686.242op/s 101754166.186op/s 101793712.363op/s 0.54% -1.388 2.674 0.46% 32962.931op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [187.730µs; 188.197µs] or [-0.124%; +0.124%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [5314025.688op/s; 5327162.354op/s] or [-0.123%; +0.123%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [17.963µs; 17.973µs] or [-0.028%; +0.028%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [55639675.219op/s; 55671273.712op/s] or [-0.028%; +0.028%] None None None
normalization/normalize_name/normalize_name/good execution_time [9.876µs; 9.889µs] or [-0.064%; +0.064%] None None None
normalization/normalize_name/normalize_name/good throughput [101128250.920op/s; 101257463.235op/s] or [-0.064%; +0.064%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 06257cf 1773651892 pin-github-actions-1773667913
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
profile_add_sample_frames_x1000 execution_time 4.139ms 4.143ms ± 0.007ms 4.142ms ± 0.001ms 4.144ms 4.147ms 4.151ms 4.235ms 2.24% 11.802 153.553 0.17% 0.000ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
profile_add_sample_frames_x1000 execution_time [4.142ms; 4.144ms] or [-0.023%; +0.023%] None None None

Group 13

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 06257cf 1773651892 pin-github-actions-1773667913
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
receiver_entry_point/report/2598 execution_time 3.407ms 3.446ms ± 0.021ms 3.440ms ± 0.009ms 3.454ms 3.490ms 3.503ms 3.519ms 2.28% 1.145 0.729 0.61% 0.002ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
receiver_entry_point/report/2598 execution_time [3.444ms; 3.449ms] or [-0.085%; +0.085%] None None None

Group 14

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 06257cf 1773651892 pin-github-actions-1773667913
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 17.600µs 25.232µs ± 9.262µs 18.108µs ± 0.421µs 33.426µs 42.492µs 43.665µs 65.402µs 261.17% 0.999 0.721 36.62% 0.655µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [23.948µs; 26.515µs] or [-5.087%; +5.087%] None None None

Group 15

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 06257cf 1773651892 pin-github-actions-1773667913
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 3.890µs 3.912µs ± 0.003µs 3.912µs ± 0.001µs 3.913µs 3.916µs 3.920µs 3.922µs 0.26% -1.597 19.495 0.07% 0.000µs 1 200
credit_card/is_card_number/ throughput 254987717.310op/s 255629530.247op/s ± 180306.096op/s 255653931.162op/s ± 89322.440op/s 255731755.491op/s 255800891.709op/s 255819305.693op/s 257059562.319op/s 0.55% 1.637 19.807 0.07% 12749.566op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 73.922µs 75.167µs ± 0.784µs 75.097µs ± 0.453µs 75.550µs 76.581µs 77.111µs 79.527µs 5.90% 1.331 4.201 1.04% 0.055µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 12574304.521op/s 13305064.287op/s ± 137033.507op/s 13316062.259op/s ± 79925.625op/s 13394052.541op/s 13471810.208op/s 13521200.996op/s 13527727.450op/s 1.59% -1.201 3.447 1.03% 9689.732op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 67.610µs 67.738µs ± 0.153µs 67.717µs ± 0.031µs 67.754µs 67.801µs 68.432µs 69.166µs 2.14% 7.481 61.987 0.23% 0.011µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 14457936.782op/s 14762818.901op/s ± 32774.487op/s 14767311.820op/s ± 6806.141op/s 14773679.951op/s 14780990.095op/s 14786189.050op/s 14790739.518op/s 0.16% -7.427 61.272 0.22% 2317.506op/s 1 200
credit_card/is_card_number/37828224631 execution_time 3.893µs 3.913µs ± 0.003µs 3.913µs ± 0.002µs 3.914µs 3.916µs 3.918µs 3.919µs 0.17% -1.850 13.631 0.07% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 255151449.898op/s 255588224.759op/s ± 173860.860op/s 255585191.143op/s ± 109354.063op/s 255694445.038op/s 255816250.590op/s 255873073.877op/s 256882920.159op/s 0.51% 1.875 13.850 0.07% 12293.819op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 64.398µs 64.493µs ± 0.051µs 64.490µs ± 0.040µs 64.533µs 64.576µs 64.635µs 64.653µs 0.25% 0.475 -0.219 0.08% 0.004µs 1 200
credit_card/is_card_number/378282246310005 throughput 15467256.908op/s 15505474.659op/s ± 12362.563op/s 15506349.403op/s ± 9650.849op/s 15515583.203op/s 15522456.946op/s 15527268.133op/s 15528482.023op/s 0.14% -0.471 -0.226 0.08% 874.165op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 44.635µs 45.066µs ± 0.134µs 45.069µs ± 0.089µs 45.153µs 45.290µs 45.383µs 45.398µs 0.73% 0.043 -0.036 0.30% 0.009µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 22027421.759op/s 22189869.130op/s ± 66135.936op/s 22188252.436op/s ± 43921.021op/s 22237452.909op/s 22294652.545op/s 22323390.248op/s 22403705.694op/s 0.97% -0.025 -0.030 0.30% 4676.517op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 6.028µs 6.036µs ± 0.006µs 6.035µs ± 0.002µs 6.037µs 6.041µs 6.044µs 6.107µs 1.19% 8.402 96.968 0.10% 0.000µs 1 200
credit_card/is_card_number/x371413321323331 throughput 163741426.413op/s 165678565.638op/s ± 163973.966op/s 165694080.060op/s ± 59669.618op/s 165747748.035op/s 165818349.459op/s 165870869.822op/s 165886194.467op/s 0.12% -8.318 95.633 0.10% 11594.710op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 3.894µs 3.912µs ± 0.003µs 3.912µs ± 0.002µs 3.914µs 3.916µs 3.918µs 3.922µs 0.25% -1.035 9.385 0.07% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 254980979.137op/s 255613546.729op/s ± 174086.416op/s 255611264.600op/s ± 107517.948op/s 255722196.687op/s 255832930.793op/s 255887193.542op/s 256783214.311op/s 0.46% 1.056 9.521 0.07% 12309.769op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 64.935µs 65.560µs ± 0.105µs 65.566µs ± 0.064µs 65.625µs 65.714µs 65.761µs 65.808µs 0.37% -1.044 5.264 0.16% 0.007µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 15195665.044op/s 15253197.363op/s ± 24370.266op/s 15251734.362op/s ± 14865.940op/s 15267689.371op/s 15290054.743op/s 15298090.175op/s 15399968.898op/s 0.97% 1.073 5.451 0.16% 1723.238op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 52.957µs 53.017µs ± 0.033µs 53.014µs ± 0.019µs 53.032µs 53.078µs 53.123µs 53.163µs 0.28% 1.271 2.737 0.06% 0.002µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 18809902.448op/s 18861749.128op/s ± 11610.141op/s 18862990.813op/s ± 6738.367op/s 18869985.401op/s 18876529.678op/s 18879547.282op/s 18883326.023op/s 0.11% -1.265 2.714 0.06% 820.961op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 3.894µs 3.912µs ± 0.003µs 3.912µs ± 0.001µs 3.914µs 3.918µs 3.920µs 3.925µs 0.34% -0.061 7.887 0.08% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 254776511.578op/s 255606502.647op/s ± 192960.052op/s 255638186.693op/s ± 95943.524op/s 255718430.914op/s 255818742.108op/s 255877932.933op/s 256788165.530op/s 0.45% 0.084 7.979 0.08% 13644.336op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 49.744µs 49.810µs ± 0.043µs 49.803µs ± 0.021µs 49.829µs 49.889µs 49.911µs 50.131µs 0.66% 2.548 14.464 0.09% 0.003µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 19947602.313op/s 20076274.231op/s ± 17290.919op/s 20079153.823op/s ± 8534.433op/s 20087103.578op/s 20096149.586op/s 20099996.162op/s 20102866.669op/s 0.12% -2.523 14.213 0.09% 1222.653op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 44.730µs 45.067µs ± 0.129µs 45.060µs ± 0.086µs 45.145µs 45.274µs 45.345µs 45.387µs 0.73% -0.090 -0.187 0.29% 0.009µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 22032821.560op/s 22189385.633op/s ± 63589.449op/s 22192728.561op/s ± 42387.357op/s 22235532.400op/s 22294787.414op/s 22345950.867op/s 22356608.039op/s 0.74% 0.105 -0.181 0.29% 4496.453op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 6.029µs 6.037µs ± 0.012µs 6.036µs ± 0.003µs 6.038µs 6.043µs 6.104µs 6.172µs 2.25% 8.216 78.486 0.20% 0.001µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 162032634.370op/s 165638483.283op/s ± 331018.431op/s 165679116.152op/s ± 71945.536op/s 165750309.364op/s 165823643.913op/s 165853695.626op/s 165863740.685op/s 0.11% -8.138 77.144 0.20% 23406.538op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [3.912µs; 3.912µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/ throughput [255604541.556op/s; 255654518.938op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [75.059µs; 75.276µs] or [-0.145%; +0.145%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [13286072.761op/s; 13324055.813op/s] or [-0.143%; +0.143%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [67.717µs; 67.759µs] or [-0.031%; +0.031%] None None None
credit_card/is_card_number/ 378282246310005 throughput [14758276.672op/s; 14767361.130op/s] or [-0.031%; +0.031%] None None None
credit_card/is_card_number/37828224631 execution_time [3.912µs; 3.913µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number/37828224631 throughput [255564129.316op/s; 255612320.202op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number/378282246310005 execution_time [64.486µs; 64.501µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number/378282246310005 throughput [15503761.326op/s; 15507187.991op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [45.047µs; 45.085µs] or [-0.041%; +0.041%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [22180703.325op/s; 22199034.934op/s] or [-0.041%; +0.041%] None None None
credit_card/is_card_number/x371413321323331 execution_time [6.035µs; 6.037µs] or [-0.014%; +0.014%] None None None
credit_card/is_card_number/x371413321323331 throughput [165655840.424op/s; 165701290.853op/s] or [-0.014%; +0.014%] None None None
credit_card/is_card_number_no_luhn/ execution_time [3.912µs; 3.913µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/ throughput [255589420.026op/s; 255637673.432op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [65.546µs; 65.575µs] or [-0.022%; +0.022%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [15249819.878op/s; 15256574.847op/s] or [-0.022%; +0.022%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [53.013µs; 53.022µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [18860140.074op/s; 18863358.182op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [3.912µs; 3.913µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [255579760.240op/s; 255633245.055op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [49.804µs; 49.816µs] or [-0.012%; +0.012%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [20073877.876op/s; 20078670.586op/s] or [-0.012%; +0.012%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [45.049µs; 45.085µs] or [-0.040%; +0.040%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [22180572.747op/s; 22198198.519op/s] or [-0.040%; +0.040%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [6.036µs; 6.039µs] or [-0.028%; +0.028%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [165592607.312op/s; 165684359.254op/s] or [-0.028%; +0.028%] None None None

Group 16

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 06257cf 1773651892 pin-github-actions-1773667913
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 160.756µs 161.824µs ± 0.299µs 161.794µs ± 0.132µs 161.926µs 162.230µs 162.451µs 164.561µs 1.71% 3.777 34.170 0.18% 0.021µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [161.782µs; 161.865µs] or [-0.026%; +0.026%] None None None

Group 17

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 06257cf 1773651892 pin-github-actions-1773667913
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 241.647ns 253.607ns ± 12.950ns 247.657ns ± 3.363ns 256.923ns 282.672ns 289.942ns 293.792ns 18.63% 1.518 1.081 5.09% 0.916ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [251.812ns; 255.401ns] or [-0.708%; +0.708%] None None None

Group 18

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 06257cf 1773651892 pin-github-actions-1773667913
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 533.935µs 534.632µs ± 0.373µs 534.574µs ± 0.276µs 534.907µs 535.265µs 535.595µs 535.858µs 0.24% 0.477 -0.140 0.07% 0.026µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1866165.217op/s 1870445.805op/s ± 1302.874op/s 1870649.228op/s ± 964.597op/s 1871403.122op/s 1872328.260op/s 1872701.160op/s 1872885.911op/s 0.12% -0.474 -0.146 0.07% 92.127op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 381.529µs 382.373µs ± 0.561µs 382.310µs ± 0.245µs 382.554µs 382.972µs 384.347µs 386.608µs 1.12% 4.074 25.839 0.15% 0.040µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2586598.183op/s 2615253.171op/s ± 3817.481op/s 2615681.798op/s ± 1676.503op/s 2617352.782op/s 2618962.172op/s 2620203.245op/s 2621029.752op/s 0.20% -4.025 25.367 0.15% 269.937op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 194.067µs 194.526µs ± 0.231µs 194.491µs ± 0.142µs 194.683µs 194.909µs 195.191µs 195.330µs 0.43% 0.598 0.520 0.12% 0.016µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5119539.910op/s 5140705.958op/s ± 6094.404op/s 5141621.569op/s ± 3755.462op/s 5144750.256op/s 5149501.514op/s 5152613.818op/s 5152867.266op/s 0.22% -0.590 0.504 0.12% 430.939op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 36.031µs 36.192µs ± 0.072µs 36.185µs ± 0.049µs 36.241µs 36.307µs 36.363µs 36.444µs 0.72% 0.293 0.184 0.20% 0.005µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 27439328.727op/s 27630221.167op/s ± 55123.726op/s 27635554.380op/s ± 37515.661op/s 27667418.402op/s 27716539.007op/s 27747012.441op/s 27753843.190op/s 0.43% -0.281 0.168 0.20% 3897.836op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 44.887µs 45.085µs ± 0.186µs 45.074µs ± 0.160µs 45.217µs 45.327µs 45.376µs 46.510µs 3.19% 2.316 15.247 0.41% 0.013µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 21500526.524op/s 22180827.557op/s ± 90692.020op/s 22185864.794op/s ± 78513.460op/s 22270068.502op/s 22277017.359op/s 22277736.912op/s 22278104.510op/s 0.42% -2.175 13.844 0.41% 6412.894op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [534.581µs; 534.684µs] or [-0.010%; +0.010%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1870265.239op/s; 1870626.370op/s] or [-0.010%; +0.010%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [382.295µs; 382.451µs] or [-0.020%; +0.020%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2614724.105op/s; 2615782.237op/s] or [-0.020%; +0.020%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [194.494µs; 194.558µs] or [-0.016%; +0.016%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5139861.332op/s; 5141550.584op/s] or [-0.016%; +0.016%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [36.182µs; 36.202µs] or [-0.028%; +0.028%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [27622581.549op/s; 27637860.786op/s] or [-0.028%; +0.028%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [45.059µs; 45.111µs] or [-0.057%; +0.057%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [22168258.515op/s; 22193396.599op/s] or [-0.057%; +0.057%] None None None

Group 19

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 06257cf 1773651892 pin-github-actions-1773667913
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 33.060µs 33.556µs ± 0.850µs 33.156µs ± 0.047µs 33.308µs 35.384µs 35.412µs 36.586µs 10.35% 1.740 1.237 2.53% 0.060µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [33.438µs; 33.674µs] or [-0.351%; +0.351%] None None None

Baseline

Omitted due to size.

@dd-octo-sts
Copy link
Contributor

dd-octo-sts bot commented Mar 16, 2026 •
edited
Loading

Artifact Size Benchmark Report

aarch64-alpine-linux-musl
Artifact Baseline Commit Change
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.a 100.39 MB 100.39 MB 0% (0 B) 👌
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.so 8.70 MB 8.70 MB 0% (0 B) 👌
aarch64-unknown-linux-gnu
Artifact Baseline Commit Change
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.a 117.08 MB 117.08 MB 0% (0 B) 👌
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.so 11.28 MB 11.28 MB 0% (0 B) 👌
libdatadog-x64-windows
Artifact Baseline Commit Change
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.dll 27.18 MB 27.18 MB 0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.lib 76.61 KB 76.61 KB 0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.pdb 186.16 MB 186.16 MB 0% (0 B) 👌
/libdatadog-x64-windows/debug/static/datadog_profiling_ffi.lib 917.36 MB 917.36 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.dll 9.94 MB 9.94 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.lib 76.61 KB 76.61 KB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.pdb 24.78 MB 24.78 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/static/datadog_profiling_ffi.lib 51.46 MB 51.46 MB 0% (0 B) 👌
libdatadog-x86-windows
Artifact Baseline Commit Change
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.dll 22.97 MB 22.97 MB 0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.lib 77.80 KB 77.80 KB 0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.pdb 190.30 MB 190.30 MB 0% (0 B) 👌
/libdatadog-x86-windows/debug/static/datadog_profiling_ffi.lib 901.02 MB 901.02 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.dll 7.54 MB 7.54 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.lib 77.80 KB 77.80 KB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.pdb 26.53 MB 26.53 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/static/datadog_profiling_ffi.lib 47.08 MB 47.08 MB 0% (0 B) 👌
x86_64-alpine-linux-musl
Artifact Baseline Commit Change
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.a 87.60 MB 87.60 MB 0% (0 B) 👌
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.so 10.22 MB 10.22 MB 0% (0 B) 👌
x86_64-apple-darwin
Artifact Baseline Commit Change
/x86_64-apple-darwin/lib/libdatadog_profiling.a 69.42 MB 69.42 MB 0% (0 B) 👌
/x86_64-apple-darwin/lib/libdatadog_profiling.dylib 10.94 MB 10.94 MB 0% (0 B) 👌
x86_64-unknown-linux-gnu
Artifact Baseline Commit Change
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.a 109.95 MB 109.95 MB 0% (0 B) 👌
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.so 11.96 MB 11.96 MB 0% (0 B) 👌

@JulesDT JulesDT changed the title [Security] Pin GitHub Actions to a full-length commit SHA ci: pin GitHub Actions to full-length commit SHA Mar 17, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

ci-build

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@juliendoutre @codecov-commenter