Speed up the JavaScript evaluator port with codegen#689
Conversation
Signed-off-by: Juan Cruz Viotti <jv@jviotti.com>
🤖 Augment PR SummarySummary: This PR accelerates the JavaScript Blaze evaluator by generating a specialized “native” validator function for eligible templates. Changes:
Technical Notes: Native codegen is gated to templates without tracking/dynamic features and falls back to the interpreter if codegen fails or throws. 🤖 Was this summary useful? React with 👍 or 👎 |
| if (evaluator.callbackMode) evaluator.callbackPop(instruction, false); | ||
| return false; | ||
| } | ||
| const __result = URI_REGEX.test(target); |
There was a problem hiding this comment.
AssertionStringType now uses URI_REGEX, but this regex appears too permissive for JSON Schema format: "uri" (it would accept strings with backslashes, quotes, {}, <>, non‑ASCII like ®, etc. that the JSON Schema test suite marks invalid). This is likely to change validation results and fail the format/uri conformance cases.
Severity: high
Other Locations
ports/javascript/index.mjs:3137
🤖 Was this useful? React with 👍 or 👎, or 🚀 if it prevented an incident/outage.
| body += 'return true;'; | ||
|
|
||
| try { | ||
| const fn = eval( |
There was a problem hiding this comment.
generateNativeValidator uses eval to build a validator from (potentially user-supplied) schema-derived templates; please double-check that all schema-controlled literals are safely encoded so the emitted source can’t be influenced into arbitrary code execution. Also note that some environments forbid eval (CSP / hardened runtimes), so it’s important that the fallback path remains correct and well-covered.
Severity: medium
🤖 Was this useful? React with 👍 or 👎, or 🚀 if it prevented an incident/outage.
| } | ||
|
|
||
| validate(instance, callback) { | ||
| if (callback === undefined && this._nativeValidate) { |
There was a problem hiding this comment.
The native fast-path (return this._nativeValidate(instance, this)) bypasses the usual per-call setup/teardown (including resetting the module-scoped evaluateInstruction), so a prior call in callback/tracked mode could leave evaluateInstruction pointing at a callback/tracked variant during native validation. Since some fast handlers recurse via the global evaluateInstruction, this can cause native validation to unexpectedly run the slower/side-effecting evaluator mode or depend on evaluator state that wasn’t initialized for this call.
Severity: medium
🤖 Was this useful? React with 👍 or 👎, or 🚀 if it prevented an incident/outage.
| } | ||
|
|
||
| instruction.push(handlers[instruction[0]] || null); | ||
| instruction.push(handlers[opcode] || null); |
There was a problem hiding this comment.
prepareInstruction still appends a handler function to each instruction (instruction.push(handlers[opcode] || null)), but the evaluators no longer read instruction[7] anywhere in this file. If this is now unused, it’s extra per-template work/memory and may be accidental given the new fastHandlers dispatch.
Severity: low
🤖 Was this useful? React with 👍 or 👎, or 🚀 if it prevented an incident/outage.
There was a problem hiding this comment.
Benchmark (linux/llvm)
Details
| Benchmark suite | Current: 873e997 | Previous: 307e9fd | Ratio |
|---|---|---|---|
E2E_Compiler_adaptivecard |
64657132.11110192 ns/iter |
65195252.88889049 ns/iter |
0.99 |
E2E_Compiler_ansible_meta |
29348072.00000004 ns/iter |
29494237.583333433 ns/iter |
1.00 |
E2E_Compiler_aws_cdk |
378117.9018338508 ns/iter |
380988.7273712844 ns/iter |
0.99 |
E2E_Compiler_babelrc |
2590164.25830243 ns/iter |
2572672.514705734 ns/iter |
1.01 |
E2E_Compiler_clang_format |
18396817.02631424 ns/iter |
18329037.57894811 ns/iter |
1.00 |
E2E_Compiler_cmake_presets |
26010041.851851318 ns/iter |
25355927.035714593 ns/iter |
1.03 |
E2E_Compiler_code_climate |
2554684.5201466107 ns/iter |
2574638.9742647912 ns/iter |
0.99 |
E2E_Compiler_cql2 |
12795633.96363673 ns/iter |
12728405.89090885 ns/iter |
1.01 |
E2E_Compiler_cspell |
22563203.70967783 ns/iter |
22972348.129032537 ns/iter |
0.98 |
E2E_Compiler_cypress |
3888252.5611111554 ns/iter |
3884687.04444449 ns/iter |
1.00 |
E2E_Compiler_deno |
7932514.714285629 ns/iter |
7721226.978022029 ns/iter |
1.03 |
E2E_Compiler_dependabot |
3868771.071823487 ns/iter |
3905490.994413207 ns/iter |
0.99 |
E2E_Compiler_draft_04 |
2672258.0957854684 ns/iter |
2696736.6384614985 ns/iter |
0.99 |
E2E_Compiler_fabric_mod |
4731338.148648522 ns/iter |
4753991.755102388 ns/iter |
1.00 |
E2E_Compiler_geojson |
22142358.093748983 ns/iter |
21974448.7499991 ns/iter |
1.01 |
E2E_Compiler_gitpod_configuration |
4909100.363635742 ns/iter |
4926287.746478708 ns/iter |
1.00 |
E2E_Compiler_helm_chart_lock |
702061.5813252814 ns/iter |
712991.2983706823 ns/iter |
0.98 |
E2E_Compiler_importmap |
286773.5738845277 ns/iter |
288176.35822733486 ns/iter |
1.00 |
E2E_Compiler_jasmine |
1362941.8284599753 ns/iter |
1371510.38326848 ns/iter |
0.99 |
E2E_Compiler_jshintrc |
4379632.881250473 ns/iter |
4367002.9687501 ns/iter |
1.00 |
E2E_Compiler_jsconfig |
21807584.90625223 ns/iter |
21741016.40624926 ns/iter |
1.00 |
E2E_Compiler_krakend |
145711165.00001153 ns/iter |
138005852.99999285 ns/iter |
1.06 |
E2E_Compiler_lazygit |
33533111.14285805 ns/iter |
33254050.142856855 ns/iter |
1.01 |
E2E_Compiler_lerna |
1589542.0364079068 ns/iter |
1592700.2551252726 ns/iter |
1.00 |
E2E_Compiler_nest_cli |
7427243.797872294 ns/iter |
7416924.484210827 ns/iter |
1.00 |
E2E_Compiler_omc |
154904807.7500004 ns/iter |
154299106.25000787 ns/iter |
1.00 |
E2E_Compiler_omnisharp |
6742497.942307925 ns/iter |
6707883.933332986 ns/iter |
1.01 |
E2E_Compiler_openapi |
24898214.178571314 ns/iter |
24897411.57142841 ns/iter |
1.00 |
E2E_Compiler_pre_commit_hooks |
5305811.643938969 ns/iter |
5333881.803030687 ns/iter |
0.99 |
E2E_Compiler_pulumi |
4039663.5664743534 ns/iter |
4025052.687861349 ns/iter |
1.00 |
E2E_Compiler_semantic_release |
1562268.8411634122 ns/iter |
1573940.2690582976 ns/iter |
0.99 |
E2E_Compiler_stale |
1557490.0917226537 ns/iter |
1561362.1444443502 ns/iter |
1.00 |
E2E_Compiler_stylecop |
6216281.017543679 ns/iter |
6204070.911504576 ns/iter |
1.00 |
E2E_Compiler_tmuxinator |
1915652.2320443434 ns/iter |
1931481.4049587105 ns/iter |
0.99 |
E2E_Compiler_ui5 |
48282438.71428738 ns/iter |
46284396.73333181 ns/iter |
1.04 |
E2E_Compiler_ui5_manifest |
333323436.4999953 ns/iter |
307108534.00000817 ns/iter |
1.09 |
E2E_Compiler_unreal_engine_uproject |
4619268.098684422 ns/iter |
4592362.855263251 ns/iter |
1.01 |
E2E_Compiler_vercel |
12348724.350878209 ns/iter |
12269249.368421042 ns/iter |
1.01 |
E2E_Compiler_yamllint |
351239.2311935607 ns/iter |
350227.52773611475 ns/iter |
1.00 |
E2E_Evaluator_adaptivecard |
24986.32929393839 ns/iter |
24662.683049041236 ns/iter |
1.01 |
E2E_Evaluator_ansible_meta |
228553.22116334728 ns/iter |
227712.1759740317 ns/iter |
1.00 |
E2E_Evaluator_aws_cdk |
50383.61631441125 ns/iter |
49760.94120171457 ns/iter |
1.01 |
E2E_Evaluator_babelrc |
112176.90411819605 ns/iter |
111607.63468281753 ns/iter |
1.01 |
E2E_Evaluator_cerebrum_criminal_case |
1218797.7367492726 ns/iter |
1216833.5201400446 ns/iter |
1.00 |
E2E_Evaluator_clang_format |
126667.55494014831 ns/iter |
126201.48278985481 ns/iter |
1.00 |
E2E_Evaluator_cmake_presets |
4464787.190789372 ns/iter |
4282669.952095932 ns/iter |
1.04 |
E2E_Evaluator_code_climate |
170151.0055717007 ns/iter |
167981.06587838577 ns/iter |
1.01 |
E2E_Evaluator_cql2 |
216986.84363176743 ns/iter |
223559.0544476197 ns/iter |
0.97 |
E2E_Evaluator_cspell |
548097.442958314 ns/iter |
542998.3307393253 ns/iter |
1.01 |
E2E_Evaluator_cypress |
192340.1585866986 ns/iter |
192648.77574432775 ns/iter |
1.00 |
E2E_Evaluator_deno |
312559.6545292735 ns/iter |
311229.23868677294 ns/iter |
1.00 |
E2E_Evaluator_dependabot |
414439.21140141936 ns/iter |
412140.7119146251 ns/iter |
1.01 |
E2E_Evaluator_draft_04 |
8216848.430232551 ns/iter |
7533126.358695866 ns/iter |
1.09 |
E2E_Evaluator_fabric_mod |
744192.0858017473 ns/iter |
711510.3716904271 ns/iter |
1.05 |
E2E_Evaluator_geojson |
16428501.428571334 ns/iter |
16593412.666666264 ns/iter |
0.99 |
E2E_Evaluator_gitpod_configuration |
228955.20927198522 ns/iter |
229677.95741273605 ns/iter |
1.00 |
E2E_Evaluator_helm_chart_lock |
354900.5690355868 ns/iter |
356457.8261748516 ns/iter |
1.00 |
E2E_Evaluator_importmap |
48838.187431549646 ns/iter |
47704.51611773081 ns/iter |
1.02 |
E2E_Evaluator_jasmine |
118382.41359447544 ns/iter |
115029.47770491603 ns/iter |
1.03 |
E2E_Evaluator_jshintrc |
1195548.213310724 ns/iter |
1196538.7650085366 ns/iter |
1.00 |
E2E_Evaluator_jsconfig |
427971.52120463696 ns/iter |
427864.22032868076 ns/iter |
1.00 |
E2E_Evaluator_krakend |
204013.7626025801 ns/iter |
209381.70275821848 ns/iter |
0.97 |
E2E_Evaluator_lazygit |
148658.45372088437 ns/iter |
144219.4655315665 ns/iter |
1.03 |
E2E_Evaluator_lerna |
145443.2656985843 ns/iter |
136692.0007789673 ns/iter |
1.06 |
E2E_Evaluator_nest_cli |
179992.48520408984 ns/iter |
177396.31100355965 ns/iter |
1.01 |
E2E_Evaluator_omc |
19433.65612455323 ns/iter |
18997.201625567443 ns/iter |
1.02 |
E2E_Evaluator_omnisharp |
609918.8993875654 ns/iter |
609480.3567099731 ns/iter |
1.00 |
E2E_Evaluator_openapi |
13776491.877551127 ns/iter |
12858784.260000674 ns/iter |
1.07 |
E2E_Evaluator_pre_commit_hooks |
471848.55399996194 ns/iter |
471615.42119380384 ns/iter |
1.00 |
E2E_Evaluator_pulumi |
705140.0810536572 ns/iter |
703956.5801838702 ns/iter |
1.00 |
E2E_Evaluator_semantic_release |
101546.06082761806 ns/iter |
101841.16040028118 ns/iter |
1.00 |
E2E_Evaluator_stale |
152166.9303181214 ns/iter |
149355.53162938473 ns/iter |
1.02 |
E2E_Evaluator_stylecop |
286103.26919935865 ns/iter |
281000.0676328319 ns/iter |
1.02 |
E2E_Evaluator_tmuxinator |
97078.9187448581 ns/iter |
96528.3085761221 ns/iter |
1.01 |
E2E_Evaluator_ui5 |
494166.94710513554 ns/iter |
500403.453257801 ns/iter |
0.99 |
E2E_Evaluator_ui5_manifest |
2477436.0964288786 ns/iter |
2503492.59642856 ns/iter |
0.99 |
E2E_Evaluator_unreal_engine_uproject |
432386.9888614325 ns/iter |
431486.8978327966 ns/iter |
1.00 |
E2E_Evaluator_vercel |
311017.03571424977 ns/iter |
313617.24722592527 ns/iter |
0.99 |
E2E_Evaluator_yamllint |
8349.106922275727 ns/iter |
8652.103733730646 ns/iter |
0.96 |
Micro_Draft4_Meta_1_No_Callback |
192.195472349381 ns/iter |
191.2588239470906 ns/iter |
1.00 |
Micro_Draft4_Required_Properties |
844.4057910642842 ns/iter |
847.288524151465 ns/iter |
1.00 |
Micro_Draft4_Many_Optional_Properties_Minimal_Match |
21.472569403172276 ns/iter |
21.372317259549057 ns/iter |
1.00 |
Micro_Draft4_Few_Optional_Properties_Minimal_Match |
11.241508449064881 ns/iter |
11.270639748135366 ns/iter |
1.00 |
Micro_Draft4_Items_Schema |
280.21414796645035 ns/iter |
288.19199981914477 ns/iter |
0.97 |
Micro_Draft4_Nested_Object |
1.7895704286371708 ns/iter |
1.779793596930528 ns/iter |
1.01 |
Micro_Draft4_Properties_Triad_Optional |
329.9518602802993 ns/iter |
330.2083285884198 ns/iter |
1.00 |
Micro_Draft4_Properties_Triad_Closed |
266.8926555700211 ns/iter |
268.376065483322 ns/iter |
0.99 |
Micro_Draft4_Properties_Triad_Required |
334.79560157280844 ns/iter |
335.22589541877676 ns/iter |
1.00 |
Micro_Draft4_Properties_Closed |
59.223778919657796 ns/iter |
54.83968381091324 ns/iter |
1.08 |
Micro_Draft4_Non_Recursive_Ref |
14.398025902060876 ns/iter |
14.323583243620567 ns/iter |
1.01 |
Micro_Draft4_Pattern_Properties_True |
157.179732260754 ns/iter |
157.22100870342555 ns/iter |
1.00 |
Micro_Draft4_Ref_To_Single_Property |
11.208627806544957 ns/iter |
11.274319633038289 ns/iter |
0.99 |
Micro_Draft4_Additional_Properties_Type |
28.33666746515252 ns/iter |
28.345794668459003 ns/iter |
1.00 |
Micro_Draft4_Nested_Oneof |
56.360407931799735 ns/iter |
56.63683712817893 ns/iter |
1.00 |
Micro_Draft4_Short_Enum |
14.171226292776582 ns/iter |
14.197928110021941 ns/iter |
1.00 |
Micro_Draft4_Long_Enum |
14.99947542843222 ns/iter |
14.779612849678932 ns/iter |
1.01 |
Micro_Draft4_Long_Enum_Short_Strings |
14.060476969879089 ns/iter |
14.07241221491402 ns/iter |
1.00 |
Micro_Draft4_Type_Object |
3.773186651832631 ns/iter |
3.7467826755593663 ns/iter |
1.01 |
Micro_Draft4_Ref_Single_100 |
2334979.3344481364 ns/iter |
2353460.986532059 ns/iter |
0.99 |
Micro_Draft4_Compile_Ref_Many_Nested |
1701674.9781552649 ns/iter |
1707369.6430317087 ns/iter |
1.00 |
Micro_Draft4_Compile_Wrap |
2353409.826666848 ns/iter |
2347206.3779261736 ns/iter |
1.00 |
Micro_Draft6_Property_Names |
134.77352685764765 ns/iter |
134.45674692897492 ns/iter |
1.00 |
Micro_Draft6_Compile_FHIR |
14092149468.999992 ns/iter |
13909588743.999962 ns/iter |
1.01 |
Micro_Draft7_If_Then_Else |
24.076675830225163 ns/iter |
24.047405129743982 ns/iter |
1.00 |
Micro_2019_09_Unevaluated_Properties |
27.418137781100654 ns/iter |
27.426331800039588 ns/iter |
1.00 |
Micro_2019_09_Compile_Wrap |
297330774.99997765 ns/iter |
285911692.0000133 ns/iter |
1.04 |
Micro_2019_09_KrakenD_Linter_Check |
1196631682.9999642 ns/iter |
1178850413.0000775 ns/iter |
1.02 |
Micro_2019_09_KrakenD_Linter_Apply |
10494006269.00001 ns/iter |
10300887171 ns/iter |
1.02 |
Micro_2020_12_Dynamic_Ref |
226.05865167306195 ns/iter |
226.4713153770237 ns/iter |
1.00 |
Micro_2020_12_Dynamic_Ref_Single |
3.4268249915074587 ns/iter |
3.4243523870522017 ns/iter |
1.00 |
Micro_2020_12_Simple_Output_Mask |
65900.62968516746 ns/iter |
66552.64390058292 ns/iter |
0.99 |
Micro_2020_12_Simple_Output_Annotations |
102558.59574160924 ns/iter |
103708.24146484636 ns/iter |
0.99 |
Micro_2020_12_Compile_NonCircular_Shared_Refs |
1106294.6534810301 ns/iter |
1109792.125786221 ns/iter |
1.00 |
Micro_2020_12_Exhaustive_Deep_Numeric |
8146.135470337042 ns/iter |
8830.123278772362 ns/iter |
0.92 |
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput |
183342.35116279192 ns/iter |
181527.28144330176 ns/iter |
1.01 |
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput |
22145.606045165376 ns/iter |
22882.61451402448 ns/iter |
0.97 |
Micro_2020_12_Exhaustive_Deep_Numeric_Fail |
141.9196725533629 ns/iter |
143.96964174944821 ns/iter |
0.99 |
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput |
4262.942896619612 ns/iter |
4336.311864888501 ns/iter |
0.98 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
JavaScript (linux/llvm)
Details
| Benchmark suite | Current: 873e997 | Previous: 307e9fd | Ratio |
|---|---|---|---|
E2E_Evaluator_adaptivecard |
118825 ns |
131901 ns |
0.90 |
E2E_Evaluator_ansible-meta |
580957 ns |
1223183 ns |
0.47 |
E2E_Evaluator_aws-cdk |
137826 ns |
258548 ns |
0.53 |
E2E_Evaluator_babelrc |
340206 ns |
550034 ns |
0.62 |
E2E_Evaluator_cerebrum-criminal-case |
2568946 ns |
5127770 ns |
0.50 |
E2E_Evaluator_clang-format |
290263 ns |
191514 ns |
1.52 |
E2E_Evaluator_cmake-presets |
20201939 ns |
20379283 ns |
0.99 |
E2E_Evaluator_code-climate |
436948 ns |
977173 ns |
0.45 |
E2E_Evaluator_cql2 |
1203327 ns |
1376619 ns |
0.87 |
E2E_Evaluator_cspell |
1596847 ns |
2265729 ns |
0.70 |
E2E_Evaluator_cypress |
864108 ns |
620301 ns |
1.39 |
E2E_Evaluator_deno |
1098928 ns |
1161838 ns |
0.95 |
E2E_Evaluator_dependabot |
1087720 ns |
1909925 ns |
0.57 |
E2E_Evaluator_draft-04 |
21506701 ns |
24127530 ns |
0.89 |
E2E_Evaluator_fabric-mod |
2506464 ns |
3824990 ns |
0.66 |
E2E_Evaluator_geojson |
20885704 ns |
71842281 ns |
0.29 |
E2E_Evaluator_gitpod-configuration |
770205 ns |
1207297 ns |
0.64 |
E2E_Evaluator_helm-chart-lock |
998654 ns |
1848338 ns |
0.54 |
E2E_Evaluator_importmap |
275563 ns |
552017 ns |
0.50 |
E2E_Evaluator_jasmine |
304259 ns |
666799 ns |
0.46 |
E2E_Evaluator_jsconfig |
1371871 ns |
1723507 ns |
0.80 |
E2E_Evaluator_jshintrc |
3142509 ns |
2145375 ns |
1.46 |
E2E_Evaluator_krakend |
764759 ns |
830448 ns |
0.92 |
E2E_Evaluator_lazygit |
565466 ns |
620714 ns |
0.91 |
E2E_Evaluator_lerna |
469782 ns |
678776 ns |
0.69 |
E2E_Evaluator_nest-cli |
633754 ns |
1138077 ns |
0.56 |
E2E_Evaluator_omc |
85052 ns |
117074 ns |
0.73 |
E2E_Evaluator_omnisharp |
1595580 ns |
1429941 ns |
1.12 |
E2E_Evaluator_openapi |
38634583 ns |
46044781 ns |
0.84 |
E2E_Evaluator_pre-commit-hooks |
2003012 ns |
2029871 ns |
0.99 |
E2E_Evaluator_pulumi |
1968570 ns |
3484597 ns |
0.56 |
E2E_Evaluator_semantic-release |
263497 ns |
642103 ns |
0.41 |
E2E_Evaluator_stale |
423094 ns |
737591 ns |
0.57 |
E2E_Evaluator_stylecop |
1231129 ns |
1340701 ns |
0.92 |
E2E_Evaluator_tmuxinator |
228417 ns |
484533 ns |
0.47 |
E2E_Evaluator_ui5 |
2270311 ns |
2959157 ns |
0.77 |
E2E_Evaluator_ui5-manifest |
11199212 ns |
11758797 ns |
0.95 |
E2E_Evaluator_unreal-engine-uproject |
1526012 ns |
2048917 ns |
0.74 |
E2E_Evaluator_vercel |
1062290 ns |
1385887 ns |
0.77 |
E2E_Evaluator_yamllint |
25035 ns |
139472 ns |
0.18 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Benchmark (linux/gcc)
Details
| Benchmark suite | Current: 873e997 | Previous: 307e9fd | Ratio |
|---|---|---|---|
Micro_2020_12_Dynamic_Ref |
261.21186541320475 ns/iter |
276.67751900682634 ns/iter |
0.94 |
Micro_2020_12_Dynamic_Ref_Single |
4.983657987639407 ns/iter |
4.981425840973916 ns/iter |
1.00 |
Micro_2020_12_Simple_Output_Mask |
74056.9753558549 ns/iter |
74233.49278768951 ns/iter |
1.00 |
Micro_2020_12_Simple_Output_Annotations |
113584.67502047865 ns/iter |
113219.38826588131 ns/iter |
1.00 |
Micro_2020_12_Compile_NonCircular_Shared_Refs |
1210294.7659209562 ns/iter |
1211575.2991303452 ns/iter |
1.00 |
Micro_2020_12_Exhaustive_Deep_Numeric |
8462.145156817276 ns/iter |
8469.49641415249 ns/iter |
1.00 |
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput |
167339.5595954605 ns/iter |
168094.72701079948 ns/iter |
1.00 |
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput |
25297.740088584775 ns/iter |
25783.490447522447 ns/iter |
0.98 |
Micro_2020_12_Exhaustive_Deep_Numeric_Fail |
127.36387914606252 ns/iter |
127.72958775347799 ns/iter |
1.00 |
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput |
4815.428708891212 ns/iter |
4811.529727990468 ns/iter |
1.00 |
Micro_2019_09_Unevaluated_Properties |
29.962758263221666 ns/iter |
29.949531637232283 ns/iter |
1.00 |
Micro_2019_09_Compile_Wrap |
308450010.4999961 ns/iter |
332231402.49992865 ns/iter |
0.93 |
Micro_2019_09_KrakenD_Linter_Check |
1222572226.0000112 ns/iter |
1332339361.000095 ns/iter |
0.92 |
Micro_2019_09_KrakenD_Linter_Apply |
10909382753.999922 ns/iter |
12002329343.999918 ns/iter |
0.91 |
Micro_Draft7_If_Then_Else |
24.292467689781585 ns/iter |
24.29204212394416 ns/iter |
1.00 |
Micro_Draft6_Property_Names |
148.5428912185324 ns/iter |
148.53591856372083 ns/iter |
1.00 |
Micro_Draft6_Compile_FHIR |
13733373980.00001 ns/iter |
15181357024.999897 ns/iter |
0.90 |
Micro_Draft4_Meta_1_No_Callback |
167.35276250753415 ns/iter |
167.75115662256735 ns/iter |
1.00 |
Micro_Draft4_Required_Properties |
851.0817749368284 ns/iter |
870.5258606032548 ns/iter |
0.98 |
Micro_Draft4_Many_Optional_Properties_Minimal_Match |
20.89164438699971 ns/iter |
20.880685358724868 ns/iter |
1.00 |
Micro_Draft4_Few_Optional_Properties_Minimal_Match |
13.107791797410565 ns/iter |
13.09263383627186 ns/iter |
1.00 |
Micro_Draft4_Items_Schema |
349.5475540488285 ns/iter |
334.3954018768833 ns/iter |
1.05 |
Micro_Draft4_Nested_Object |
1.870694819518451 ns/iter |
1.8701344079442126 ns/iter |
1.00 |
Micro_Draft4_Properties_Triad_Optional |
492.5522921866467 ns/iter |
367.19861892075926 ns/iter |
1.34 |
Micro_Draft4_Properties_Triad_Closed |
392.0201681644465 ns/iter |
309.1922022114691 ns/iter |
1.27 |
Micro_Draft4_Properties_Triad_Required |
510.4664582032195 ns/iter |
391.3360268700425 ns/iter |
1.30 |
Micro_Draft4_Properties_Closed |
64.70698093262378 ns/iter |
64.23087021118091 ns/iter |
1.01 |
Micro_Draft4_Non_Recursive_Ref |
9.979719961752014 ns/iter |
9.974916474216895 ns/iter |
1.00 |
Micro_Draft4_Pattern_Properties_True |
227.88586938649087 ns/iter |
228.06338804397953 ns/iter |
1.00 |
Micro_Draft4_Ref_To_Single_Property |
13.09139623009553 ns/iter |
13.18448846596109 ns/iter |
0.99 |
Micro_Draft4_Additional_Properties_Type |
14.645062151027375 ns/iter |
14.651848760105311 ns/iter |
1.00 |
Micro_Draft4_Nested_Oneof |
66.42603987484425 ns/iter |
66.3213902932537 ns/iter |
1.00 |
Micro_Draft4_Short_Enum |
14.697202592863954 ns/iter |
14.643668834999705 ns/iter |
1.00 |
Micro_Draft4_Long_Enum |
14.665384140642141 ns/iter |
14.685816285180083 ns/iter |
1.00 |
Micro_Draft4_Long_Enum_Short_Strings |
14.753571102944102 ns/iter |
14.68762064149268 ns/iter |
1.00 |
Micro_Draft4_Type_Object |
4.678686303017377 ns/iter |
4.672271333482866 ns/iter |
1.00 |
Micro_Draft4_Ref_Single_100 |
2501899.6702506538 ns/iter |
2516342.390680454 ns/iter |
0.99 |
Micro_Draft4_Compile_Ref_Many_Nested |
1808660.1932989385 ns/iter |
1815077.083333468 ns/iter |
1.00 |
Micro_Draft4_Compile_Wrap |
2598418.0221403693 ns/iter |
2602181.684015505 ns/iter |
1.00 |
E2E_Compiler_adaptivecard |
64618079.63636477 ns/iter |
66420242.699996375 ns/iter |
0.97 |
E2E_Compiler_ansible_meta |
30187496.304348398 ns/iter |
30601192.913042285 ns/iter |
0.99 |
E2E_Compiler_aws_cdk |
416249.8120525212 ns/iter |
418575.5254035232 ns/iter |
0.99 |
E2E_Compiler_babelrc |
2785381.478087587 ns/iter |
2790720.258964569 ns/iter |
1.00 |
E2E_Compiler_clang_format |
19622576.08333415 ns/iter |
19684310.80555572 ns/iter |
1.00 |
E2E_Compiler_cmake_presets |
27441312.19999872 ns/iter |
27199860.15999893 ns/iter |
1.01 |
E2E_Compiler_code_climate |
2776523.763052492 ns/iter |
2789910.780876992 ns/iter |
1.00 |
E2E_Compiler_cql2 |
13913625.239999874 ns/iter |
14224706.84000018 ns/iter |
0.98 |
E2E_Compiler_cspell |
23949320.379313514 ns/iter |
24292257.034481924 ns/iter |
0.99 |
E2E_Compiler_cypress |
4209654.34319541 ns/iter |
4144769.374999582 ns/iter |
1.02 |
E2E_Compiler_deno |
8267104.554216168 ns/iter |
8313435.845239036 ns/iter |
0.99 |
E2E_Compiler_dependabot |
4176980.909638664 ns/iter |
4183693.0898192762 ns/iter |
1.00 |
E2E_Compiler_draft_04 |
2942638.168067448 ns/iter |
2945475.6722684996 ns/iter |
1.00 |
E2E_Compiler_fabric_mod |
5149945.786764179 ns/iter |
5149227.933822645 ns/iter |
1.00 |
E2E_Compiler_geojson |
23942848.620690867 ns/iter |
23995523.41379102 ns/iter |
1.00 |
E2E_Compiler_gitpod_configuration |
5302869.458646421 ns/iter |
5320489.053031686 ns/iter |
1.00 |
E2E_Compiler_helm_chart_lock |
756386.9644012714 ns/iter |
756888.7039473549 ns/iter |
1.00 |
E2E_Compiler_importmap |
315277.42627347866 ns/iter |
313623.3061772082 ns/iter |
1.01 |
E2E_Compiler_jasmine |
1483685.1170210799 ns/iter |
1473905.9851692826 ns/iter |
1.01 |
E2E_Compiler_jshintrc |
4729252.7074831715 ns/iter |
4708222.932886934 ns/iter |
1.00 |
E2E_Compiler_jsconfig |
23494883.133332677 ns/iter |
23530905.366662104 ns/iter |
1.00 |
E2E_Compiler_krakend |
144241934.80001575 ns/iter |
151126827.79999885 ns/iter |
0.95 |
E2E_Compiler_lazygit |
35829673.45000156 ns/iter |
36113358.78947916 ns/iter |
0.99 |
E2E_Compiler_lerna |
1762310.2135678607 ns/iter |
1740472.3017458725 ns/iter |
1.01 |
E2E_Compiler_nest_cli |
8090749.045977488 ns/iter |
7990548.999998736 ns/iter |
1.01 |
E2E_Compiler_omc |
163056518.49998525 ns/iter |
168140293.50001648 ns/iter |
0.97 |
E2E_Compiler_omnisharp |
7217100.632652657 ns/iter |
7171883.58163296 ns/iter |
1.01 |
E2E_Compiler_openapi |
27161134.192309733 ns/iter |
27291408.7307754 ns/iter |
1.00 |
E2E_Compiler_pre_commit_hooks |
5718102.60655769 ns/iter |
5721860.024589689 ns/iter |
1.00 |
E2E_Compiler_pulumi |
4385194.025000061 ns/iter |
4382180.081249488 ns/iter |
1.00 |
E2E_Compiler_semantic_release |
1713296.5682926292 ns/iter |
1710065.1246944342 ns/iter |
1.00 |
E2E_Compiler_stale |
1695919.6658597682 ns/iter |
1674660.7566264756 ns/iter |
1.01 |
E2E_Compiler_stylecop |
6424731.743119424 ns/iter |
6351066.100918565 ns/iter |
1.01 |
E2E_Compiler_tmuxinator |
2124860.8878787914 ns/iter |
2104251.6960487305 ns/iter |
1.01 |
E2E_Compiler_ui5 |
48685721.07143011 ns/iter |
50632314.900008164 ns/iter |
0.96 |
E2E_Compiler_ui5_manifest |
320784818.99998224 ns/iter |
331547217.00009304 ns/iter |
0.97 |
E2E_Compiler_unreal_engine_uproject |
4965365.411347657 ns/iter |
4938854.2957757 ns/iter |
1.01 |
E2E_Compiler_vercel |
13279701.22641537 ns/iter |
13242222.679245284 ns/iter |
1.00 |
E2E_Compiler_yamllint |
388112.0632562834 ns/iter |
381504.86764702306 ns/iter |
1.02 |
E2E_Evaluator_adaptivecard |
23936.27798205974 ns/iter |
23974.29895740848 ns/iter |
1.00 |
E2E_Evaluator_ansible_meta |
247293.71195649594 ns/iter |
251819.76664276505 ns/iter |
0.98 |
E2E_Evaluator_aws_cdk |
51595.484219949336 ns/iter |
52739.99196455793 ns/iter |
0.98 |
E2E_Evaluator_babelrc |
109869.14654106736 ns/iter |
111221.46521955499 ns/iter |
0.99 |
E2E_Evaluator_cerebrum_criminal_case |
1292731.806985238 ns/iter |
1302881.1743969764 ns/iter |
0.99 |
E2E_Evaluator_clang_format |
110864.9357754441 ns/iter |
111794.43195926082 ns/iter |
0.99 |
E2E_Evaluator_cmake_presets |
4496389.269230751 ns/iter |
4749511.95804135 ns/iter |
0.95 |
E2E_Evaluator_code_climate |
185184.6355389464 ns/iter |
189333.41874665432 ns/iter |
0.98 |
E2E_Evaluator_cql2 |
213458.1272395852 ns/iter |
217284.6218692459 ns/iter |
0.98 |
E2E_Evaluator_cspell |
542462.110099331 ns/iter |
541055.694247271 ns/iter |
1.00 |
E2E_Evaluator_cypress |
183201.13989501307 ns/iter |
183828.71871710438 ns/iter |
1.00 |
E2E_Evaluator_deno |
332931.83555771457 ns/iter |
333462.78277331404 ns/iter |
1.00 |
E2E_Evaluator_dependabot |
465437.81624499627 ns/iter |
470662.57268423884 ns/iter |
0.99 |
E2E_Evaluator_draft_04 |
6875615.357142458 ns/iter |
7213500.303921548 ns/iter |
0.95 |
E2E_Evaluator_fabric_mod |
749807.1112310654 ns/iter |
750075.0590763686 ns/iter |
1.00 |
E2E_Evaluator_geojson |
15564738.88888882 ns/iter |
15792196.199997004 ns/iter |
0.99 |
E2E_Evaluator_gitpod_configuration |
251073.35001802354 ns/iter |
253788.82286747964 ns/iter |
0.99 |
E2E_Evaluator_helm_chart_lock |
324579.3928570949 ns/iter |
329308.4188432875 ns/iter |
0.99 |
E2E_Evaluator_importmap |
47979.25729223636 ns/iter |
49261.482220528465 ns/iter |
0.97 |
E2E_Evaluator_jasmine |
115746.73567558566 ns/iter |
118081.60304197043 ns/iter |
0.98 |
E2E_Evaluator_jshintrc |
1048283.0045113137 ns/iter |
1059194.9789157747 ns/iter |
0.99 |
E2E_Evaluator_jsconfig |
404458.0256708983 ns/iter |
404245.7465115688 ns/iter |
1.00 |
E2E_Evaluator_krakend |
212867.46007258864 ns/iter |
212662.83908401098 ns/iter |
1.00 |
E2E_Evaluator_lazygit |
138966.83539580755 ns/iter |
141299.96630544346 ns/iter |
0.98 |
E2E_Evaluator_lerna |
157050.09220017577 ns/iter |
157511.7029365022 ns/iter |
1.00 |
E2E_Evaluator_nest_cli |
197090.48142975912 ns/iter |
200057.7165866242 ns/iter |
0.99 |
E2E_Evaluator_omc |
19300.039415146945 ns/iter |
19688.7500070443 ns/iter |
0.98 |
E2E_Evaluator_omnisharp |
558150.4678455851 ns/iter |
558676.6824377431 ns/iter |
1.00 |
E2E_Evaluator_openapi |
12912479.999999959 ns/iter |
13731810.519232113 ns/iter |
0.94 |
E2E_Evaluator_pre_commit_hooks |
515652.5583090013 ns/iter |
510515.80600292527 ns/iter |
1.01 |
E2E_Evaluator_pulumi |
734295.7055150475 ns/iter |
732497.7829787887 ns/iter |
1.00 |
E2E_Evaluator_semantic_release |
101819.01741697405 ns/iter |
103648.03888161949 ns/iter |
0.98 |
E2E_Evaluator_stale |
165461.22377125698 ns/iter |
166157.42035500956 ns/iter |
1.00 |
E2E_Evaluator_stylecop |
308323.9870633839 ns/iter |
305632.23743891576 ns/iter |
1.01 |
E2E_Evaluator_tmuxinator |
98192.99763593577 ns/iter |
97864.65063432998 ns/iter |
1.00 |
E2E_Evaluator_ui5 |
538097.4354838657 ns/iter |
544367.1287820535 ns/iter |
0.99 |
E2E_Evaluator_ui5_manifest |
2903827.698346955 ns/iter |
2921435.8702932536 ns/iter |
0.99 |
E2E_Evaluator_unreal_engine_uproject |
466153.1888064617 ns/iter |
470785.835164901 ns/iter |
0.99 |
E2E_Evaluator_vercel |
320032.0095195104 ns/iter |
321620.4107713851 ns/iter |
1.00 |
E2E_Evaluator_yamllint |
10872.58438795467 ns/iter |
10808.685210965054 ns/iter |
1.01 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
JavaScript (linux/gcc)
Details
| Benchmark suite | Current: 873e997 | Previous: 307e9fd | Ratio |
|---|---|---|---|
E2E_Evaluator_adaptivecard |
117426 ns |
131241 ns |
0.89 |
E2E_Evaluator_ansible-meta |
587704 ns |
1159864 ns |
0.51 |
E2E_Evaluator_aws-cdk |
137439 ns |
251051 ns |
0.55 |
E2E_Evaluator_babelrc |
330891 ns |
522903 ns |
0.63 |
E2E_Evaluator_cerebrum-criminal-case |
2550437 ns |
5259299 ns |
0.48 |
E2E_Evaluator_clang-format |
286739 ns |
184247 ns |
1.56 |
E2E_Evaluator_cmake-presets |
19697064 ns |
20691846 ns |
0.95 |
E2E_Evaluator_code-climate |
441359 ns |
975574 ns |
0.45 |
E2E_Evaluator_cql2 |
1191249 ns |
1333471 ns |
0.89 |
E2E_Evaluator_cspell |
1570917 ns |
2240341 ns |
0.70 |
E2E_Evaluator_cypress |
864064 ns |
629244 ns |
1.37 |
E2E_Evaluator_deno |
1108063 ns |
1174495 ns |
0.94 |
E2E_Evaluator_dependabot |
1099863 ns |
1911516 ns |
0.58 |
E2E_Evaluator_draft-04 |
19958073 ns |
25093635 ns |
0.80 |
E2E_Evaluator_fabric-mod |
2469988 ns |
3708682 ns |
0.67 |
E2E_Evaluator_geojson |
21114279 ns |
71542961 ns |
0.30 |
E2E_Evaluator_gitpod-configuration |
766211 ns |
1195110 ns |
0.64 |
E2E_Evaluator_helm-chart-lock |
995696 ns |
1819782 ns |
0.55 |
E2E_Evaluator_importmap |
276639 ns |
534193 ns |
0.52 |
E2E_Evaluator_jasmine |
297390 ns |
659322 ns |
0.45 |
E2E_Evaluator_jsconfig |
1353758 ns |
1791585 ns |
0.76 |
E2E_Evaluator_jshintrc |
3108507 ns |
2152182 ns |
1.44 |
E2E_Evaluator_krakend |
766293 ns |
816545 ns |
0.94 |
E2E_Evaluator_lazygit |
587143 ns |
596535 ns |
0.98 |
E2E_Evaluator_lerna |
472910 ns |
680544 ns |
0.69 |
E2E_Evaluator_nest-cli |
633398 ns |
1108902 ns |
0.57 |
E2E_Evaluator_omc |
83698 ns |
125987 ns |
0.66 |
E2E_Evaluator_omnisharp |
1577776 ns |
1394179 ns |
1.13 |
E2E_Evaluator_openapi |
36411506 ns |
46239617 ns |
0.79 |
E2E_Evaluator_pre-commit-hooks |
1979231 ns |
1875306 ns |
1.06 |
E2E_Evaluator_pulumi |
1999705 ns |
3346133 ns |
0.60 |
E2E_Evaluator_semantic-release |
262654 ns |
646521 ns |
0.41 |
E2E_Evaluator_stale |
429482 ns |
742279 ns |
0.58 |
E2E_Evaluator_stylecop |
1219381 ns |
1294098 ns |
0.94 |
E2E_Evaluator_tmuxinator |
229380 ns |
473045 ns |
0.48 |
E2E_Evaluator_ui5 |
2216211 ns |
2806711 ns |
0.79 |
E2E_Evaluator_ui5-manifest |
11801547 ns |
11960839 ns |
0.99 |
E2E_Evaluator_unreal-engine-uproject |
1553397 ns |
2091146 ns |
0.74 |
E2E_Evaluator_vercel |
1061458 ns |
1310064 ns |
0.81 |
E2E_Evaluator_yamllint |
25224 ns |
140281 ns |
0.18 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Benchmark (macos/llvm)
Details
| Benchmark suite | Current: 873e997 | Previous: 307e9fd | Ratio |
|---|---|---|---|
E2E_Compiler_adaptivecard |
65654343.749997675 ns/iter |
84483104.25001182 ns/iter |
0.78 |
E2E_Compiler_ansible_meta |
28441160.000002127 ns/iter |
36677501.75000132 ns/iter |
0.78 |
E2E_Compiler_aws_cdk |
334382.0918526275 ns/iter |
378639.96630648366 ns/iter |
0.88 |
E2E_Compiler_babelrc |
2480237.4452055776 ns/iter |
2763652.101625981 ns/iter |
0.90 |
E2E_Compiler_clang_format |
20315175.916667588 ns/iter |
20272560.714287076 ns/iter |
1.00 |
E2E_Compiler_cmake_presets |
30565974.190478433 ns/iter |
30395928.319999255 ns/iter |
1.01 |
E2E_Compiler_code_climate |
2616719.4266209654 ns/iter |
2907037.412245124 ns/iter |
0.90 |
E2E_Compiler_cql2 |
13376113.315789632 ns/iter |
16013857.255319286 ns/iter |
0.84 |
E2E_Compiler_cspell |
24435701.4000002 ns/iter |
25081269.46666683 ns/iter |
0.97 |
E2E_Compiler_cypress |
5171750.239765991 ns/iter |
4639743.6907896185 ns/iter |
1.11 |
E2E_Compiler_deno |
8363688.00000016 ns/iter |
9752524.096385574 ns/iter |
0.86 |
E2E_Compiler_dependabot |
5011879.999999564 ns/iter |
4629372.076023738 ns/iter |
1.08 |
E2E_Compiler_draft_04 |
2800875.1583010643 ns/iter |
2970027.3071161276 ns/iter |
0.94 |
E2E_Compiler_fabric_mod |
5201958.726414252 ns/iter |
5026936.250000062 ns/iter |
1.03 |
E2E_Compiler_geojson |
27974983.359999895 ns/iter |
29268825.629628737 ns/iter |
0.96 |
E2E_Compiler_gitpod_configuration |
4830059.7826087335 ns/iter |
5277422.0214286875 ns/iter |
0.92 |
E2E_Compiler_helm_chart_lock |
635630.7216417836 ns/iter |
614592.3684981749 ns/iter |
1.03 |
E2E_Compiler_importmap |
231143.95135508265 ns/iter |
268414.3229813404 ns/iter |
0.86 |
E2E_Compiler_jasmine |
1364306.0642200683 ns/iter |
1418946.8503936378 ns/iter |
0.96 |
E2E_Compiler_jshintrc |
4711544.847328307 ns/iter |
4083891.715115997 ns/iter |
1.15 |
E2E_Compiler_jsconfig |
26615919.64285646 ns/iter |
25009549.70967893 ns/iter |
1.06 |
E2E_Compiler_krakend |
169802843.74997723 ns/iter |
172569374.99998912 ns/iter |
0.98 |
E2E_Compiler_lazygit |
44449833.333328575 ns/iter |
43665880.18749695 ns/iter |
1.02 |
E2E_Compiler_lerna |
1860258.8361447093 ns/iter |
2173456.3862926345 ns/iter |
0.86 |
E2E_Compiler_nest_cli |
9172926.645832764 ns/iter |
7900942.016667045 ns/iter |
1.16 |
E2E_Compiler_omc |
228877138.99998137 ns/iter |
236287778.00001898 ns/iter |
0.97 |
E2E_Compiler_omnisharp |
7897267.499999997 ns/iter |
6739736.816326995 ns/iter |
1.17 |
E2E_Compiler_openapi |
30340355.08695702 ns/iter |
28134408.962959815 ns/iter |
1.08 |
E2E_Compiler_pre_commit_hooks |
5156354.9999991665 ns/iter |
6289999.169999873 ns/iter |
0.82 |
E2E_Compiler_pulumi |
4313789.189189732 ns/iter |
3830931.327160563 ns/iter |
1.13 |
E2E_Compiler_semantic_release |
1663667.8571428221 ns/iter |
1557995.1642856875 ns/iter |
1.07 |
E2E_Compiler_stale |
1643030.5236770583 ns/iter |
1561440.3277661065 ns/iter |
1.05 |
E2E_Compiler_stylecop |
7276307.593495558 ns/iter |
8506184.82905978 ns/iter |
0.86 |
E2E_Compiler_tmuxinator |
1876324.4186045595 ns/iter |
1828771.4371981216 ns/iter |
1.03 |
E2E_Compiler_ui5 |
55930104.20000155 ns/iter |
64318446.42857446 ns/iter |
0.87 |
E2E_Compiler_ui5_manifest |
391609062.49998105 ns/iter |
333599458.4999753 ns/iter |
1.17 |
E2E_Compiler_unreal_engine_uproject |
4387622.155279912 ns/iter |
4119827.3828571737 ns/iter |
1.07 |
E2E_Compiler_vercel |
13701543.203703078 ns/iter |
16664364.361703366 ns/iter |
0.82 |
E2E_Compiler_yamllint |
286481.9347484134 ns/iter |
308726.93883661093 ns/iter |
0.93 |
E2E_Evaluator_adaptivecard |
20314.816322246214 ns/iter |
23184.185149470803 ns/iter |
0.88 |
E2E_Evaluator_ansible_meta |
184932.90810300322 ns/iter |
199825.3664754776 ns/iter |
0.93 |
E2E_Evaluator_aws_cdk |
43561.19661326278 ns/iter |
43742.78353715722 ns/iter |
1.00 |
E2E_Evaluator_babelrc |
98498.07685042704 ns/iter |
94206.68796667679 ns/iter |
1.05 |
E2E_Evaluator_cerebrum_criminal_case |
976311.9640102257 ns/iter |
950861.5456820821 ns/iter |
1.03 |
E2E_Evaluator_clang_format |
111605.78982045839 ns/iter |
116517.36037635137 ns/iter |
0.96 |
E2E_Evaluator_cmake_presets |
3511014.7058823085 ns/iter |
3660754.3975158264 ns/iter |
0.96 |
E2E_Evaluator_code_climate |
210921.1007824692 ns/iter |
147327.63623791168 ns/iter |
1.43 |
E2E_Evaluator_cql2 |
221259.87544480516 ns/iter |
150644.0839694497 ns/iter |
1.47 |
E2E_Evaluator_cspell |
603968.5559006189 ns/iter |
551733.0363262148 ns/iter |
1.09 |
E2E_Evaluator_cypress |
207183.18496571534 ns/iter |
187531.0786850018 ns/iter |
1.10 |
E2E_Evaluator_deno |
326314.1620166616 ns/iter |
280050.77134405746 ns/iter |
1.17 |
E2E_Evaluator_dependabot |
402977.8773857625 ns/iter |
387394.33841270977 ns/iter |
1.04 |
E2E_Evaluator_draft_04 |
6021759.579999752 ns/iter |
6490734.761193869 ns/iter |
0.93 |
E2E_Evaluator_fabric_mod |
660647.2403474742 ns/iter |
578772.8032473604 ns/iter |
1.14 |
E2E_Evaluator_geojson |
14494242.599999376 ns/iter |
11600919.391303645 ns/iter |
1.25 |
E2E_Evaluator_gitpod_configuration |
223471.01828646677 ns/iter |
170790.10805818063 ns/iter |
1.31 |
E2E_Evaluator_helm_chart_lock |
270744.39851593896 ns/iter |
206654.29659320938 ns/iter |
1.31 |
E2E_Evaluator_importmap |
42854.88363969941 ns/iter |
32089.967497293947 ns/iter |
1.34 |
E2E_Evaluator_jasmine |
97374.21164563208 ns/iter |
76451.35477735948 ns/iter |
1.27 |
E2E_Evaluator_jshintrc |
1195264.4949054073 ns/iter |
854410.3598014332 ns/iter |
1.40 |
E2E_Evaluator_jsconfig |
321722.2493958616 ns/iter |
273814.8724648832 ns/iter |
1.17 |
E2E_Evaluator_krakend |
171923.61686949077 ns/iter |
116554.73363169335 ns/iter |
1.48 |
E2E_Evaluator_lazygit |
137659.4947287621 ns/iter |
84752.93252574062 ns/iter |
1.62 |
E2E_Evaluator_lerna |
140405.1653642655 ns/iter |
104204.8919478836 ns/iter |
1.35 |
E2E_Evaluator_nest_cli |
163380.68699978152 ns/iter |
131003.42811141581 ns/iter |
1.25 |
E2E_Evaluator_omc |
17812.580271277202 ns/iter |
13952.010394653 ns/iter |
1.28 |
E2E_Evaluator_omnisharp |
521640.48395278666 ns/iter |
433119.02300408744 ns/iter |
1.20 |
E2E_Evaluator_openapi |
9971176.432099195 ns/iter |
8139031.944444418 ns/iter |
1.23 |
E2E_Evaluator_pre_commit_hooks |
399481.3485360052 ns/iter |
310158.3256227554 ns/iter |
1.29 |
E2E_Evaluator_pulumi |
652993.8038461762 ns/iter |
560021.5829999797 ns/iter |
1.17 |
E2E_Evaluator_semantic_release |
70053.4429941578 ns/iter |
90131.24823578725 ns/iter |
0.78 |
E2E_Evaluator_stale |
129382.37757220792 ns/iter |
114428.47863797843 ns/iter |
1.13 |
E2E_Evaluator_stylecop |
195594.51219513605 ns/iter |
210053.18428568184 ns/iter |
0.93 |
E2E_Evaluator_tmuxinator |
72432.94984486698 ns/iter |
69405.14986924049 ns/iter |
1.04 |
E2E_Evaluator_ui5 |
330400.36043742043 ns/iter |
330795.12862863234 ns/iter |
1.00 |
E2E_Evaluator_ui5_manifest |
2748626.4662755677 ns/iter |
1591122.8870968672 ns/iter |
1.73 |
E2E_Evaluator_unreal_engine_uproject |
366341.08873026934 ns/iter |
310300.54251548275 ns/iter |
1.18 |
E2E_Evaluator_vercel |
237727.59768832295 ns/iter |
222826.38203354672 ns/iter |
1.07 |
E2E_Evaluator_yamllint |
6092.459731232576 ns/iter |
6322.668633462667 ns/iter |
0.96 |
Micro_Draft4_Meta_1_No_Callback |
132.0852827747987 ns/iter |
128.16795992818138 ns/iter |
1.03 |
Micro_Draft4_Required_Properties |
632.29710311019 ns/iter |
615.8111637824397 ns/iter |
1.03 |
Micro_Draft4_Many_Optional_Properties_Minimal_Match |
15.681858704949546 ns/iter |
15.464080791534021 ns/iter |
1.01 |
Micro_Draft4_Few_Optional_Properties_Minimal_Match |
7.326211659540332 ns/iter |
6.968993787209002 ns/iter |
1.05 |
Micro_Draft4_Items_Schema |
277.633920222499 ns/iter |
255.57601435085726 ns/iter |
1.09 |
Micro_Draft4_Nested_Object |
0.7020885167695853 ns/iter |
0.6956337229970917 ns/iter |
1.01 |
Micro_Draft4_Properties_Triad_Optional |
214.17954588542685 ns/iter |
206.8399073964319 ns/iter |
1.04 |
Micro_Draft4_Properties_Triad_Closed |
186.8653480637946 ns/iter |
180.33185734463532 ns/iter |
1.04 |
Micro_Draft4_Properties_Triad_Required |
222.7224161201677 ns/iter |
238.99833486813637 ns/iter |
0.93 |
Micro_Draft4_Properties_Closed |
37.41170011576898 ns/iter |
47.88592395888462 ns/iter |
0.78 |
Micro_Draft4_Non_Recursive_Ref |
12.492631407346918 ns/iter |
13.805226739544434 ns/iter |
0.90 |
Micro_Draft4_Pattern_Properties_True |
135.03605402592873 ns/iter |
151.42744154132646 ns/iter |
0.89 |
Micro_Draft4_Ref_To_Single_Property |
7.036529283418342 ns/iter |
7.446790622746334 ns/iter |
0.94 |
Micro_Draft4_Additional_Properties_Type |
25.262897457614514 ns/iter |
24.86571792700924 ns/iter |
1.02 |
Micro_Draft4_Nested_Oneof |
41.44484172821039 ns/iter |
40.46517916057027 ns/iter |
1.02 |
Micro_Draft4_Short_Enum |
4.846861192045773 ns/iter |
5.097892331173829 ns/iter |
0.95 |
Micro_Draft4_Long_Enum |
10.134029378965256 ns/iter |
10.353961779209035 ns/iter |
0.98 |
Micro_Draft4_Long_Enum_Short_Strings |
6.30506013399125 ns/iter |
6.078864767811666 ns/iter |
1.04 |
Micro_Draft4_Type_Object |
2.1687461525276497 ns/iter |
2.157003340169858 ns/iter |
1.01 |
Micro_Draft4_Ref_Single_100 |
1718931.9213756449 ns/iter |
1689148.1042657215 ns/iter |
1.02 |
Micro_Draft4_Compile_Ref_Many_Nested |
1248841.6307051915 ns/iter |
1236708.5482757264 ns/iter |
1.01 |
Micro_Draft4_Compile_Wrap |
2061685.9421768351 ns/iter |
2055921.0948271744 ns/iter |
1.00 |
Micro_Draft6_Property_Names |
98.42396145470707 ns/iter |
121.17570140950842 ns/iter |
0.81 |
Micro_Draft6_Compile_FHIR |
10431970082.999897 ns/iter |
12538496124.999937 ns/iter |
0.83 |
Micro_Draft7_If_Then_Else |
33.94298303196632 ns/iter |
17.5964149281286 ns/iter |
1.93 |
Micro_2019_09_Unevaluated_Properties |
27.594164696229697 ns/iter |
26.928670232867358 ns/iter |
1.02 |
Micro_2019_09_Compile_Wrap |
323646645.4999345 ns/iter |
367201270.5000043 ns/iter |
0.88 |
Micro_2019_09_KrakenD_Linter_Check |
629538375.0000383 ns/iter |
782256791.000009 ns/iter |
0.80 |
Micro_2019_09_KrakenD_Linter_Apply |
5890507417.99997 ns/iter |
7060215457.999903 ns/iter |
0.83 |
Micro_2020_12_Dynamic_Ref |
188.3669921753857 ns/iter |
195.60971011866653 ns/iter |
0.96 |
Micro_2020_12_Dynamic_Ref_Single |
2.240990556634089 ns/iter |
2.203744212542273 ns/iter |
1.02 |
Micro_2020_12_Simple_Output_Mask |
65180.47513624686 ns/iter |
61158.635958627914 ns/iter |
1.07 |
Micro_2020_12_Simple_Output_Annotations |
87865.2121474339 ns/iter |
86555.68874326433 ns/iter |
1.02 |
Micro_2020_12_Compile_NonCircular_Shared_Refs |
824542.0023012825 ns/iter |
819318.4832756555 ns/iter |
1.01 |
Micro_2020_12_Exhaustive_Deep_Numeric |
5357.535628055122 ns/iter |
5258.4869346334235 ns/iter |
1.02 |
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput |
117982.76202136441 ns/iter |
120360.09693055875 ns/iter |
0.98 |
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput |
15296.01065399896 ns/iter |
16423.04822243397 ns/iter |
0.93 |
Micro_2020_12_Exhaustive_Deep_Numeric_Fail |
95.30988418770656 ns/iter |
96.04395723547795 ns/iter |
0.99 |
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput |
4785.748926861686 ns/iter |
4905.522176036576 ns/iter |
0.98 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
JavaScript (macos/llvm)
Details
| Benchmark suite | Current: 873e997 | Previous: 307e9fd | Ratio |
|---|---|---|---|
E2E_Evaluator_adaptivecard |
96649 ns |
99781 ns |
0.97 |
E2E_Evaluator_ansible-meta |
453452 ns |
967388 ns |
0.47 |
E2E_Evaluator_aws-cdk |
122300 ns |
231876 ns |
0.53 |
E2E_Evaluator_babelrc |
361752 ns |
409582 ns |
0.88 |
E2E_Evaluator_cerebrum-criminal-case |
2196821 ns |
3975297 ns |
0.55 |
E2E_Evaluator_clang-format |
302609 ns |
140578 ns |
2.15 |
E2E_Evaluator_cmake-presets |
14817381 ns |
16584356 ns |
0.89 |
E2E_Evaluator_code-climate |
394226 ns |
854262 ns |
0.46 |
E2E_Evaluator_cql2 |
951739 ns |
1218453 ns |
0.78 |
E2E_Evaluator_cspell |
1447392 ns |
1800834 ns |
0.80 |
E2E_Evaluator_cypress |
1014280 ns |
538525 ns |
1.88 |
E2E_Evaluator_deno |
1126275 ns |
1099559 ns |
1.02 |
E2E_Evaluator_dependabot |
968517 ns |
1860712 ns |
0.52 |
E2E_Evaluator_draft-04 |
16364226 ns |
23843341 ns |
0.69 |
E2E_Evaluator_fabric-mod |
1961501 ns |
3342187 ns |
0.59 |
E2E_Evaluator_geojson |
21734801 ns |
69696586 ns |
0.31 |
E2E_Evaluator_gitpod-configuration |
731639 ns |
947912 ns |
0.77 |
E2E_Evaluator_helm-chart-lock |
1140671 ns |
1703774 ns |
0.67 |
E2E_Evaluator_importmap |
264594 ns |
403719 ns |
0.66 |
E2E_Evaluator_jasmine |
317078 ns |
514384 ns |
0.62 |
E2E_Evaluator_jsconfig |
1483412 ns |
1264204 ns |
1.17 |
E2E_Evaluator_jshintrc |
2774916 ns |
2187400 ns |
1.27 |
E2E_Evaluator_krakend |
486062 ns |
665104 ns |
0.73 |
E2E_Evaluator_lazygit |
415178 ns |
616948 ns |
0.67 |
E2E_Evaluator_lerna |
427668 ns |
593259 ns |
0.72 |
E2E_Evaluator_nest-cli |
673942 ns |
776629 ns |
0.87 |
E2E_Evaluator_omc |
74929 ns |
90740 ns |
0.83 |
E2E_Evaluator_omnisharp |
1472541 ns |
1081301 ns |
1.36 |
E2E_Evaluator_openapi |
31079968 ns |
28939329 ns |
1.07 |
E2E_Evaluator_pre-commit-hooks |
1920060 ns |
1509212 ns |
1.27 |
E2E_Evaluator_pulumi |
1953353 ns |
2435047 ns |
0.80 |
E2E_Evaluator_semantic-release |
251014 ns |
502956 ns |
0.50 |
E2E_Evaluator_stale |
420985 ns |
541962 ns |
0.78 |
E2E_Evaluator_stylecop |
944384 ns |
1008612 ns |
0.94 |
E2E_Evaluator_tmuxinator |
238451 ns |
374760 ns |
0.64 |
E2E_Evaluator_ui5 |
1650741 ns |
2130098 ns |
0.77 |
E2E_Evaluator_ui5-manifest |
8653837 ns |
8772255 ns |
0.99 |
E2E_Evaluator_unreal-engine-uproject |
1482237 ns |
1541575 ns |
0.96 |
E2E_Evaluator_vercel |
935999 ns |
945043 ns |
0.99 |
E2E_Evaluator_yamllint |
28946 ns |
85724 ns |
0.34 |
This comment was automatically generated by workflow using github-action-benchmark.
Signed-off-by: Juan Cruz Viotti jv@jviotti.com