Turn most evaluation test cases into JSON

[jviotti]

Signed-off-by: Juan Cruz Viotti jv@jviotti.com

[github-actions]

Benchmark (linux/llvm)

Details

Benchmark suite	Current: 7ec1968	Previous: 2c4115a	Ratio
E2E_Compiler_adaptivecard	68371191.77777772 ns/iter	71669549.88888897 ns/iter	0.95
E2E_Compiler_ansible_meta	29645862.833334032 ns/iter	30079409.956521846 ns/iter	0.99
E2E_Compiler_aws_cdk	379061.5402920477 ns/iter	375844.1884760608 ns/iter	1.01
E2E_Compiler_babelrc	2591934.107011065 ns/iter	2584045.690298565 ns/iter	1.00
E2E_Compiler_clang_format	18433614.894737624 ns/iter	18467481.078947626 ns/iter	1.00
E2E_Compiler_cmake_presets	27083838.851852864 ns/iter	25536032.250000417 ns/iter	1.06
E2E_Compiler_code_climate	2575964.794871922 ns/iter	2551762.8832115764 ns/iter	1.01
E2E_Compiler_cql2	13036834.018867828 ns/iter	12821978.425926594 ns/iter	1.02
E2E_Compiler_cspell	22686849.67741812 ns/iter	23082701.433332883 ns/iter	0.98
E2E_Compiler_cypress	3890615.333333219 ns/iter	3879265.1712707756 ns/iter	1.00
E2E_Compiler_deno	7680746.5384619245 ns/iter	7686550.296703764 ns/iter	1.00
E2E_Compiler_dependabot	3957203.5251394203 ns/iter	3897719.06666662 ns/iter	1.02
E2E_Compiler_draft_04	2680387.9307690384 ns/iter	2662839.8935362017 ns/iter	1.01
E2E_Compiler_fabric_mod	4758336.29251708 ns/iter	4740409.094594611 ns/iter	1.00
E2E_Compiler_geojson	22627882.580644794 ns/iter	22286903.967741884 ns/iter	1.02
E2E_Compiler_gitpod_configuration	4930683.678321418 ns/iter	4886769.342657648 ns/iter	1.01
E2E_Compiler_helm_chart_lock	704518.0931173912 ns/iter	703179.2695652088 ns/iter	1.00
E2E_Compiler_importmap	286599.70016407757 ns/iter	285766.46756425017 ns/iter	1.00
E2E_Compiler_jasmine	1371663.8571428526 ns/iter	1362984.5175096712 ns/iter	1.01
E2E_Compiler_jshintrc	4362579.043478002 ns/iter	4358195.418750199 ns/iter	1.00
E2E_Compiler_jsconfig	22027103.84375095 ns/iter	22096000.40625048 ns/iter	1.00
E2E_Compiler_krakend	147709302.1999963 ns/iter	151614844.9999946 ns/iter	0.97
E2E_Compiler_lazygit	33956678.33333283 ns/iter	33707038.285716146 ns/iter	1.01
E2E_Compiler_lerna	1602658.8394494976 ns/iter	1594338.3022727435 ns/iter	1.01
E2E_Compiler_nest_cli	7556743.351063866 ns/iter	7412306.294737079 ns/iter	1.02
E2E_Compiler_omc	158417671.49998987 ns/iter	165217647.7499978 ns/iter	0.96
E2E_Compiler_omnisharp	6711681.451923058 ns/iter	6705281.361904607 ns/iter	1.00
E2E_Compiler_openapi	25301295.785715587 ns/iter	25472233.107143845 ns/iter	0.99
E2E_Compiler_pre_commit_hooks	5309220.053030203 ns/iter	5308468.310606042 ns/iter	1.00
E2E_Compiler_pulumi	4039528.109826549 ns/iter	4029205.1609195163 ns/iter	1.00
E2E_Compiler_semantic_release	1565742.1696429553 ns/iter	1558935.7133333376 ns/iter	1.00
E2E_Compiler_stale	1554756.8600000734 ns/iter	1552309.077605253 ns/iter	1.00
E2E_Compiler_stylecop	6165222.690265585 ns/iter	6136469.442478011 ns/iter	1.00
E2E_Compiler_tmuxinator	1925907.2387641484 ns/iter	1915237.8356165648 ns/iter	1.01
E2E_Compiler_ui5	47173324.8000002 ns/iter	47781189.93333464 ns/iter	0.99
E2E_Compiler_ui5_manifest	320221474.99998254 ns/iter	327298614.49999475 ns/iter	0.98
E2E_Compiler_unreal_engine_uproject	4611336.374999927 ns/iter	4594302.743421289 ns/iter	1.00
E2E_Compiler_vercel	12341124.446429318 ns/iter	12519423.964286195 ns/iter	0.99
E2E_Compiler_yamllint	349691.5816275681 ns/iter	348578.0184079413 ns/iter	1.00
E2E_Evaluator_adaptivecard	24512.729973879254 ns/iter	24629.629768031184 ns/iter	1.00
E2E_Evaluator_ansible_meta	229162.0314754143 ns/iter	230392.30079682087 ns/iter	0.99
E2E_Evaluator_aws_cdk	52614.57190732961 ns/iter	50923.177990921045 ns/iter	1.03
E2E_Evaluator_babelrc	112499.79477730856 ns/iter	110662.62290458358 ns/iter	1.02
E2E_Evaluator_cerebrum_criminal_case	1218351.648275851 ns/iter	1198788.6979167368 ns/iter	1.02
E2E_Evaluator_clang_format	125720.21181556316 ns/iter	126972.26782798984 ns/iter	0.99
E2E_Evaluator_cmake_presets	4799744.828025627 ns/iter	4548514.273333239 ns/iter	1.06
E2E_Evaluator_code_climate	170391.93971803432 ns/iter	171349.49734427404 ns/iter	0.99
E2E_Evaluator_cql2	216336.26553845996 ns/iter	220406.37235672586 ns/iter	0.98
E2E_Evaluator_cspell	558988.4537479947 ns/iter	568795.4829544859 ns/iter	0.98
E2E_Evaluator_cypress	193354.4584134032 ns/iter	192221.64410957578 ns/iter	1.01
E2E_Evaluator_deno	310633.68619617913 ns/iter	322885.72016093775 ns/iter	0.96
E2E_Evaluator_dependabot	419198.35301204113 ns/iter	416837.7501483743 ns/iter	1.01
E2E_Evaluator_draft_04	8848494.753086317 ns/iter	8730681.300001208 ns/iter	1.01
E2E_Evaluator_fabric_mod	723463.4088568543 ns/iter	720400.71149898 ns/iter	1.00
E2E_Evaluator_geojson	17791822.02564045 ns/iter	17600361.149999343 ns/iter	1.01
E2E_Evaluator_gitpod_configuration	230135.023029521 ns/iter	228021.22784401543 ns/iter	1.01
E2E_Evaluator_helm_chart_lock	356850.7913043546 ns/iter	353050.4758515535 ns/iter	1.01
E2E_Evaluator_importmap	50585.45802434312 ns/iter	47798.204369227686 ns/iter	1.06
E2E_Evaluator_jasmine	116785.5195788122 ns/iter	115359.71341962762 ns/iter	1.01
E2E_Evaluator_jshintrc	1202697.679794474 ns/iter	1202288.1451049338 ns/iter	1.00
E2E_Evaluator_jsconfig	429728.4353157534 ns/iter	429732.71490412613 ns/iter	1.00
E2E_Evaluator_krakend	212124.8876072257 ns/iter	206219.56722564728 ns/iter	1.03
E2E_Evaluator_lazygit	148202.9672877773 ns/iter	145191.22554682818 ns/iter	1.02
E2E_Evaluator_lerna	136879.34095387816 ns/iter	137188.37743949896 ns/iter	1.00
E2E_Evaluator_nest_cli	180148.54070065738 ns/iter	178573.36110405813 ns/iter	1.01
E2E_Evaluator_omc	19273.14613556338 ns/iter	19193.228461815997 ns/iter	1.00
E2E_Evaluator_omnisharp	610654.1328671573 ns/iter	606603.6309314397 ns/iter	1.01
E2E_Evaluator_openapi	15813066.499999551 ns/iter	16050331.911110839 ns/iter	0.99
E2E_Evaluator_pre_commit_hooks	470885.52403519995 ns/iter	474109.48550230847 ns/iter	0.99
E2E_Evaluator_pulumi	717232.1668372159 ns/iter	707938.5178753858 ns/iter	1.01
E2E_Evaluator_semantic_release	102370.77160130044 ns/iter	102985.85160080672 ns/iter	0.99
E2E_Evaluator_stale	151898.94622964787 ns/iter	149253.6829995706 ns/iter	1.02
E2E_Evaluator_stylecop	284141.8774350702 ns/iter	284381.7889386342 ns/iter	1.00
E2E_Evaluator_tmuxinator	97506.36662961754 ns/iter	95965.80537190012 ns/iter	1.02
E2E_Evaluator_ui5	501519.3256979454 ns/iter	493031.63321297814 ns/iter	1.02
E2E_Evaluator_ui5_manifest	2570846.37545133 ns/iter	2550484.1213236437 ns/iter	1.01
E2E_Evaluator_unreal_engine_uproject	441427.3343789044 ns/iter	441479.9286615876 ns/iter	1.00
E2E_Evaluator_vercel	315031.01526716736 ns/iter	343328.64929328836 ns/iter	0.92
E2E_Evaluator_yamllint	8820.486033019804 ns/iter	8734.150885201578 ns/iter	1.01
Micro_Draft4_Meta_1_No_Callback	194.73278829261307 ns/iter	194.21056875711773 ns/iter	1.00
Micro_Draft4_Required_Properties	848.5512160144095 ns/iter	852.7648270655278 ns/iter	1.00
Micro_Draft4_Many_Optional_Properties_Minimal_Match	21.631199295954918 ns/iter	21.281989079364923 ns/iter	1.02
Micro_Draft4_Few_Optional_Properties_Minimal_Match	11.246811279712624 ns/iter	11.207512282727217 ns/iter	1.00
Micro_Draft4_Items_Schema	288.78064782470636 ns/iter	344.4415858275168 ns/iter	0.84
Micro_Draft4_Nested_Object	1.772267128905126 ns/iter	1.767544448323719 ns/iter	1.00
Micro_Draft4_Properties_Triad_Optional	339.0220286627901 ns/iter	338.40380066253834 ns/iter	1.00
Micro_Draft4_Properties_Triad_Closed	269.5108718956112 ns/iter	270.21833074908466 ns/iter	1.00
Micro_Draft4_Properties_Triad_Required	335.0393765821266 ns/iter	334.399428420101 ns/iter	1.00
Micro_Draft4_Properties_Closed	56.01820081667417 ns/iter	54.80314241293724 ns/iter	1.02
Micro_Draft4_Non_Recursive_Ref	14.337945665905652 ns/iter	14.320650267908121 ns/iter	1.00
Micro_Draft4_Pattern_Properties_True	157.2367784059062 ns/iter	158.99899702968125 ns/iter	0.99
Micro_Draft4_Ref_To_Single_Property	11.21870728635513 ns/iter	11.211083642880753 ns/iter	1.00
Micro_Draft4_Additional_Properties_Type	28.35151998212762 ns/iter	28.348861915192423 ns/iter	1.00
Micro_Draft4_Nested_Oneof	56.48379959041272 ns/iter	56.505091996992746 ns/iter	1.00
Micro_Draft4_Short_Enum	14.812448295528934 ns/iter	14.218326362034668 ns/iter	1.04
Micro_Draft4_Long_Enum	15.349972808449591 ns/iter	14.991893902582087 ns/iter	1.02
Micro_Draft4_Long_Enum_Short_Strings	14.09379250151074 ns/iter	14.131352249892013 ns/iter	1.00
Micro_Draft4_Type_Object	3.7360689058656766 ns/iter	3.735907297410456 ns/iter	1.00
Micro_Draft4_Ref_Single_100	2389444.757679109 ns/iter	2361953.8779658503 ns/iter	1.01
Micro_Draft4_Compile_Ref_Many_Nested	1734569.5098040113 ns/iter	1809671.2328430137 ns/iter	0.96
Micro_Draft4_Compile_Wrap	2361578.558922628 ns/iter	2363269.6879193825 ns/iter	1.00
Micro_Draft6_Property_Names	134.5876726139421 ns/iter	135.0188224492254 ns/iter	1.00
Micro_Draft6_Compile_FHIR	14380215591.000023 ns/iter	14858613743.999968 ns/iter	0.97
Micro_Draft7_If_Then_Else	24.146045441824796 ns/iter	23.985543852843183 ns/iter	1.01
Micro_2019_09_Unevaluated_Properties	27.446315965029214 ns/iter	27.525632132909223 ns/iter	1.00
Micro_2019_09_Compile_Wrap	299818978.5000136 ns/iter	314153594.000004 ns/iter	0.95
Micro_2019_09_KrakenD_Linter_Check	1169662347.9999745 ns/iter	1215044438.9999392 ns/iter	0.96
Micro_2019_09_KrakenD_Linter_Apply	10515438178.999943 ns/iter	10830098451.000027 ns/iter	0.97
Micro_2020_12_Dynamic_Ref	226.43940908833392 ns/iter	232.92327082010618 ns/iter	0.97
Micro_2020_12_Dynamic_Ref_Single	3.426895686636416 ns/iter	3.426298948505964 ns/iter	1.00
Micro_2020_12_Simple_Output_Mask	65640.99217054613 ns/iter	65994.48367980478 ns/iter	0.99
Micro_2020_12_Simple_Output_Annotations	101779.0277657817 ns/iter	103779.85098795455 ns/iter	0.98
Micro_2020_12_Compile_NonCircular_Shared_Refs	1101522.0047096193 ns/iter	1093168.246106063 ns/iter	1.01
Micro_2020_12_Exhaustive_Deep_Numeric	8405.317851673002 ns/iter	8300.285413436208 ns/iter	1.01
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput	182668.30654685904 ns/iter	184196.1265155355 ns/iter	0.99
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput	22227.71953159761 ns/iter	22282.921299108184 ns/iter	1.00
Micro_2020_12_Exhaustive_Deep_Numeric_Fail	146.76952667232817 ns/iter	143.10816128884045 ns/iter	1.03
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput	4240.9134874772935 ns/iter	4290.045353072649 ns/iter	0.99

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

JavaScript (linux/llvm)

Details

Benchmark suite	Current: 7ec1968	Previous: 2c4115a	Ratio
E2E_Evaluator_adaptivecard	113361 ns	108929 ns	1.04
E2E_Evaluator_ansible-meta	980907 ns	950469 ns	1.03
E2E_Evaluator_aws-cdk	216641 ns	212584 ns	1.02
E2E_Evaluator_babelrc	404029 ns	410433 ns	0.98
E2E_Evaluator_cerebrum-criminal-case	4297444 ns	4591377 ns	0.94
E2E_Evaluator_clang-format	154885 ns	152928 ns	1.01
E2E_Evaluator_cmake-presets	17355751 ns	18400984 ns	0.94
E2E_Evaluator_code-climate	849436 ns	817244 ns	1.04
E2E_Evaluator_cql2	1090309 ns	1048814 ns	1.04
E2E_Evaluator_cspell	1779685 ns	1686100 ns	1.06
E2E_Evaluator_cypress	530264 ns	531855 ns	1.00
E2E_Evaluator_deno	1017522 ns	1008824 ns	1.01
E2E_Evaluator_dependabot	1502160 ns	1508802 ns	1.00
E2E_Evaluator_draft-04	23469840 ns	23114936 ns	1.02
E2E_Evaluator_fabric-mod	3062378 ns	3000394 ns	1.02
E2E_Evaluator_geojson	54953971 ns	54173055 ns	1.01
E2E_Evaluator_gitpod-configuration	923224 ns	915323 ns	1.01
E2E_Evaluator_helm-chart-lock	1417326 ns	1430959 ns	0.99
E2E_Evaluator_importmap	408072 ns	403295 ns	1.01
E2E_Evaluator_jasmine	465269 ns	457982 ns	1.02
E2E_Evaluator_jsconfig	1334138 ns	1327851 ns	1.00
E2E_Evaluator_jshintrc	1872025 ns	1854975 ns	1.01
E2E_Evaluator_krakend	701898 ns	695297 ns	1.01
E2E_Evaluator_lazygit	500045 ns	488697 ns	1.02
E2E_Evaluator_lerna	526973 ns	525256 ns	1.00
E2E_Evaluator_nest-cli	830153 ns	839851 ns	0.99
E2E_Evaluator_omc	83645 ns	82996 ns	1.01
E2E_Evaluator_omnisharp	1203030 ns	1180155 ns	1.02
E2E_Evaluator_openapi	41218966 ns	41266525 ns	1.00
E2E_Evaluator_pre-commit-hooks	1508807 ns	1544369 ns	0.98
E2E_Evaluator_pulumi	2615975 ns	2664081 ns	0.98
E2E_Evaluator_semantic-release	474068 ns	489512 ns	0.97
E2E_Evaluator_stale	554680 ns	555359 ns	1.00
E2E_Evaluator_stylecop	997916 ns	977896 ns	1.02
E2E_Evaluator_tmuxinator	378205 ns	389446 ns	0.97
E2E_Evaluator_ui5	2224405 ns	2247315 ns	0.99
E2E_Evaluator_ui5-manifest	10958107 ns	10080878 ns	1.09
E2E_Evaluator_unreal-engine-uproject	1601905 ns	1608267 ns	1.00
E2E_Evaluator_vercel	1110333 ns	1105009 ns	1.00
E2E_Evaluator_yamllint	72521 ns	71136 ns	1.02

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

Benchmark (macos/llvm)

Details

Benchmark suite	Current: 7ec1968	Previous: 2c4115a	Ratio
E2E_Compiler_adaptivecard	56705874.99999287 ns/iter	59965357.58329931 ns/iter	0.95
E2E_Compiler_ansible_meta	24212333.344825435 ns/iter	24600404.296287943 ns/iter	0.98
E2E_Compiler_aws_cdk	297492.2985304717 ns/iter	275012.0201083315 ns/iter	1.08
E2E_Compiler_babelrc	2779994.0036900784 ns/iter	2142117.946708235 ns/iter	1.30
E2E_Compiler_clang_format	15908346.913044585 ns/iter	14913748.195646763 ns/iter	1.07
E2E_Compiler_cmake_presets	27051557.69230644 ns/iter	27231461.321434833 ns/iter	0.99
E2E_Compiler_code_climate	3088587.0126178754 ns/iter	2280465.7041800544 ns/iter	1.35
E2E_Compiler_cql2	13518661.111109193 ns/iter	11402196.032793386 ns/iter	1.19
E2E_Compiler_cspell	19405121.621619742 ns/iter	19280773.138891365 ns/iter	1.01
E2E_Compiler_cypress	3506330.921053584 ns/iter	3504637.228855865 ns/iter	1.00
E2E_Compiler_deno	6531980.324075026 ns/iter	6588374.999997746 ns/iter	0.99
E2E_Compiler_dependabot	3534304.2929291576 ns/iter	3819789.148350298 ns/iter	0.93
E2E_Compiler_draft_04	1969334.0307261494 ns/iter	1964757.3828569876 ns/iter	1.00
E2E_Compiler_fabric_mod	3622114.207253409 ns/iter	3729279.2303655655 ns/iter	0.97
E2E_Compiler_geojson	21718906.249994062 ns/iter	21790300.781262316 ns/iter	1.00
E2E_Compiler_gitpod_configuration	4019411.668571463 ns/iter	4024010.7142848764 ns/iter	1.00
E2E_Compiler_helm_chart_lock	520663.808351859 ns/iter	532135.3559942275 ns/iter	0.98
E2E_Compiler_importmap	202858.62948089518 ns/iter	204412.79336874106 ns/iter	0.99
E2E_Compiler_jasmine	1533986.3184077695 ns/iter	1048170.0649546662 ns/iter	1.46
E2E_Compiler_jshintrc	3285490.6823532097 ns/iter	3202844.3181822943 ns/iter	1.03
E2E_Compiler_jsconfig	18286127.21052842 ns/iter	19193795.138890993 ns/iter	0.95
E2E_Compiler_krakend	128717624.99999022 ns/iter	134286599.9999958 ns/iter	0.96
E2E_Compiler_lazygit	31749501.909085993 ns/iter	39598240.50000613 ns/iter	0.80
E2E_Compiler_lerna	1315796.0497134652 ns/iter	1406800.0000001437 ns/iter	0.94
E2E_Compiler_nest_cli	6116382.00000031 ns/iter	6178228.365386601 ns/iter	0.99
E2E_Compiler_omc	161271666.74999672 ns/iter	164939645.7499961 ns/iter	0.98
E2E_Compiler_omnisharp	5790321.875000851 ns/iter	5791159.9576258045 ns/iter	1.00
E2E_Compiler_openapi	21033979.78788218 ns/iter	21739941.909097318 ns/iter	0.97
E2E_Compiler_pre_commit_hooks	4113622.305881643 ns/iter	4101907.599999108 ns/iter	1.00
E2E_Compiler_pulumi	3197490.400921176 ns/iter	3359759.900991542 ns/iter	0.95
E2E_Compiler_semantic_release	1335533.9103216622 ns/iter	1294070.4503816196 ns/iter	1.03
E2E_Compiler_stale	1240570.3460803016 ns/iter	1235696.998197569 ns/iter	1.00
E2E_Compiler_stylecop	5396304.2635661075 ns/iter	5561002.929685088 ns/iter	0.97
E2E_Compiler_tmuxinator	1501836.2516414486 ns/iter	1505876.1757044287 ns/iter	1.00
E2E_Compiler_ui5	50505122.00000412 ns/iter	55933270.857134886 ns/iter	0.90
E2E_Compiler_ui5_manifest	293525478.9999817 ns/iter	436866500.00017834 ns/iter	0.67
E2E_Compiler_unreal_engine_uproject	3964599.2063498623 ns/iter	4370905.999998004 ns/iter	0.91
E2E_Compiler_vercel	12160255.741378024 ns/iter	15651301.857147068 ns/iter	0.78
E2E_Compiler_yamllint	246099.97648296208 ns/iter	267354.8664850198 ns/iter	0.92
E2E_Evaluator_adaptivecard	18351.178736962855 ns/iter	21145.55742181651 ns/iter	0.87
E2E_Evaluator_ansible_meta	159535.47936296687 ns/iter	172517.05436488247 ns/iter	0.92
E2E_Evaluator_aws_cdk	33413.418681835785 ns/iter	39818.472610163015 ns/iter	0.84
E2E_Evaluator_babelrc	78186.23698121126 ns/iter	82192.64023408003 ns/iter	0.95
E2E_Evaluator_cerebrum_criminal_case	847212.2711444045 ns/iter	874841.9385620152 ns/iter	0.97
E2E_Evaluator_clang_format	95497.29656662875 ns/iter	108765.13708134454 ns/iter	0.88
E2E_Evaluator_cmake_presets	3090671.8318580706 ns/iter	3504783.8010211997 ns/iter	0.88
E2E_Evaluator_code_climate	122187.3267763335 ns/iter	160305.19550261178 ns/iter	0.76
E2E_Evaluator_cql2	142348.0823012431 ns/iter	177844.62141257012 ns/iter	0.80
E2E_Evaluator_cspell	395167.7498646071 ns/iter	483256.78294567077 ns/iter	0.82
E2E_Evaluator_cypress	135310.5122895189 ns/iter	157458.20156017665 ns/iter	0.86
E2E_Evaluator_deno	217577.95128849262 ns/iter	293484.5575604681 ns/iter	0.74
E2E_Evaluator_dependabot	305858.44560482336 ns/iter	374687.920624627 ns/iter	0.82
E2E_Evaluator_draft_04	4885491.839161602 ns/iter	5862134.6343260035 ns/iter	0.83
E2E_Evaluator_fabric_mod	463041.99867191806 ns/iter	709601.90437563 ns/iter	0.65
E2E_Evaluator_geojson	11130506.725807678 ns/iter	11997671.142856752 ns/iter	0.93
E2E_Evaluator_gitpod_configuration	159029.73223140297 ns/iter	184460.6568701745 ns/iter	0.86
E2E_Evaluator_helm_chart_lock	206353.25923701542 ns/iter	218464.43089433527 ns/iter	0.94
E2E_Evaluator_importmap	29889.368313909745 ns/iter	30849.538703907136 ns/iter	0.97
E2E_Evaluator_jasmine	78920.45415391207 ns/iter	79860.86780857158 ns/iter	0.99
E2E_Evaluator_jshintrc	939456.4102901354 ns/iter	919668.2352156679 ns/iter	1.02
E2E_Evaluator_jsconfig	294109.1960119373 ns/iter	296495.39367092686 ns/iter	0.99
E2E_Evaluator_krakend	126884.73764327087 ns/iter	127944.88687538798 ns/iter	0.99
E2E_Evaluator_lazygit	95221.71332877057 ns/iter	108524.04366697416 ns/iter	0.88
E2E_Evaluator_lerna	115337.21621165752 ns/iter	135972.8399253684 ns/iter	0.85
E2E_Evaluator_nest_cli	121905.1515151568 ns/iter	124657.06123957607 ns/iter	0.98
E2E_Evaluator_omc	13953.608057587753 ns/iter	14054.444351806515 ns/iter	0.99
E2E_Evaluator_omnisharp	424595.2992744604 ns/iter	425551.7045453712 ns/iter	1.00
E2E_Evaluator_openapi	8321142.122220711 ns/iter	8288155.438196882 ns/iter	1.00
E2E_Evaluator_pre_commit_hooks	337661.0617165245 ns/iter	361639.75253802986 ns/iter	0.93
E2E_Evaluator_pulumi	497809.29169630766 ns/iter	587259.5588243712 ns/iter	0.85
E2E_Evaluator_semantic_release	67470.62161112273 ns/iter	68606.84057265043 ns/iter	0.98
E2E_Evaluator_stale	108085.17259813217 ns/iter	113207.1547030345 ns/iter	0.95
E2E_Evaluator_stylecop	183435.4692971145 ns/iter	198468.96761837538 ns/iter	0.92
E2E_Evaluator_tmuxinator	68818.52572506473 ns/iter	74167.1489140489 ns/iter	0.93
E2E_Evaluator_ui5	331056.6657316769 ns/iter	330567.2152134164 ns/iter	1.00
E2E_Evaluator_ui5_manifest	1548026.4476613805 ns/iter	1579086.023925441 ns/iter	0.98
E2E_Evaluator_unreal_engine_uproject	307601.9638766783 ns/iter	348299.260869543 ns/iter	0.88
E2E_Evaluator_vercel	228786.59096687657 ns/iter	247087.57049294823 ns/iter	0.93
E2E_Evaluator_yamllint	5602.918455007435 ns/iter	6503.547667398199 ns/iter	0.86
Micro_Draft4_Meta_1_No_Callback	126.76234530668577 ns/iter	156.7203868002781 ns/iter	0.81
Micro_Draft4_Required_Properties	614.6598574431928 ns/iter	724.8791187335778 ns/iter	0.85
Micro_Draft4_Many_Optional_Properties_Minimal_Match	15.625155443943674 ns/iter	15.901629389901572 ns/iter	0.98
Micro_Draft4_Few_Optional_Properties_Minimal_Match	6.96311240910022 ns/iter	6.965428512958099 ns/iter	1.00
Micro_Draft4_Items_Schema	254.79110691853853 ns/iter	255.84108814097166 ns/iter	1.00
Micro_Draft4_Nested_Object	0.6770890019581779 ns/iter	0.712708772536076 ns/iter	0.95
Micro_Draft4_Properties_Triad_Optional	197.61846742631192 ns/iter	197.70423705734964 ns/iter	1.00
Micro_Draft4_Properties_Triad_Closed	162.16799618361443 ns/iter	163.84656487780867 ns/iter	0.99
Micro_Draft4_Properties_Triad_Required	208.17615658468108 ns/iter	208.13843479525053 ns/iter	1.00
Micro_Draft4_Properties_Closed	36.800226756110426 ns/iter	37.36564613036344 ns/iter	0.98
Micro_Draft4_Non_Recursive_Ref	12.565831760883167 ns/iter	13.758980268478721 ns/iter	0.91
Micro_Draft4_Pattern_Properties_True	133.67614349027446 ns/iter	155.95501870818907 ns/iter	0.86
Micro_Draft4_Ref_To_Single_Property	6.976133613243845 ns/iter	7.565446582279797 ns/iter	0.92
Micro_Draft4_Additional_Properties_Type	25.260124220791905 ns/iter	30.519163220648373 ns/iter	0.83
Micro_Draft4_Nested_Oneof	40.435478924830505 ns/iter	42.201800895409974 ns/iter	0.96
Micro_Draft4_Short_Enum	4.809893660919849 ns/iter	5.063492079998468 ns/iter	0.95
Micro_Draft4_Long_Enum	9.780814679154856 ns/iter	10.801450474866712 ns/iter	0.91
Micro_Draft4_Long_Enum_Short_Strings	6.098816900459098 ns/iter	6.382213597478304 ns/iter	0.96
Micro_Draft4_Type_Object	2.1522051452464694 ns/iter	2.370384152298418 ns/iter	0.91
Micro_Draft4_Ref_Single_100	1683321.3285714183 ns/iter	1747226.08521289 ns/iter	0.96
Micro_Draft4_Compile_Ref_Many_Nested	1227919.781138624 ns/iter	1340004.1232642934 ns/iter	0.92
Micro_Draft4_Compile_Wrap	2035233.2853112244 ns/iter	2374206.422017992 ns/iter	0.86
Micro_Draft6_Property_Names	94.27162143739973 ns/iter	98.13793173622473 ns/iter	0.96
Micro_Draft6_Compile_FHIR	9862739375.000046 ns/iter	13431330833.000175 ns/iter	0.73
Micro_Draft7_If_Then_Else	17.284970407336957 ns/iter	21.264487575554757 ns/iter	0.81
Micro_2019_09_Unevaluated_Properties	26.06593398804499 ns/iter	29.01464190075954 ns/iter	0.90
Micro_2019_09_Compile_Wrap	321785458.0000221 ns/iter	415873041.5001628 ns/iter	0.77
Micro_2019_09_KrakenD_Linter_Check	645580667.0001038 ns/iter	783878875.0004823 ns/iter	0.82
Micro_2019_09_KrakenD_Linter_Apply	5867855458.000122 ns/iter	6898084874.999767 ns/iter	0.85
Micro_2020_12_Dynamic_Ref	188.01958954805767 ns/iter	201.6864824766021 ns/iter	0.93
Micro_2020_12_Dynamic_Ref_Single	2.1640728436741803 ns/iter	2.5597989469129967 ns/iter	0.85
Micro_2020_12_Simple_Output_Mask	61068.07772834343 ns/iter	66402.04862674663 ns/iter	0.92
Micro_2020_12_Simple_Output_Annotations	86095.58376868615 ns/iter	88490.67549503373 ns/iter	0.97
Micro_2020_12_Compile_NonCircular_Shared_Refs	816122.1576472813 ns/iter	863537.2340425502 ns/iter	0.95
Micro_2020_12_Exhaustive_Deep_Numeric	5315.728475166523 ns/iter	5485.998346654982 ns/iter	0.97
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput	116167.51572105882 ns/iter	132647.94259694105 ns/iter	0.88
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput	14440.41216060138 ns/iter	15724.975017002815 ns/iter	0.92
Micro_2020_12_Exhaustive_Deep_Numeric_Fail	93.11733963117858 ns/iter	100.77807861869606 ns/iter	0.92
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput	4806.876073754102 ns/iter	4880.358027238379 ns/iter	0.98

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

JavaScript (macos/llvm)

Details

Benchmark suite	Current: 7ec1968	Previous: 2c4115a	Ratio
E2E_Evaluator_adaptivecard	102125 ns	105211 ns	0.97
E2E_Evaluator_ansible-meta	745278 ns	943547 ns	0.79
E2E_Evaluator_aws-cdk	170487 ns	186007 ns	0.92
E2E_Evaluator_babelrc	295411 ns	319757 ns	0.92
E2E_Evaluator_cerebrum-criminal-case	3160122 ns	3416155 ns	0.93
E2E_Evaluator_clang-format	113028 ns	124712 ns	0.91
E2E_Evaluator_cmake-presets	14142857 ns	14121052 ns	1.00
E2E_Evaluator_code-climate	705061 ns	752610 ns	0.94
E2E_Evaluator_cql2	871590 ns	965000 ns	0.90
E2E_Evaluator_cspell	1440831 ns	1459897 ns	0.99
E2E_Evaluator_cypress	555695 ns	460251 ns	1.21
E2E_Evaluator_deno	1233134 ns	891019 ns	1.38
E2E_Evaluator_dependabot	1444509 ns	1453134 ns	0.99
E2E_Evaluator_draft-04	19114651 ns	17507571 ns	1.09
E2E_Evaluator_fabric-mod	3078276 ns	2670881 ns	1.15
E2E_Evaluator_geojson	53373820 ns	51217654 ns	1.04
E2E_Evaluator_gitpod-configuration	743126 ns	831013 ns	0.89
E2E_Evaluator_helm-chart-lock	1586645 ns	1535707 ns	1.03
E2E_Evaluator_importmap	336874 ns	435957 ns	0.77
E2E_Evaluator_jasmine	436559 ns	479780 ns	0.91
E2E_Evaluator_jsconfig	1091981 ns	1490823 ns	0.73
E2E_Evaluator_jshintrc	2044062 ns	2463303 ns	0.83
E2E_Evaluator_krakend	800445 ns	733464 ns	1.09
E2E_Evaluator_lazygit	415805 ns	563718 ns	0.74
E2E_Evaluator_lerna	488305 ns	454366 ns	1.07
E2E_Evaluator_nest-cli	643575 ns	632741 ns	1.02
E2E_Evaluator_omc	70234 ns	70660 ns	0.99
E2E_Evaluator_omnisharp	1055495 ns	1023261 ns	1.03
E2E_Evaluator_openapi	29672913 ns	32389212 ns	0.92
E2E_Evaluator_pre-commit-hooks	1384558 ns	1347228 ns	1.03
E2E_Evaluator_pulumi	2427357 ns	2189771 ns	1.11
E2E_Evaluator_semantic-release	412120 ns	387277 ns	1.06
E2E_Evaluator_stale	543647 ns	495582 ns	1.10
E2E_Evaluator_stylecop	1052203 ns	828955 ns	1.27
E2E_Evaluator_tmuxinator	327657 ns	427576 ns	0.77
E2E_Evaluator_ui5	2251811 ns	1999439 ns	1.13
E2E_Evaluator_ui5-manifest	9721996 ns	8809526 ns	1.10
E2E_Evaluator_unreal-engine-uproject	1499133 ns	1466575 ns	1.02
E2E_Evaluator_vercel	1137341 ns	1003702 ns	1.13
E2E_Evaluator_yamllint	54069 ns	56279 ns	0.96

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

Benchmark (linux/gcc)

Details

Benchmark suite	Current: 7ec1968	Previous: 2c4115a	Ratio
Micro_2020_12_Dynamic_Ref	254.84622373935798 ns/iter	260.8311432009952 ns/iter	0.98
Micro_2020_12_Dynamic_Ref_Single	4.998893668725695 ns/iter	4.984473319032307 ns/iter	1.00
Micro_2020_12_Simple_Output_Mask	74011.01893142471 ns/iter	75636.39332334859 ns/iter	0.98
Micro_2020_12_Simple_Output_Annotations	111714.48932384793 ns/iter	115787.86677656899 ns/iter	0.96
Micro_2020_12_Compile_NonCircular_Shared_Refs	1211150.0275862312 ns/iter	1207623.7224136845 ns/iter	1.00
Micro_2020_12_Exhaustive_Deep_Numeric	8313.699900347301 ns/iter	8238.91245010131 ns/iter	1.01
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput	165431.61198288362 ns/iter	166628.0568319264 ns/iter	0.99
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput	25174.842649062302 ns/iter	25456.9242616396 ns/iter	0.99
Micro_2020_12_Exhaustive_Deep_Numeric_Fail	126.3127745540068 ns/iter	128.18184768550304 ns/iter	0.99
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput	4802.748872079032 ns/iter	4912.319583802102 ns/iter	0.98
Micro_2019_09_Unevaluated_Properties	28.700369740001815 ns/iter	28.678889267439224 ns/iter	1.00
Micro_2019_09_Compile_Wrap	304607665.00004864 ns/iter	329846693.5000306 ns/iter	0.92
Micro_2019_09_KrakenD_Linter_Check	1254103052.000005 ns/iter	1318010146.000006 ns/iter	0.95
Micro_2019_09_KrakenD_Linter_Apply	11052624744.000013 ns/iter	11649729462.999857 ns/iter	0.95
Micro_Draft7_If_Then_Else	24.59446933890492 ns/iter	24.603531352797358 ns/iter	1.00
Micro_Draft6_Property_Names	142.6111193616988 ns/iter	143.05457614446468 ns/iter	1.00
Micro_Draft6_Compile_FHIR	14212205323.000034 ns/iter	15609694079.000065 ns/iter	0.91
Micro_Draft4_Meta_1_No_Callback	166.240269493836 ns/iter	166.2672419465093 ns/iter	1.00
Micro_Draft4_Required_Properties	821.3626298448272 ns/iter	814.1041847298264 ns/iter	1.01
Micro_Draft4_Many_Optional_Properties_Minimal_Match	21.211827596313146 ns/iter	22.18421336747148 ns/iter	0.96
Micro_Draft4_Few_Optional_Properties_Minimal_Match	13.102034290388296 ns/iter	13.09650577180572 ns/iter	1.00
Micro_Draft4_Items_Schema	324.7791957380412 ns/iter	324.5567135566793 ns/iter	1.00
Micro_Draft4_Nested_Object	1.869214921046078 ns/iter	1.8683051328142222 ns/iter	1.00
Micro_Draft4_Properties_Triad_Optional	377.27635876944663 ns/iter	374.2614817454294 ns/iter	1.01
Micro_Draft4_Properties_Triad_Closed	299.02949662988215 ns/iter	319.0365129809038 ns/iter	0.94
Micro_Draft4_Properties_Triad_Required	445.8684321476047 ns/iter	403.8823800641085 ns/iter	1.10
Micro_Draft4_Properties_Closed	63.372650774331596 ns/iter	63.01748658993822 ns/iter	1.01
Micro_Draft4_Non_Recursive_Ref	9.652990484121116 ns/iter	9.651093325329832 ns/iter	1.00
Micro_Draft4_Pattern_Properties_True	208.00769244037025 ns/iter	207.9205738832722 ns/iter	1.00
Micro_Draft4_Ref_To_Single_Property	13.401898099366198 ns/iter	13.406260167337193 ns/iter	1.00
Micro_Draft4_Additional_Properties_Type	15.253708028836073 ns/iter	15.342252392069273 ns/iter	0.99
Micro_Draft4_Nested_Oneof	65.40154402098025 ns/iter	66.65006900307209 ns/iter	0.98
Micro_Draft4_Short_Enum	14.65321340270471 ns/iter	14.681676934341839 ns/iter	1.00
Micro_Draft4_Long_Enum	14.342388336236626 ns/iter	14.361863794586805 ns/iter	1.00
Micro_Draft4_Long_Enum_Short_Strings	14.658119086260479 ns/iter	14.6538114278103 ns/iter	1.00
Micro_Draft4_Type_Object	4.673923192901569 ns/iter	4.670563271144809 ns/iter	1.00
Micro_Draft4_Ref_Single_100	2530569.1335737854 ns/iter	2534904.1159419017 ns/iter	1.00
Micro_Draft4_Compile_Ref_Many_Nested	1846509.1858638397 ns/iter	1837413.6151833322 ns/iter	1.00
Micro_Draft4_Compile_Wrap	2612389.551851872 ns/iter	2613001.6791045764 ns/iter	1.00
E2E_Compiler_adaptivecard	65634794.090907566 ns/iter	69838567.30000752 ns/iter	0.94
E2E_Compiler_ansible_meta	30444345.043475628 ns/iter	30961998.826094948 ns/iter	0.98
E2E_Compiler_aws_cdk	413794.970414211 ns/iter	416918.1206896926 ns/iter	0.99
E2E_Compiler_babelrc	2793290.892430421 ns/iter	2793814.8951613307 ns/iter	1.00
E2E_Compiler_clang_format	19714988.250001397 ns/iter	19742336.08571662 ns/iter	1.00
E2E_Compiler_cmake_presets	27168472.7692288 ns/iter	27842554.119997658 ns/iter	0.98
E2E_Compiler_code_climate	2820963.9354834566 ns/iter	2834654.5020083277 ns/iter	1.00
E2E_Compiler_cql2	13961601.660000725 ns/iter	14187823.795918101 ns/iter	0.98
E2E_Compiler_cspell	24032068.241381396 ns/iter	24426203.68965279 ns/iter	0.98
E2E_Compiler_cypress	4155826.1360947904 ns/iter	4168037.8630950428 ns/iter	1.00
E2E_Compiler_deno	8246034.235293443 ns/iter	8229770.752942546 ns/iter	1.00
E2E_Compiler_dependabot	4230686.47272692 ns/iter	4199027.443114927 ns/iter	1.01
E2E_Compiler_draft_04	2958061.508403708 ns/iter	2958329.8734180545 ns/iter	1.00
E2E_Compiler_fabric_mod	5144636.801470129 ns/iter	5184974.918517616 ns/iter	0.99
E2E_Compiler_geojson	23910173.379312225 ns/iter	24211864.379312515 ns/iter	0.99
E2E_Compiler_gitpod_configuration	5304375.825758281 ns/iter	5312348.621211613 ns/iter	1.00
E2E_Compiler_helm_chart_lock	757419.3264865145 ns/iter	757086.5691144282 ns/iter	1.00
E2E_Compiler_importmap	311651.7910182127 ns/iter	312715.67321431753 ns/iter	1.00
E2E_Compiler_jasmine	1475772.273684015 ns/iter	1482346.8942915928 ns/iter	1.00
E2E_Compiler_jshintrc	4731135.140939646 ns/iter	4741408.364864312 ns/iter	1.00
E2E_Compiler_jsconfig	23360976.433336116 ns/iter	23892481.793107685 ns/iter	0.98
E2E_Compiler_krakend	142425095.59999233 ns/iter	155333196.99998173 ns/iter	0.92
E2E_Compiler_lazygit	35337690.049999535 ns/iter	36153970.42105877 ns/iter	0.98
E2E_Compiler_lerna	1735042.3589110698 ns/iter	1750167.4475005302 ns/iter	0.99
E2E_Compiler_nest_cli	8049311.579545752 ns/iter	8059545.172414048 ns/iter	1.00
E2E_Compiler_omc	163592475.7499936 ns/iter	175887310.7499994 ns/iter	0.93
E2E_Compiler_omnisharp	7205642.8061227035 ns/iter	7193322.938774701 ns/iter	1.00
E2E_Compiler_openapi	27068707.73076494 ns/iter	27531856.423077162 ns/iter	0.98
E2E_Compiler_pre_commit_hooks	5736031.81147541 ns/iter	5761049.073768965 ns/iter	1.00
E2E_Compiler_pulumi	4386567.006249464 ns/iter	4382214.093749326 ns/iter	1.00
E2E_Compiler_semantic_release	1727968.7346437094 ns/iter	1722719.4324323472 ns/iter	1.00
E2E_Compiler_stale	1682208.1111110826 ns/iter	1684713.6867470974 ns/iter	1.00
E2E_Compiler_stylecop	6375876.854544706 ns/iter	6437879.231481457 ns/iter	0.99
E2E_Compiler_tmuxinator	2119004.791540792 ns/iter	2115397.2590359007 ns/iter	1.00
E2E_Compiler_ui5	48711152.42856864 ns/iter	50782588.28572351 ns/iter	0.96
E2E_Compiler_ui5_manifest	321768292.4999963 ns/iter	352562990.5000187 ns/iter	0.91
E2E_Compiler_unreal_engine_uproject	4926025.288732106 ns/iter	4982437.588652687 ns/iter	0.99
E2E_Compiler_vercel	13180668.660377808 ns/iter	13465344.980768524 ns/iter	0.98
E2E_Compiler_yamllint	380490.5916258932 ns/iter	383012.5890410322 ns/iter	0.99
E2E_Evaluator_adaptivecard	23386.978604649325 ns/iter	23404.205380866395 ns/iter	1.00
E2E_Evaluator_ansible_meta	246139.18776370943 ns/iter	249563.27455920726 ns/iter	0.99
E2E_Evaluator_aws_cdk	51137.5187285517 ns/iter	51354.800676423685 ns/iter	1.00
E2E_Evaluator_babelrc	106312.31785769272 ns/iter	106983.09408444315 ns/iter	0.99
E2E_Evaluator_cerebrum_criminal_case	1273188.409506401 ns/iter	1296708.2078650035 ns/iter	0.98
E2E_Evaluator_clang_format	105988.34113206633 ns/iter	105413.72004854193 ns/iter	1.01
E2E_Evaluator_cmake_presets	4434214.006369219 ns/iter	5036304.942447171 ns/iter	0.88
E2E_Evaluator_code_climate	183491.85992114627 ns/iter	190130.52339966042 ns/iter	0.97
E2E_Evaluator_cql2	216675.76598349636 ns/iter	217166.2380512341 ns/iter	1.00
E2E_Evaluator_cspell	540489.4122256484 ns/iter	550658.0629425568 ns/iter	0.98
E2E_Evaluator_cypress	171637.95501815656 ns/iter	169856.819125821 ns/iter	1.01
E2E_Evaluator_deno	333654.687441016 ns/iter	337420.17989416036 ns/iter	0.99
E2E_Evaluator_dependabot	462443.10166113125 ns/iter	474103.4291443008 ns/iter	0.98
E2E_Evaluator_draft_04	6374847.371428889 ns/iter	7964502.8750018235 ns/iter	0.80
E2E_Evaluator_fabric_mod	735561.4139387705 ns/iter	739169.6066450793 ns/iter	1.00
E2E_Evaluator_geojson	16891828.068180945 ns/iter	17135018.82926632 ns/iter	0.99
E2E_Evaluator_gitpod_configuration	252140.10071173604 ns/iter	258844.4305147545 ns/iter	0.97
E2E_Evaluator_helm_chart_lock	316152.2803271148 ns/iter	332986.084190754 ns/iter	0.95
E2E_Evaluator_importmap	47746.24688419455 ns/iter	50600.3082999996 ns/iter	0.94
E2E_Evaluator_jasmine	117353.7306223988 ns/iter	116441.4660370963 ns/iter	1.01
E2E_Evaluator_jshintrc	1029851.1220587911 ns/iter	1035428.3220588994 ns/iter	0.99
E2E_Evaluator_jsconfig	396450.4703196287 ns/iter	404598.1720741572 ns/iter	0.98
E2E_Evaluator_krakend	203995.25206612414 ns/iter	210961.7451690908 ns/iter	0.97
E2E_Evaluator_lazygit	137447.08016464688 ns/iter	134403.47773363104 ns/iter	1.02
E2E_Evaluator_lerna	151220.1652040411 ns/iter	153663.8043010606 ns/iter	0.98
E2E_Evaluator_nest_cli	195638.8065248233 ns/iter	198091.0954674565 ns/iter	0.99
E2E_Evaluator_omc	19010.925291108328 ns/iter	19288.27067440665 ns/iter	0.99
E2E_Evaluator_omnisharp	558370.7540322833 ns/iter	561580.9774011681 ns/iter	0.99
E2E_Evaluator_openapi	12232003.454544777 ns/iter	15804157.391303504 ns/iter	0.77
E2E_Evaluator_pre_commit_hooks	510342.8486238576 ns/iter	524382.414380996 ns/iter	0.97
E2E_Evaluator_pulumi	709767.7835366166 ns/iter	720620.510266881 ns/iter	0.98
E2E_Evaluator_semantic_release	102808.65093512737 ns/iter	103688.22402402006 ns/iter	0.99
E2E_Evaluator_stale	155551.64961065876 ns/iter	157596.6275115972 ns/iter	0.99
E2E_Evaluator_stylecop	302450.2562553867 ns/iter	303560.368443907 ns/iter	1.00
E2E_Evaluator_tmuxinator	98327.20055672208 ns/iter	100415.63074351507 ns/iter	0.98
E2E_Evaluator_ui5	532105.3700607731 ns/iter	569999.4302236447 ns/iter	0.93
E2E_Evaluator_ui5_manifest	2697660.6177606625 ns/iter	2810541.1624996653 ns/iter	0.96
E2E_Evaluator_unreal_engine_uproject	461808.0912646404 ns/iter	472303.78638816095 ns/iter	0.98
E2E_Evaluator_vercel	319804.50957155833 ns/iter	322578.13545998384 ns/iter	0.99
E2E_Evaluator_yamllint	10932.527720483145 ns/iter	10780.243787997895 ns/iter	1.01

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

JavaScript (linux/gcc)

Details

Benchmark suite	Current: 7ec1968	Previous: 2c4115a	Ratio
E2E_Evaluator_adaptivecard	109566 ns	109638 ns	1.00
E2E_Evaluator_ansible-meta	1039149 ns	951621 ns	1.09
E2E_Evaluator_aws-cdk	212928 ns	217357 ns	0.98
E2E_Evaluator_babelrc	399980 ns	422183 ns	0.95
E2E_Evaluator_cerebrum-criminal-case	4268893 ns	4403718 ns	0.97
E2E_Evaluator_clang-format	154151 ns	153458 ns	1.00
E2E_Evaluator_cmake-presets	15843749 ns	17385817 ns	0.91
E2E_Evaluator_code-climate	819339 ns	837679 ns	0.98
E2E_Evaluator_cql2	1050088 ns	1100300 ns	0.95
E2E_Evaluator_cspell	1703124 ns	1786528 ns	0.95
E2E_Evaluator_cypress	502757 ns	535191 ns	0.94
E2E_Evaluator_deno	979126 ns	1020699 ns	0.96
E2E_Evaluator_dependabot	1497518 ns	1513906 ns	0.99
E2E_Evaluator_draft-04	19108370 ns	22369693 ns	0.85
E2E_Evaluator_fabric-mod	2969812 ns	3084779 ns	0.96
E2E_Evaluator_geojson	54061351 ns	54607182 ns	0.99
E2E_Evaluator_gitpod-configuration	872496 ns	885810 ns	0.98
E2E_Evaluator_helm-chart-lock	1450503 ns	1429843 ns	1.01
E2E_Evaluator_importmap	401337 ns	411702 ns	0.97
E2E_Evaluator_jasmine	464814 ns	458284 ns	1.01
E2E_Evaluator_jsconfig	1312622 ns	1353078 ns	0.97
E2E_Evaluator_jshintrc	1862960 ns	1873333 ns	0.99
E2E_Evaluator_krakend	689579 ns	705941 ns	0.98
E2E_Evaluator_lazygit	468407 ns	472280 ns	0.99
E2E_Evaluator_lerna	519612 ns	524987 ns	0.99
E2E_Evaluator_nest-cli	819456 ns	821486 ns	1.00
E2E_Evaluator_omc	84153 ns	85160 ns	0.99
E2E_Evaluator_omnisharp	1179855 ns	1191531 ns	0.99
E2E_Evaluator_openapi	39209745 ns	44248877 ns	0.89
E2E_Evaluator_pre-commit-hooks	1446755 ns	1475634 ns	0.98
E2E_Evaluator_pulumi	2678556 ns	2611695 ns	1.03
E2E_Evaluator_semantic-release	494280 ns	475541 ns	1.04
E2E_Evaluator_stale	558718 ns	559676 ns	1.00
E2E_Evaluator_stylecop	972507 ns	994069 ns	0.98
E2E_Evaluator_tmuxinator	375784 ns	370965 ns	1.01
E2E_Evaluator_ui5	2187097 ns	2228854 ns	0.98
E2E_Evaluator_ui5-manifest	9925221 ns	12056548 ns	0.82
E2E_Evaluator_unreal-engine-uproject	1589673 ns	1617944 ns	0.98
E2E_Evaluator_vercel	1093991 ns	1135673 ns	0.96
E2E_Evaluator_yamllint	71173 ns	70963 ns	1.00

This comment was automatically generated by workflow using github-action-benchmark.

[augmentcode]

This pull request is too large for Augment to review. The PR exceeds the maximum size limit of 100000 tokens (approximately 400000 characters) for automated code review. Please consider breaking this PR into smaller, more focused changes.

[cubic-dev-ai]

No issues found across 17 files