Add position information to TestCase
#576
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
![github-actions[bot]](https://avatars.githubusercontent.com/in/15368?s=60&v=4){kind=small}
There was a problem hiding this comment.
Bindings (linux/nodejs)
Details
| Benchmark suite | Current: eeb3226 | Previous: 9c22fb1 | Ratio |
|---|---|---|---|
E2E_Parse_BlazeJSON_ui5_manifest |
109 ops/sec (±0.37%) |
111 ops/sec (±0.27%) |
1.02 |
E2E_Parse_JSON_ui5_manifest |
782 ops/sec (±0.38%) |
794 ops/sec (±0.40%) |
1.02 |
E2E_Evaluator_adaptivecard |
14186 ops/sec (±0.45%) |
14091 ops/sec (±0.18%) |
0.99 |
E2E_Evaluator_ansible_meta |
1948 ops/sec (±0.17%) |
1857 ops/sec (±0.14%) |
0.95 |
E2E_Evaluator_aws_cdk |
2828 ops/sec (±0.46%) |
2707 ops/sec (±0.09%) |
0.96 |
E2E_Evaluator_babelrc |
1499 ops/sec (±0.14%) |
1529 ops/sec (±0.10%) |
1.02 |
E2E_Evaluator_clang_format |
5018 ops/sec (±1.52%) |
4968 ops/sec (±0.90%) |
0.99 |
E2E_Evaluator_cmake_presets |
121 ops/sec (±2.39%) |
144 ops/sec (±0.80%) |
1.19 |
E2E_Evaluator_code_climate |
578 ops/sec (±0.56%) |
551 ops/sec (±0.13%) |
0.95 |
E2E_Evaluator_cql2 |
2788 ops/sec (±0.27%) |
2776 ops/sec (±0.64%) |
1.00 |
E2E_Evaluator_cspell |
724 ops/sec (±0.64%) |
772 ops/sec (±0.54%) |
1.07 |
E2E_Evaluator_cypress |
1284 ops/sec (±1.27%) |
1230 ops/sec (±0.89%) |
0.96 |
E2E_Evaluator_deno |
912 ops/sec (±0.20%) |
951 ops/sec (±0.14%) |
1.04 |
E2E_Evaluator_dependabot |
826 ops/sec (±0.23%) |
831 ops/sec (±0.13%) |
1.01 |
E2E_Evaluator_draft_04 |
101 ops/sec (±3.53%) |
101 ops/sec (±0.52%) |
1 |
E2E_Evaluator_fabric_mod |
588 ops/sec (±0.48%) |
587 ops/sec (±0.19%) |
1.00 |
E2E_Evaluator_geojson |
22.34 ops/sec (±1.28%) |
37.13 ops/sec (±0.13%) |
1.66 |
E2E_Evaluator_gitpod_configuration |
1058 ops/sec (±0.67%) |
1047 ops/sec (±0.14%) |
0.99 |
E2E_Evaluator_helm_chart_lock |
323 ops/sec (±2.25%) |
322 ops/sec (±0.88%) |
1.00 |
E2E_Evaluator_importmap |
1609 ops/sec (±0.24%) |
1542 ops/sec (±0.13%) |
0.96 |
E2E_Evaluator_jasmine |
1355 ops/sec (±0.56%) |
1265 ops/sec (±0.12%) |
0.93 |
E2E_Evaluator_jsconfig |
887 ops/sec (±0.23%) |
845 ops/sec (±0.96%) |
0.95 |
E2E_Evaluator_jshintrc |
576 ops/sec (±1.83%) |
585 ops/sec (±0.09%) |
1.02 |
E2E_Evaluator_krakend |
3781 ops/sec (±0.17%) |
3367 ops/sec (±0.46%) |
0.89 |
E2E_Evaluator_lazygit |
2901 ops/sec (±0.22%) |
2675 ops/sec (±0.20%) |
0.92 |
E2E_Evaluator_lerna |
1261 ops/sec (±0.48%) |
1231 ops/sec (±0.20%) |
0.98 |
E2E_Evaluator_nest_cli |
1137 ops/sec (±0.39%) |
1104 ops/sec (±0.14%) |
0.97 |
E2E_Evaluator_omc |
22131 ops/sec (±0.16%) |
22085 ops/sec (±0.15%) |
1.00 |
E2E_Evaluator_omnisharp |
805 ops/sec (±0.19%) |
783 ops/sec (±0.47%) |
0.97 |
E2E_Evaluator_openapi |
54.54 ops/sec (±2.19%) |
60.14 ops/sec (±0.23%) |
1.10 |
E2E_Evaluator_pre_commit_hooks |
725 ops/sec (±2.31%) |
786 ops/sec (±0.23%) |
1.08 |
E2E_Evaluator_pulumi |
215 ops/sec (±2.47%) |
255 ops/sec (±1.68%) |
1.19 |
E2E_Evaluator_semantic_release |
1507 ops/sec (±0.60%) |
1511 ops/sec (±0.40%) |
1.00 |
E2E_Evaluator_stale |
1281 ops/sec (±0.40%) |
1242 ops/sec (±0.13%) |
0.97 |
E2E_Evaluator_stylecop |
1010 ops/sec (±0.25%) |
959 ops/sec (±0.20%) |
0.95 |
E2E_Evaluator_tmuxinator |
2626 ops/sec (±0.49%) |
2597 ops/sec (±0.40%) |
0.99 |
E2E_Evaluator_ui5 |
754 ops/sec (±0.63%) |
694 ops/sec (±0.47%) |
0.92 |
E2E_Evaluator_ui5_manifest |
169 ops/sec (±1.85%) |
199 ops/sec (±1.45%) |
1.18 |
E2E_Evaluator_unreal_engine_uproject |
795 ops/sec (±0.24%) |
802 ops/sec (±0.17%) |
1.01 |
E2E_Evaluator_vercel |
1205 ops/sec (±0.23%) |
1226 ops/sec (±0.30%) |
1.02 |
E2E_Evaluator_yamllint |
1765 ops/sec (±0.27%) |
1658 ops/sec (±0.14%) |
0.94 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Benchmark (linux/llvm)
Details
| Benchmark suite | Current: eeb3226 | Previous: 9c22fb1 | Ratio |
|---|---|---|---|
E2E_Compiler_adaptivecard |
998349245.9999752 ns/iter |
986132666.9999926 ns/iter |
1.01 |
E2E_Compiler_ansible_meta |
29197566.79166596 ns/iter |
28255295.35999976 ns/iter |
1.03 |
E2E_Compiler_aws_cdk |
547372.33873457 ns/iter |
538071.0790483531 ns/iter |
1.02 |
E2E_Compiler_babelrc |
3579080.6717949263 ns/iter |
3553286.035532996 ns/iter |
1.01 |
E2E_Compiler_clang_format |
19231697.3888893 ns/iter |
18927170.89189214 ns/iter |
1.02 |
E2E_Compiler_cmake_presets |
217084718.9999942 ns/iter |
212588469.99999532 ns/iter |
1.02 |
E2E_Compiler_code_climate |
3022563.448275871 ns/iter |
2981092.8425531723 ns/iter |
1.01 |
E2E_Compiler_cql2 |
169178922.0000004 ns/iter |
165230141.24999237 ns/iter |
1.02 |
E2E_Compiler_cspell |
56272216.07692088 ns/iter |
55172347.69230911 ns/iter |
1.02 |
E2E_Compiler_cypress |
6788773.538461284 ns/iter |
6707404.628571112 ns/iter |
1.01 |
E2E_Compiler_deno |
8654224.395061726 ns/iter |
8573292.146340974 ns/iter |
1.01 |
E2E_Compiler_dependabot |
4615396.390728611 ns/iter |
4614113.789473681 ns/iter |
1.00 |
E2E_Compiler_draft_04 |
17592281.925000466 ns/iter |
17410676.374998957 ns/iter |
1.01 |
E2E_Compiler_fabric_mod |
6173185.982143131 ns/iter |
6150586.780701691 ns/iter |
1.00 |
E2E_Compiler_geojson |
30794700.04166751 ns/iter |
29191919.12499978 ns/iter |
1.05 |
E2E_Compiler_gitpod_configuration |
6392251.74545469 ns/iter |
6357655.518181363 ns/iter |
1.01 |
E2E_Compiler_helm_chart_lock |
895629.6618798653 ns/iter |
885593.4930114385 ns/iter |
1.01 |
E2E_Compiler_importmap |
445398.9993622499 ns/iter |
442508.2198357471 ns/iter |
1.01 |
E2E_Compiler_jasmine |
1774417.7898734214 ns/iter |
1775421.7208121684 ns/iter |
1.00 |
E2E_Compiler_jshintrc |
4701239.456375831 ns/iter |
4899715.845637512 ns/iter |
0.96 |
E2E_Compiler_jsconfig |
24160836.724137943 ns/iter |
23880114.827587195 ns/iter |
1.01 |
E2E_Compiler_krakend |
252750020.00000766 ns/iter |
250969302.333336 ns/iter |
1.01 |
E2E_Compiler_lazygit |
39480047.055554405 ns/iter |
39606074.77777798 ns/iter |
1.00 |
E2E_Compiler_lerna |
1917031.013661197 ns/iter |
1912124.4098360178 ns/iter |
1.00 |
E2E_Compiler_nest_cli |
10396407.850746255 ns/iter |
10375255.88059683 ns/iter |
1.00 |
E2E_Compiler_omc |
1616434824.0000095 ns/iter |
1578376680.0000193 ns/iter |
1.02 |
E2E_Compiler_omnisharp |
7904337.99999985 ns/iter |
7849272.011235805 ns/iter |
1.01 |
E2E_Compiler_openapi |
1155107119.9999683 ns/iter |
1146996495.9999857 ns/iter |
1.01 |
E2E_Compiler_pre_commit_hooks |
5188994.536764572 ns/iter |
5174895.6740741255 ns/iter |
1.00 |
E2E_Compiler_pulumi |
4934314.73239405 ns/iter |
4894377.05594425 ns/iter |
1.01 |
E2E_Compiler_semantic_release |
1868672.4403182322 ns/iter |
1834410.8766404209 ns/iter |
1.02 |
E2E_Compiler_stale |
2209232.208202042 ns/iter |
2189249.153124884 ns/iter |
1.01 |
E2E_Compiler_stylecop |
6727547.605769665 ns/iter |
6641700.180952219 ns/iter |
1.01 |
E2E_Compiler_tmuxinator |
2376788.625000096 ns/iter |
2345438.083612059 ns/iter |
1.01 |
E2E_Compiler_ui5 |
153355746.59999338 ns/iter |
152592568.4000072 ns/iter |
1.01 |
E2E_Compiler_ui5_manifest |
2044090342.000004 ns/iter |
2049887350.9999952 ns/iter |
1.00 |
E2E_Compiler_unreal_engine_uproject |
5305411.776922798 ns/iter |
5277054.7022903375 ns/iter |
1.01 |
E2E_Compiler_vercel |
16850742.547619898 ns/iter |
16756877.619048368 ns/iter |
1.01 |
E2E_Compiler_yamllint |
454929.26753247326 ns/iter |
452127.7221502624 ns/iter |
1.01 |
E2E_Evaluator_adaptivecard |
54177.993408145696 ns/iter |
54096.662410028526 ns/iter |
1.00 |
E2E_Evaluator_ansible_meta |
317255.32360985543 ns/iter |
319809.64652015077 ns/iter |
0.99 |
E2E_Evaluator_aws_cdk |
70724.45842628414 ns/iter |
69782.24103445033 ns/iter |
1.01 |
E2E_Evaluator_babelrc |
162590.3312757253 ns/iter |
162387.2946837841 ns/iter |
1.00 |
E2E_Evaluator_clang_format |
138056.4705882312 ns/iter |
138712.59790348343 ns/iter |
1.00 |
E2E_Evaluator_cmake_presets |
6340297.16666665 ns/iter |
6104784.07562997 ns/iter |
1.04 |
E2E_Evaluator_code_climate |
285509.1670077871 ns/iter |
277906.0307753859 ns/iter |
1.03 |
E2E_Evaluator_cql2 |
264375.9368421213 ns/iter |
271849.3388461569 ns/iter |
0.97 |
E2E_Evaluator_cspell |
727245.627492153 ns/iter |
725754.9529289003 ns/iter |
1.00 |
E2E_Evaluator_cypress |
229195.54539473244 ns/iter |
230845.199737625 ns/iter |
0.99 |
E2E_Evaluator_deno |
398590.81196091615 ns/iter |
394942.96090651915 ns/iter |
1.01 |
E2E_Evaluator_dependabot |
562711.2668288563 ns/iter |
566482.6541904176 ns/iter |
0.99 |
E2E_Evaluator_draft_04 |
9498829.066666683 ns/iter |
9941639.242857393 ns/iter |
0.96 |
E2E_Evaluator_fabric_mod |
956868.8380566658 ns/iter |
954100.4797297104 ns/iter |
1.00 |
E2E_Evaluator_geojson |
29917202.043478757 ns/iter |
29990119.17391361 ns/iter |
1.00 |
E2E_Evaluator_gitpod_configuration |
330564.8644814034 ns/iter |
332783.5049505026 ns/iter |
0.99 |
E2E_Evaluator_helm_chart_lock |
470185.8253861643 ns/iter |
468306.53342245927 ns/iter |
1.00 |
E2E_Evaluator_importmap |
74437.20027801389 ns/iter |
74656.05036426768 ns/iter |
1.00 |
E2E_Evaluator_jasmine |
168572.60368774013 ns/iter |
167195.65682037146 ns/iter |
1.01 |
E2E_Evaluator_jshintrc |
1443508.6873822953 ns/iter |
1325134.2386363756 ns/iter |
1.09 |
E2E_Evaluator_jsconfig |
520789.2772424044 ns/iter |
526794.1604477616 ns/iter |
0.99 |
E2E_Evaluator_krakend |
267596.4724470048 ns/iter |
263444.08199846133 ns/iter |
1.02 |
E2E_Evaluator_lazygit |
191353.94664804393 ns/iter |
191246.54184901607 ns/iter |
1.00 |
E2E_Evaluator_lerna |
207677.23987174654 ns/iter |
202276.2065154118 ns/iter |
1.03 |
E2E_Evaluator_nest_cli |
264720.31866464415 ns/iter |
263148.6487915291 ns/iter |
1.01 |
E2E_Evaluator_omc |
30210.33204530172 ns/iter |
30872.752938578444 ns/iter |
0.98 |
E2E_Evaluator_omnisharp |
728098.3378238342 ns/iter |
726096.8990731431 ns/iter |
1.00 |
E2E_Evaluator_openapi |
17242607.738094896 ns/iter |
17370841.743589457 ns/iter |
0.99 |
E2E_Evaluator_pre_commit_hooks |
624002.5027173889 ns/iter |
624419.3057041237 ns/iter |
1.00 |
E2E_Evaluator_pulumi |
935519.5381526074 ns/iter |
923783.7636122524 ns/iter |
1.01 |
E2E_Evaluator_semantic_release |
144451.31820049294 ns/iter |
141666.59931985935 ns/iter |
1.02 |
E2E_Evaluator_stale |
210460.62361068936 ns/iter |
209868.77252319542 ns/iter |
1.00 |
E2E_Evaluator_stylecop |
383128.08256382006 ns/iter |
376214.7470461653 ns/iter |
1.02 |
E2E_Evaluator_tmuxinator |
139714.86501101378 ns/iter |
138749.63582088752 ns/iter |
1.01 |
E2E_Evaluator_ui5 |
726481.4324034648 ns/iter |
722768.050000037 ns/iter |
1.01 |
E2E_Evaluator_ui5_manifest |
3538279.191616992 ns/iter |
3643607.6649213796 ns/iter |
0.97 |
E2E_Evaluator_unreal_engine_uproject |
553900.7217805828 ns/iter |
552500.8577075208 ns/iter |
1.00 |
E2E_Evaluator_vercel |
401116.3068965395 ns/iter |
397400.0039637849 ns/iter |
1.01 |
E2E_Evaluator_yamllint |
17548.856682689882 ns/iter |
17889.72439302917 ns/iter |
0.98 |
Micro_Draft4_Meta_1_No_Callback |
324.21694797501243 ns/iter |
327.6551435588232 ns/iter |
0.99 |
Micro_Draft4_Required_Properties |
724.4655063018602 ns/iter |
716.3258679503198 ns/iter |
1.01 |
Micro_Draft4_Many_Optional_Properties_Minimal_Match |
34.86037931626028 ns/iter |
34.88109060313854 ns/iter |
1.00 |
Micro_Draft4_Few_Optional_Properties_Minimal_Match |
16.193131961547092 ns/iter |
16.18442821055944 ns/iter |
1.00 |
Micro_Draft4_Items_Schema |
649.9040421702927 ns/iter |
664.2535329292522 ns/iter |
0.98 |
Micro_Draft4_Nested_Object |
7.48903092319994 ns/iter |
7.5146922406100565 ns/iter |
1.00 |
Micro_Draft4_Properties_Triad_Optional |
384.8225032113307 ns/iter |
384.36075603200635 ns/iter |
1.00 |
Micro_Draft4_Properties_Triad_Closed |
320.4111075420988 ns/iter |
320.7041781889492 ns/iter |
1.00 |
Micro_Draft4_Properties_Triad_Required |
395.2185415650071 ns/iter |
394.80359422685984 ns/iter |
1.00 |
Micro_Draft4_Properties_Closed |
89.15780793224198 ns/iter |
88.39989417937035 ns/iter |
1.01 |
Micro_Draft4_Non_Recursive_Ref |
36.08762327209966 ns/iter |
36.07931027295848 ns/iter |
1.00 |
Micro_Draft4_Pattern_Properties_True |
265.362205711935 ns/iter |
263.4694700905176 ns/iter |
1.01 |
Micro_Draft4_Ref_To_Single_Property |
16.18994928378236 ns/iter |
16.176872360849362 ns/iter |
1.00 |
Micro_Draft4_Additional_Properties_Type |
63.81349416498025 ns/iter |
63.78552165720365 ns/iter |
1.00 |
Micro_Draft4_Nested_Oneof |
93.13240670894652 ns/iter |
93.14728918449993 ns/iter |
1.00 |
Micro_Draft4_Short_Enum |
18.987423099649803 ns/iter |
18.997857522679027 ns/iter |
1.00 |
Micro_Draft4_Long_Enum |
23.656333181696098 ns/iter |
23.686686369246274 ns/iter |
1.00 |
Micro_Draft4_Long_Enum_Short_Strings |
18.67287555317082 ns/iter |
18.68172075610316 ns/iter |
1.00 |
Micro_Draft4_Type_Object |
13.387516408729947 ns/iter |
13.376080586762415 ns/iter |
1.00 |
Micro_Draft4_Ref_Single_100 |
3446361.721951068 ns/iter |
3401640.1893205354 ns/iter |
1.01 |
Micro_Draft4_Ref_Many_Nested |
4688204765.000023 ns/iter |
4966943723.999975 ns/iter |
0.94 |
Micro_Draft6_Property_Names |
129.76865174116858 ns/iter |
129.7353063720997 ns/iter |
1.00 |
Micro_Draft7_If_Then_Else |
42.02275877439804 ns/iter |
42.10976865746045 ns/iter |
1.00 |
Micro_2019_09_Unevaluated_Properties |
55.40288236059183 ns/iter |
55.51461470592626 ns/iter |
1.00 |
Micro_2020_12_Dynamic_Ref |
535.3039283068778 ns/iter |
529.7654900552544 ns/iter |
1.01 |
Micro_2020_12_Dynamic_Ref_Single |
13.395202810645221 ns/iter |
13.383047022668555 ns/iter |
1.00 |
Micro_2020_12_Simple_Output_Mask |
138710.20051876243 ns/iter |
139645.2062673419 ns/iter |
0.99 |
Micro_2020_12_Simple_Output_Annotations |
173012.79999999973 ns/iter |
167201.55722102948 ns/iter |
1.03 |
This comment was automatically generated by workflow using github-action-benchmark.
jviotti
force-pushed
the
case-position
branch
from
28f5a80 to
585c149
Compare
🤖 Augment PR SummarySummary: This PR enriches test-suite parsing by recording source location (line/column span) for each Changes:
Technical Notes: Position is stored as 🤖 Was this summary useful? React with 👍 or 👎 |
![augmentcode[bot]](https://avatars.githubusercontent.com/in/1027498?s=60&v=4){kind=small}
There was a problem hiding this comment.
Benchmark (macos/llvm)
Details
| Benchmark suite | Current: eeb3226 | Previous: 9c22fb1 | Ratio |
|---|---|---|---|
E2E_Compiler_adaptivecard |
979930958.0000682 ns/iter |
748924708.000004 ns/iter |
1.31 |
E2E_Compiler_ansible_meta |
33040560.63636422 ns/iter |
23925552.799998213 ns/iter |
1.38 |
E2E_Compiler_aws_cdk |
501435.59027778415 ns/iter |
350349.93292989535 ns/iter |
1.43 |
E2E_Compiler_babelrc |
4084313.5714294473 ns/iter |
2728847.3966243765 ns/iter |
1.50 |
E2E_Compiler_clang_format |
23026868.03332866 ns/iter |
14309837.346154643 ns/iter |
1.61 |
E2E_Compiler_cmake_presets |
203053000.0000302 ns/iter |
149395291.79998773 ns/iter |
1.36 |
E2E_Compiler_code_climate |
2792707.26102923 ns/iter |
2180757.8280254058 ns/iter |
1.28 |
E2E_Compiler_cql2 |
127844103.99996205 ns/iter |
113301236.16666771 ns/iter |
1.13 |
E2E_Compiler_cspell |
43112399.470587924 ns/iter |
38443357.473684765 ns/iter |
1.12 |
E2E_Compiler_cypress |
5569496.975806121 ns/iter |
5211056.352458936 ns/iter |
1.07 |
E2E_Compiler_deno |
7981610.937497407 ns/iter |
8972702.500000196 ns/iter |
0.89 |
E2E_Compiler_dependabot |
3561684.81595156 ns/iter |
3610563.5721652135 ns/iter |
0.99 |
E2E_Compiler_draft_04 |
11886119.524590079 ns/iter |
11925428.368421739 ns/iter |
1.00 |
E2E_Compiler_fabric_mod |
5132810.4200001685 ns/iter |
4441099.417721477 ns/iter |
1.16 |
E2E_Compiler_geojson |
30815878.772727955 ns/iter |
24386384.419354696 ns/iter |
1.26 |
E2E_Compiler_gitpod_configuration |
5716601.612246506 ns/iter |
5024970.60274 ns/iter |
1.14 |
E2E_Compiler_helm_chart_lock |
833410.7472323318 ns/iter |
586021.3967851062 ns/iter |
1.42 |
E2E_Compiler_importmap |
480907.0890140402 ns/iter |
273780.3830508481 ns/iter |
1.76 |
E2E_Compiler_jasmine |
2055834.8214282119 ns/iter |
1250858.4110091426 ns/iter |
1.64 |
E2E_Compiler_jshintrc |
4671538.934425883 ns/iter |
3144890.7181816758 ns/iter |
1.49 |
E2E_Compiler_jsconfig |
25911930.00000203 ns/iter |
19880529.27027036 ns/iter |
1.30 |
E2E_Compiler_krakend |
286614999.99998343 ns/iter |
180991083.3333106 ns/iter |
1.58 |
E2E_Compiler_lazygit |
44672716.66665814 ns/iter |
31264462.09090649 ns/iter |
1.43 |
E2E_Compiler_lerna |
2096998.849246138 ns/iter |
1437207.2337396995 ns/iter |
1.46 |
E2E_Compiler_nest_cli |
9410308.90804729 ns/iter |
7126168.329999701 ns/iter |
1.32 |
E2E_Compiler_omc |
1698145041.000089 ns/iter |
1276527165.999937 ns/iter |
1.33 |
E2E_Compiler_omnisharp |
8154826.567567545 ns/iter |
6407902.908257702 ns/iter |
1.27 |
E2E_Compiler_openapi |
1527314582.9999065 ns/iter |
891848708.9999871 ns/iter |
1.71 |
E2E_Compiler_pre_commit_hooks |
5564687.179687056 ns/iter |
3852388.5027929503 ns/iter |
1.44 |
E2E_Compiler_pulumi |
3804523.047871585 ns/iter |
3646853.5156254 ns/iter |
1.04 |
E2E_Compiler_semantic_release |
1413107.33122349 ns/iter |
1390496.0248962566 ns/iter |
1.02 |
E2E_Compiler_stale |
1613608.074549798 ns/iter |
1740090.176328625 ns/iter |
0.93 |
E2E_Compiler_stylecop |
5328591.030767991 ns/iter |
5144213.235294113 ns/iter |
1.04 |
E2E_Compiler_tmuxinator |
1632104.8371559377 ns/iter |
1911235.3929412006 ns/iter |
0.85 |
E2E_Compiler_ui5 |
136715850.0000187 ns/iter |
126865861.16666377 ns/iter |
1.08 |
E2E_Compiler_ui5_manifest |
1606400832.9999523 ns/iter |
1436891625.0000439 ns/iter |
1.12 |
E2E_Compiler_unreal_engine_uproject |
4213360.0384627 ns/iter |
3722038.4114580913 ns/iter |
1.13 |
E2E_Compiler_vercel |
14786479.961536804 ns/iter |
13339944.450981598 ns/iter |
1.11 |
E2E_Compiler_yamllint |
396572.25684926705 ns/iter |
287925.69781147933 ns/iter |
1.38 |
E2E_Evaluator_adaptivecard |
52650.506115559634 ns/iter |
45330.517158074115 ns/iter |
1.16 |
E2E_Evaluator_ansible_meta |
248491.7792391885 ns/iter |
206844.90066857677 ns/iter |
1.20 |
E2E_Evaluator_aws_cdk |
65009.67919998857 ns/iter |
45203.093349185845 ns/iter |
1.44 |
E2E_Evaluator_babelrc |
172643.29724088317 ns/iter |
103954.03247812921 ns/iter |
1.66 |
E2E_Evaluator_clang_format |
139073.61593363865 ns/iter |
103814.03229476514 ns/iter |
1.34 |
E2E_Evaluator_cmake_presets |
4002904.7256098236 ns/iter |
3679780.6122447634 ns/iter |
1.09 |
E2E_Evaluator_code_climate |
215182.65831556407 ns/iter |
175587.94490695637 ns/iter |
1.23 |
E2E_Evaluator_cql2 |
169229.69473971787 ns/iter |
168538.1380178704 ns/iter |
1.00 |
E2E_Evaluator_cspell |
634895.974781808 ns/iter |
453042.2792406067 ns/iter |
1.40 |
E2E_Evaluator_cypress |
167037.0153167352 ns/iter |
161220.92016010173 ns/iter |
1.04 |
E2E_Evaluator_deno |
322245.88711829064 ns/iter |
243142.8879207947 ns/iter |
1.33 |
E2E_Evaluator_dependabot |
390932.9828539675 ns/iter |
352504.208224901 ns/iter |
1.11 |
E2E_Evaluator_draft_04 |
7672891.336000248 ns/iter |
5762451.44628118 ns/iter |
1.33 |
E2E_Evaluator_fabric_mod |
811851.9659624945 ns/iter |
628692.4854700965 ns/iter |
1.29 |
E2E_Evaluator_geojson |
26132352.03448469 ns/iter |
17638438.52500031 ns/iter |
1.48 |
E2E_Evaluator_gitpod_configuration |
251620.49413490255 ns/iter |
196252.4461145693 ns/iter |
1.28 |
E2E_Evaluator_helm_chart_lock |
360632.77911278605 ns/iter |
278134.55104363005 ns/iter |
1.30 |
E2E_Evaluator_importmap |
56655.64534699147 ns/iter |
45597.95356991843 ns/iter |
1.24 |
E2E_Evaluator_jasmine |
122453.63863488598 ns/iter |
103096.63533834986 ns/iter |
1.19 |
E2E_Evaluator_jshintrc |
1010500.2909090439 ns/iter |
953211.9073304769 ns/iter |
1.06 |
E2E_Evaluator_jsconfig |
364988.8024625199 ns/iter |
355148.57978197304 ns/iter |
1.03 |
E2E_Evaluator_krakend |
169008.00740912397 ns/iter |
144800.19294377876 ns/iter |
1.17 |
E2E_Evaluator_lazygit |
111426.69370586204 ns/iter |
99948.07370183527 ns/iter |
1.11 |
E2E_Evaluator_lerna |
145620.49286451022 ns/iter |
127108.26059095867 ns/iter |
1.15 |
E2E_Evaluator_nest_cli |
168491.72546048526 ns/iter |
152070.1659768115 ns/iter |
1.11 |
E2E_Evaluator_omc |
26279.939753686187 ns/iter |
21819.275155243624 ns/iter |
1.20 |
E2E_Evaluator_omnisharp |
518227.24999988166 ns/iter |
422430.02977667196 ns/iter |
1.23 |
E2E_Evaluator_openapi |
8692848.702380506 ns/iter |
8133622.2222224325 ns/iter |
1.07 |
E2E_Evaluator_pre_commit_hooks |
401950.9197465833 ns/iter |
370638.711024514 ns/iter |
1.08 |
E2E_Evaluator_pulumi |
653982.1077693277 ns/iter |
608657.8872428718 ns/iter |
1.07 |
E2E_Evaluator_semantic_release |
95614.9671382251 ns/iter |
102376.32899361268 ns/iter |
0.93 |
E2E_Evaluator_stale |
152762.38374586467 ns/iter |
135367.0334891007 ns/iter |
1.13 |
E2E_Evaluator_stylecop |
266016.2577083505 ns/iter |
225991.92743011928 ns/iter |
1.18 |
E2E_Evaluator_tmuxinator |
89846.72886892813 ns/iter |
87479.74405200384 ns/iter |
1.03 |
E2E_Evaluator_ui5 |
472040.59962534736 ns/iter |
428035.8255114266 ns/iter |
1.10 |
E2E_Evaluator_ui5_manifest |
2278675.819672094 ns/iter |
1874427.5210083823 ns/iter |
1.22 |
E2E_Evaluator_unreal_engine_uproject |
366239.6495771509 ns/iter |
368164.7298553479 ns/iter |
0.99 |
E2E_Evaluator_vercel |
228581.95525294752 ns/iter |
260445.36042403977 ns/iter |
0.88 |
E2E_Evaluator_yamllint |
10979.918430182912 ns/iter |
11948.62006786418 ns/iter |
0.92 |
Micro_Draft4_Meta_1_No_Callback |
190.18649981373713 ns/iter |
200.53996135120866 ns/iter |
0.95 |
Micro_Draft4_Required_Properties |
523.6460792601732 ns/iter |
515.3613749999977 ns/iter |
1.02 |
Micro_Draft4_Many_Optional_Properties_Minimal_Match |
22.52634887285593 ns/iter |
24.26611426081371 ns/iter |
0.93 |
Micro_Draft4_Few_Optional_Properties_Minimal_Match |
7.3711175573147845 ns/iter |
9.469377410890544 ns/iter |
0.78 |
Micro_Draft4_Items_Schema |
467.96599766324607 ns/iter |
540.2631994759876 ns/iter |
0.87 |
Micro_Draft4_Nested_Object |
3.4214880148934577 ns/iter |
3.826619471219998 ns/iter |
0.89 |
Micro_Draft4_Properties_Triad_Optional |
278.0268516806877 ns/iter |
422.52976730078274 ns/iter |
0.66 |
Micro_Draft4_Properties_Triad_Closed |
227.2647021810344 ns/iter |
291.2704085266616 ns/iter |
0.78 |
Micro_Draft4_Properties_Triad_Required |
273.13921312585427 ns/iter |
483.39874927460244 ns/iter |
0.57 |
Micro_Draft4_Properties_Closed |
63.34834950385822 ns/iter |
67.39764407907401 ns/iter |
0.94 |
Micro_Draft4_Non_Recursive_Ref |
28.436808944704996 ns/iter |
27.184235419969397 ns/iter |
1.05 |
Micro_Draft4_Pattern_Properties_True |
189.99928042295127 ns/iter |
193.61466900889076 ns/iter |
0.98 |
Micro_Draft4_Ref_To_Single_Property |
8.336912170538886 ns/iter |
11.257668326978221 ns/iter |
0.74 |
Micro_Draft4_Additional_Properties_Type |
46.602956780989494 ns/iter |
50.26816497874401 ns/iter |
0.93 |
Micro_Draft4_Nested_Oneof |
59.276887430687644 ns/iter |
62.25844064922441 ns/iter |
0.95 |
Micro_Draft4_Short_Enum |
9.935288364497312 ns/iter |
10.317945045009159 ns/iter |
0.96 |
Micro_Draft4_Long_Enum |
24.98628596264795 ns/iter |
27.002169097105835 ns/iter |
0.93 |
Micro_Draft4_Long_Enum_Short_Strings |
12.552825481459507 ns/iter |
11.67995650474709 ns/iter |
1.07 |
Micro_Draft4_Type_Object |
7.340843569691829 ns/iter |
6.943780454999635 ns/iter |
1.06 |
Micro_Draft4_Ref_Single_100 |
2924831.243243502 ns/iter |
2555494.377162699 ns/iter |
1.14 |
Micro_Draft4_Ref_Many_Nested |
3862910124.9998713 ns/iter |
3335242249.9999647 ns/iter |
1.16 |
Micro_Draft6_Property_Names |
153.95198619910948 ns/iter |
119.89729605819376 ns/iter |
1.28 |
Micro_Draft7_If_Then_Else |
37.813752463998235 ns/iter |
34.76941218834968 ns/iter |
1.09 |
Micro_2019_09_Unevaluated_Properties |
52.905340659433435 ns/iter |
52.89432121571401 ns/iter |
1.00 |
Micro_2020_12_Dynamic_Ref |
684.8204126202914 ns/iter |
600.3503895539037 ns/iter |
1.14 |
Micro_2020_12_Dynamic_Ref_Single |
9.020908105273433 ns/iter |
7.729079693463185 ns/iter |
1.17 |
Micro_2020_12_Simple_Output_Mask |
192882.87639196188 ns/iter |
166646.90708928613 ns/iter |
1.16 |
Micro_2020_12_Simple_Output_Annotations |
226882.87486965675 ns/iter |
188593.6000554552 ns/iter |
1.20 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Benchmark (linux/gcc)
Details
| Benchmark suite | Current: eeb3226 | Previous: 9c22fb1 | Ratio |
|---|---|---|---|
Micro_2020_12_Dynamic_Ref |
616.059723119268 ns/iter |
655.5511859205563 ns/iter |
0.94 |
Micro_2020_12_Dynamic_Ref_Single |
11.63205495632316 ns/iter |
9.68310912907271 ns/iter |
1.20 |
Micro_2020_12_Simple_Output_Mask |
137697.24137931276 ns/iter |
123045.43113138933 ns/iter |
1.12 |
Micro_2020_12_Simple_Output_Annotations |
172440.83600099274 ns/iter |
168312.79460234192 ns/iter |
1.02 |
Micro_2019_09_Unevaluated_Properties |
50.40911736904359 ns/iter |
42.566529965576294 ns/iter |
1.18 |
Micro_Draft7_If_Then_Else |
46.74559195620489 ns/iter |
39.11375099154473 ns/iter |
1.20 |
Micro_Draft6_Property_Names |
177.98450169362826 ns/iter |
156.3947989368584 ns/iter |
1.14 |
Micro_Draft4_Meta_1_No_Callback |
249.24278030914545 ns/iter |
251.89216287001693 ns/iter |
0.99 |
Micro_Draft4_Required_Properties |
537.8882518863485 ns/iter |
564.5712252729863 ns/iter |
0.95 |
Micro_Draft4_Many_Optional_Properties_Minimal_Match |
31.55106050756226 ns/iter |
32.56467940160445 ns/iter |
0.97 |
Micro_Draft4_Few_Optional_Properties_Minimal_Match |
13.564562527383323 ns/iter |
11.948184021591135 ns/iter |
1.14 |
Micro_Draft4_Items_Schema |
544.3376798062984 ns/iter |
470.3129230996561 ns/iter |
1.16 |
Micro_Draft4_Nested_Object |
6.964538880377953 ns/iter |
5.872234818369322 ns/iter |
1.19 |
Micro_Draft4_Properties_Triad_Optional |
457.6099450503078 ns/iter |
433.1674056240016 ns/iter |
1.06 |
Micro_Draft4_Properties_Triad_Closed |
378.5597749838453 ns/iter |
366.88577350760676 ns/iter |
1.03 |
Micro_Draft4_Properties_Triad_Required |
461.6235589783223 ns/iter |
436.4575201572282 ns/iter |
1.06 |
Micro_Draft4_Properties_Closed |
80.56596985849339 ns/iter |
87.5208463413475 ns/iter |
0.92 |
Micro_Draft4_Non_Recursive_Ref |
16.49892323307869 ns/iter |
13.641409295411128 ns/iter |
1.21 |
Micro_Draft4_Pattern_Properties_True |
250.88568355584874 ns/iter |
214.6877239187797 ns/iter |
1.17 |
Micro_Draft4_Ref_To_Single_Property |
13.53247546099697 ns/iter |
11.931248128525631 ns/iter |
1.13 |
Micro_Draft4_Additional_Properties_Type |
21.221358428297 ns/iter |
18.28645805422604 ns/iter |
1.16 |
Micro_Draft4_Nested_Oneof |
113.92055499592581 ns/iter |
103.77628012090825 ns/iter |
1.10 |
Micro_Draft4_Short_Enum |
18.70666146530936 ns/iter |
14.880526737254565 ns/iter |
1.26 |
Micro_Draft4_Long_Enum |
21.02046666214636 ns/iter |
17.53826998069762 ns/iter |
1.20 |
Micro_Draft4_Long_Enum_Short_Strings |
18.70816521408423 ns/iter |
14.86126951110095 ns/iter |
1.26 |
Micro_Draft4_Type_Object |
11.596956186492784 ns/iter |
9.626478723892495 ns/iter |
1.20 |
Micro_Draft4_Ref_Single_100 |
3479661.4603960332 ns/iter |
3195547.0590901314 ns/iter |
1.09 |
Micro_Draft4_Ref_Many_Nested |
5557038844.999966 ns/iter |
5940103624.000131 ns/iter |
0.94 |
E2E_Compiler_adaptivecard |
1005193916.0000529 ns/iter |
949140165.9997791 ns/iter |
1.06 |
E2E_Compiler_ansible_meta |
31201418.22727295 ns/iter |
28936110.239992555 ns/iter |
1.08 |
E2E_Compiler_aws_cdk |
588456.4345287072 ns/iter |
563724.3959839739 ns/iter |
1.04 |
E2E_Compiler_babelrc |
3888566.133333092 ns/iter |
3593764.7128193 ns/iter |
1.08 |
E2E_Compiler_clang_format |
20844189.294119615 ns/iter |
19539064.805548556 ns/iter |
1.07 |
E2E_Compiler_cmake_presets |
215162169.66665527 ns/iter |
207330289.666667 ns/iter |
1.04 |
E2E_Compiler_code_climate |
3336349.7333333553 ns/iter |
3092832.2433633143 ns/iter |
1.08 |
E2E_Compiler_cql2 |
175623018.50000495 ns/iter |
169063454.250022 ns/iter |
1.04 |
E2E_Compiler_cspell |
57212902.499998115 ns/iter |
55055351.15382652 ns/iter |
1.04 |
E2E_Compiler_cypress |
7003676.019801806 ns/iter |
6654881.114285499 ns/iter |
1.05 |
E2E_Compiler_deno |
9514005.554054879 ns/iter |
8663422.724998781 ns/iter |
1.10 |
E2E_Compiler_dependabot |
5202732.259259493 ns/iter |
4781024.782311519 ns/iter |
1.09 |
E2E_Compiler_draft_04 |
18938814.108110275 ns/iter |
17892084.33333792 ns/iter |
1.06 |
E2E_Compiler_fabric_mod |
6735830.480768466 ns/iter |
6326438.378379805 ns/iter |
1.06 |
E2E_Compiler_geojson |
33188126.19047982 ns/iter |
30959131.913040556 ns/iter |
1.07 |
E2E_Compiler_gitpod_configuration |
7005992.7326730015 ns/iter |
6554713.822428924 ns/iter |
1.07 |
E2E_Compiler_helm_chart_lock |
963516.8585164874 ns/iter |
916813.7751634145 ns/iter |
1.05 |
E2E_Compiler_importmap |
480954.1441317976 ns/iter |
466584.50567024347 ns/iter |
1.03 |
E2E_Compiler_jasmine |
1953560.5013925813 ns/iter |
1847035.515873108 ns/iter |
1.06 |
E2E_Compiler_jshintrc |
5123854.044117259 ns/iter |
4694155.228186456 ns/iter |
1.09 |
E2E_Compiler_jsconfig |
26039161.11111091 ns/iter |
23443922.66666849 ns/iter |
1.11 |
E2E_Compiler_krakend |
262723425.33331993 ns/iter |
251813184.6666923 ns/iter |
1.04 |
E2E_Compiler_lazygit |
43565063.937499814 ns/iter |
40087953.11112104 ns/iter |
1.09 |
E2E_Compiler_lerna |
2155986.1661538747 ns/iter |
2023440.6011561623 ns/iter |
1.07 |
E2E_Compiler_nest_cli |
11382059.09677481 ns/iter |
10557514.696970291 ns/iter |
1.08 |
E2E_Compiler_omc |
1742964472.0000396 ns/iter |
1534350897.9999568 ns/iter |
1.14 |
E2E_Compiler_omnisharp |
8653307.246912913 ns/iter |
8031171.333333004 ns/iter |
1.08 |
E2E_Compiler_openapi |
1223609113.0000658 ns/iter |
1170884620.9999137 ns/iter |
1.05 |
E2E_Compiler_pre_commit_hooks |
5637291.774193852 ns/iter |
5207353.470146401 ns/iter |
1.08 |
E2E_Compiler_pulumi |
5410463.861538189 ns/iter |
5090818.9270066805 ns/iter |
1.06 |
E2E_Compiler_semantic_release |
2043745.0146197313 ns/iter |
1946679.1333330648 ns/iter |
1.05 |
E2E_Compiler_stale |
2369868.0101351077 ns/iter |
2200161.245283547 ns/iter |
1.08 |
E2E_Compiler_stylecop |
7256537.391752965 ns/iter |
6669863.457141002 ns/iter |
1.09 |
E2E_Compiler_tmuxinator |
2608095.3197024968 ns/iter |
2461668.5789480563 ns/iter |
1.06 |
E2E_Compiler_ui5 |
160391477.25001612 ns/iter |
154896414.80007777 ns/iter |
1.04 |
E2E_Compiler_ui5_manifest |
2178583245.000027 ns/iter |
2015895020.0002437 ns/iter |
1.08 |
E2E_Compiler_unreal_engine_uproject |
5795340.866666266 ns/iter |
5425342.220473615 ns/iter |
1.07 |
E2E_Compiler_vercel |
18217223.131578546 ns/iter |
17374857.849995352 ns/iter |
1.05 |
E2E_Compiler_yamllint |
489974.03151261783 ns/iter |
471285.1340067426 ns/iter |
1.04 |
E2E_Evaluator_adaptivecard |
56158.88243820267 ns/iter |
52034.43897042878 ns/iter |
1.08 |
E2E_Evaluator_ansible_meta |
296307.54326304136 ns/iter |
270173.33116133936 ns/iter |
1.10 |
E2E_Evaluator_aws_cdk |
59242.50862566646 ns/iter |
48176.01679858147 ns/iter |
1.23 |
E2E_Evaluator_babelrc |
137490.69726902124 ns/iter |
121515.18164274868 ns/iter |
1.13 |
E2E_Evaluator_clang_format |
102066.85298892496 ns/iter |
101460.05103971194 ns/iter |
1.01 |
E2E_Evaluator_cmake_presets |
5428673.938931335 ns/iter |
6180205.816515208 ns/iter |
0.88 |
E2E_Evaluator_code_climate |
225608.165001625 ns/iter |
226502.46211139034 ns/iter |
1.00 |
E2E_Evaluator_cql2 |
270834.5072133526 ns/iter |
238589.09435894486 ns/iter |
1.14 |
E2E_Evaluator_cspell |
581523.8569064866 ns/iter |
607707.5090596217 ns/iter |
0.96 |
E2E_Evaluator_cypress |
165740.83134541055 ns/iter |
150662.98850074052 ns/iter |
1.10 |
E2E_Evaluator_deno |
351140.27789044904 ns/iter |
374037.4288018087 ns/iter |
0.94 |
E2E_Evaluator_dependabot |
480533.6730505842 ns/iter |
475223.83593216434 ns/iter |
1.01 |
E2E_Evaluator_draft_04 |
8557373.24675315 ns/iter |
8500645.939755004 ns/iter |
1.01 |
E2E_Evaluator_fabric_mod |
945615.6194925992 ns/iter |
924601.5949536917 ns/iter |
1.02 |
E2E_Evaluator_geojson |
26597414.38461739 ns/iter |
26575854.1923053 ns/iter |
1.00 |
E2E_Evaluator_gitpod_configuration |
285016.19812088314 ns/iter |
282227.74646173045 ns/iter |
1.01 |
E2E_Evaluator_helm_chart_lock |
364664.70773198176 ns/iter |
416347.9375000363 ns/iter |
0.88 |
E2E_Evaluator_importmap |
60893.29119916661 ns/iter |
43077.71746418785 ns/iter |
1.41 |
E2E_Evaluator_jasmine |
142783.96604309772 ns/iter |
132705.38019727555 ns/iter |
1.08 |
E2E_Evaluator_jshintrc |
950564.4856362803 ns/iter |
1030784.6444447932 ns/iter |
0.92 |
E2E_Evaluator_jsconfig |
451234.20438427344 ns/iter |
417300.79508682195 ns/iter |
1.08 |
E2E_Evaluator_krakend |
227123.24170463064 ns/iter |
199069.22061744757 ns/iter |
1.14 |
E2E_Evaluator_lazygit |
161652.8273724776 ns/iter |
141706.3084780395 ns/iter |
1.14 |
E2E_Evaluator_lerna |
146463.47770564852 ns/iter |
167547.41535531267 ns/iter |
0.87 |
E2E_Evaluator_nest_cli |
232064.378762857 ns/iter |
228692.48223676215 ns/iter |
1.01 |
E2E_Evaluator_omc |
29082.66512191352 ns/iter |
27124.6962896334 ns/iter |
1.07 |
E2E_Evaluator_omnisharp |
543227.9664848143 ns/iter |
579870.0083679825 ns/iter |
0.94 |
E2E_Evaluator_openapi |
14015706.909090526 ns/iter |
13475814.619996525 ns/iter |
1.04 |
E2E_Evaluator_pre_commit_hooks |
536060.4453913113 ns/iter |
565988.6968216149 ns/iter |
0.95 |
E2E_Evaluator_pulumi |
831940.6066351226 ns/iter |
891261.3307692925 ns/iter |
0.93 |
E2E_Evaluator_semantic_release |
137684.13748250477 ns/iter |
119163.99564767089 ns/iter |
1.16 |
E2E_Evaluator_stale |
172705.31451810978 ns/iter |
169230.8409689965 ns/iter |
1.02 |
E2E_Evaluator_stylecop |
341585.7420477921 ns/iter |
331091.3928064827 ns/iter |
1.03 |
E2E_Evaluator_tmuxinator |
128091.56834661574 ns/iter |
113155.49819732885 ns/iter |
1.13 |
E2E_Evaluator_ui5 |
667868.2509577619 ns/iter |
604511.2443673979 ns/iter |
1.10 |
E2E_Evaluator_ui5_manifest |
3164234.3105024802 ns/iter |
3389503.7846167935 ns/iter |
0.93 |
E2E_Evaluator_unreal_engine_uproject |
526920.7205014802 ns/iter |
514890.47395081294 ns/iter |
1.02 |
E2E_Evaluator_vercel |
347184.0839580224 ns/iter |
372764.5770879552 ns/iter |
0.93 |
E2E_Evaluator_yamllint |
14190.61157660325 ns/iter |
12692.044783677075 ns/iter |
1.12 |
This comment was automatically generated by workflow using github-action-benchmark.
Signed-off-by: Juan Cruz Viotti <[email protected]>
jviotti
force-pushed
the
case-position
branch
from
585c149 to
eeb3226
Compare
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Signed-off-by: Juan Cruz Viotti [email protected]