Skip to content

Optimise the canonicalizer#730

Closed
jviotti wants to merge 2 commits intomainfrom
optimise-canonical
Closed

Optimise the canonicalizer#730
jviotti wants to merge 2 commits intomainfrom
optimise-canonical

Conversation

@jviotti
Copy link
Copy Markdown
Member

@jviotti jviotti commented Apr 16, 2026

Signed-off-by: Juan Cruz Viotti jv@jviotti.com

Signed-off-by: Juan Cruz Viotti <jv@jviotti.com>
Copy link
Copy Markdown

@cubic-dev-ai cubic-dev-ai bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

1 issue found across 35 files

Prompt for AI agents (unresolved issues)

Check if these issues are valid — if so, understand the root cause of each and fix them. If appropriate, use sub-agents to investigate and fix each issue separately.


<file name="src/alterschema/transformer.cc">

<violation number="1" location="src/alterschema/transformer.cc:294">
P2: This `goto` exits the current subschema/rule iteration early, so the "continue checking more rules for the same subschema" optimization does not happen.</violation>
</file>

Reply with feedback, questions, or to request a fix. Tag @cubic-dev-ai to re-run a review.

// and reference fixing. Continue checking more rules for the same
// subschema without restarting.
needs_reframe = true;
goto blaze_transformer_start_again;
Copy link
Copy Markdown

@cubic-dev-ai cubic-dev-ai bot Apr 16, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P2: This goto exits the current subschema/rule iteration early, so the "continue checking more rules for the same subschema" optimization does not happen.

Prompt for AI agents
Check if this issue is valid — if so, understand the root cause and fix it. At src/alterschema/transformer.cc, line 294:

<comment>This `goto` exits the current subschema/rule iteration early, so the "continue checking more rules for the same subschema" optimization does not happen.</comment>

<file context>
@@ -281,6 +284,16 @@ auto SchemaTransformer::apply(core::JSON &schema,
+          // and reference fixing. Continue checking more rules for the same
+          // subschema without restarting.
+          needs_reframe = true;
+          goto blaze_transformer_start_again;
+        }
+
</file context>
Suggested change
goto blaze_transformer_start_again;
continue;
Fix with Cubic

@augmentcode
Copy link
Copy Markdown

augmentcode bot commented Apr 16, 2026

🤖 Augment PR Summary

Summary: Adds a per-rule needs_frame_analysis hint to speed up canonicalization by avoiding unnecessary transformer work.
Changes:

  • Extends SchemaTransformer rule metadata to include needs_frame_analysis (default: true).
  • Marks many canonicalizer rules as needs_frame_analysis = false.
  • Adds an apply() fast path intended to skip frame re-analysis / post-checks / reference handling for those rules.
Technical Notes: Updates internal rule tuple types and structured bindings to carry the new flag.

🤖 Was this summary useful? React with 👍 or 👎

Copy link
Copy Markdown

@augmentcode augmentcode bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Review completed. 3 suggestions posted.

Fix All in Augment

Comment augment review to trigger a new review at any time.

Comment thread src/alterschema/transformer.cc Outdated

bool subschema_failed{false};
for (const auto &[rule, mutates, _] : rules) {
for (const auto &[rule, mutates, unused1_, unused2_] : rules) {
Copy link
Copy Markdown

@augmentcode augmentcode bot Apr 16, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

src/alterschema/transformer.cc:79: The structured binding introduces unused1_/unused2_ that are never referenced; with -Wunused-variable + -Werror this can break builds. Consider explicitly ignoring these tuple elements (e.g., via std::ignore) or marking them [[maybe_unused]].

Severity: low

Fix This in Augment

🤖 Was this useful? React with 👍 or 👎, or 🚀 if it prevented an incident/outage.


applied = true;

if (!needs_frame_analysis && !current.is_boolean()) {
Copy link
Copy Markdown

@augmentcode augmentcode bot Apr 16, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

src/alterschema/transformer.cc:287: This !needs_frame_analysis fast path bypasses the post-transform condition re-check, processed_rules marking, and all reference/broken-ref handling; if a rule’s transform() is a no-op (or doesn’t clear its condition), this can loop indefinitely and/or leave broken $refs undetected. Also, setting needs_reframe = true causes analyse_frame() to run on the next outer iteration anyway, which doesn’t match the comment about skipping frame re-analysis.

Severity: medium

Fix This in Augment

🤖 Was this useful? React with 👍 or 👎, or 🚀 if it prevented an incident/outage.

public:
using mutates = std::true_type;
using reframe_after_transform = std::true_type;
using needs_frame_analysis = std::false_type;
Copy link
Copy Markdown

@augmentcode augmentcode bot Apr 16, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

src/alterschema/canonicalizer/empty_definitions_drop.h:5: Marking this rule as needs_frame_analysis = std::false_type means the transformer will skip reference/broken-ref handling even though transform() deletes definitions; a $ref to #/definitions would become silently broken instead of being detected/fixed. If that scenario is possible, this rule likely still needs full frame/reference processing.

Severity: medium

Other Locations
  • src/alterschema/canonicalizer/empty_defs_drop.h:5

Fix This in Augment

🤖 Was this useful? React with 👍 or 👎, or 🚀 if it prevented an incident/outage.

Copy link
Copy Markdown

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark (linux/llvm)

Details
Benchmark suite Current: ac043d0 Previous: 3243d56 Ratio
E2E_Compiler_adaptivecard 64544746.55555487 ns/iter 65123607.99999644 ns/iter 0.99
E2E_Compiler_ansible_meta 29242857.12500089 ns/iter 29345848.624998894 ns/iter 1.00
E2E_Compiler_aws_cdk 386784.3766088327 ns/iter 383470.25684559584 ns/iter 1.01
E2E_Compiler_babelrc 2602580.486988749 ns/iter 2603406.2602230334 ns/iter 1.00
E2E_Compiler_clang_format 18564457.73684282 ns/iter 18536449.342105385 ns/iter 1.00
E2E_Compiler_cmake_presets 26294451.814814474 ns/iter 26021399.555555005 ns/iter 1.01
E2E_Compiler_code_climate 2634633.289473702 ns/iter 2648363.7698113015 ns/iter 0.99
E2E_Compiler_cql2 13154425.86792522 ns/iter 13018892.425925009 ns/iter 1.01
E2E_Compiler_cspell 22921132.500001322 ns/iter 23106513.899998996 ns/iter 0.99
E2E_Compiler_cypress 3988781.285714335 ns/iter 3978248.6022730265 ns/iter 1.00
E2E_Compiler_deno 7702300.934065809 ns/iter 7915569.544444325 ns/iter 0.97
E2E_Compiler_dependabot 3983000.363636403 ns/iter 3975135.818182258 ns/iter 1.00
E2E_Compiler_draft_04 2691211.8850574167 ns/iter 2709580.410852553 ns/iter 0.99
E2E_Compiler_fabric_mod 4779918.342465747 ns/iter 4819598.738805978 ns/iter 0.99
E2E_Compiler_geojson 22196390.437500212 ns/iter 22233950.18749841 ns/iter 1.00
E2E_Compiler_gitpod_configuration 4907286.169014524 ns/iter 4928435.802816732 ns/iter 1.00
E2E_Compiler_helm_chart_lock 710528.5519348359 ns/iter 714200.3159508555 ns/iter 0.99
E2E_Compiler_importmap 292488.0648918466 ns/iter 289766.1815181715 ns/iter 1.01
E2E_Compiler_jasmine 1378838.0039448428 ns/iter 1381190.0276679625 ns/iter 1.00
E2E_Compiler_jshintrc 4396112.767295254 ns/iter 4388760.006289137 ns/iter 1.00
E2E_Compiler_jsconfig 21988456.46875114 ns/iter 22159275.65625009 ns/iter 0.99
E2E_Compiler_krakend 139720213.60000327 ns/iter 148985929.80000558 ns/iter 0.94
E2E_Compiler_lazygit 33828594.666666895 ns/iter 33704958.95238231 ns/iter 1.00
E2E_Compiler_lerna 1629754.2529004556 ns/iter 1622468.5697675024 ns/iter 1.00
E2E_Compiler_nest_cli 7517420.462366033 ns/iter 7530242.086021087 ns/iter 1.00
E2E_Compiler_omc 153251023.40000287 ns/iter 164948962.0000111 ns/iter 0.93
E2E_Compiler_omnisharp 6824921.294118408 ns/iter 6793450.291261207 ns/iter 1.00
E2E_Compiler_openapi 24950020.67856993 ns/iter 25167231.964287244 ns/iter 0.99
E2E_Compiler_pre_commit_hooks 5344144.190839592 ns/iter 5358502.900764179 ns/iter 1.00
E2E_Compiler_pulumi 4071582.0755817834 ns/iter 4074430.738372421 ns/iter 1.00
E2E_Compiler_semantic_release 1573561.894382069 ns/iter 1589214.5421412662 ns/iter 0.99
E2E_Compiler_stale 1567731.892376821 ns/iter 1569541.810810891 ns/iter 1.00
E2E_Compiler_stylecop 6150850.456139634 ns/iter 6229462.2410712065 ns/iter 0.99
E2E_Compiler_tmuxinator 1944677.0469615466 ns/iter 1973098.6536310867 ns/iter 0.99
E2E_Compiler_ui5 47282066.733335644 ns/iter 47645426.8571404 ns/iter 0.99
E2E_Compiler_ui5_manifest 311798728.9999746 ns/iter 318582821.5000015 ns/iter 0.98
E2E_Compiler_unreal_engine_uproject 4645309.132450509 ns/iter 4643230.15893982 ns/iter 1.00
E2E_Compiler_users_array 798634.5503432688 ns/iter 798393.7616875134 ns/iter 1.00
E2E_Compiler_vercel 12512480.357143221 ns/iter 12598046.017856745 ns/iter 0.99
E2E_Compiler_yamllint 360961.13890286535 ns/iter 352193.1965227087 ns/iter 1.02
E2E_Evaluator_adaptivecard 24836.30482176092 ns/iter 26295.280213027545 ns/iter 0.94
E2E_Evaluator_ansible_meta 229653.92866450816 ns/iter 232821.76350660087 ns/iter 0.99
E2E_Evaluator_aws_cdk 50993.462596302816 ns/iter 50829.46650141587 ns/iter 1.00
E2E_Evaluator_babelrc 110382.17295596848 ns/iter 109658.52722694185 ns/iter 1.01
E2E_Evaluator_cerebrum_criminal_case 945270.758152114 ns/iter 957020.218836621 ns/iter 0.99
E2E_Evaluator_clang_format 122898.90366088615 ns/iter 122909.477320318 ns/iter 1.00
E2E_Evaluator_cmake_presets 4201746.078313382 ns/iter 5059979.330000033 ns/iter 0.83
E2E_Evaluator_code_climate 182638.78986273232 ns/iter 188742.09867020007 ns/iter 0.97
E2E_Evaluator_cql2 204438.00432651018 ns/iter 212228.95945536427 ns/iter 0.96
E2E_Evaluator_cspell 556238.1847389898 ns/iter 561355.5764331027 ns/iter 0.99
E2E_Evaluator_cypress 194839.99585978125 ns/iter 194338.7260917522 ns/iter 1.00
E2E_Evaluator_deno 318175.1142857445 ns/iter 309616.6743875325 ns/iter 1.03
E2E_Evaluator_dependabot 336306.55406695907 ns/iter 334321.9722089072 ns/iter 1.01
E2E_Evaluator_draft_04 7484062.1222228445 ns/iter 9330211.38157947 ns/iter 0.80
E2E_Evaluator_fabric_mod 702137.9048562939 ns/iter 671157.3355576094 ns/iter 1.05
E2E_Evaluator_geojson 15612744.088889485 ns/iter 16002613.386363734 ns/iter 0.98
E2E_Evaluator_gitpod_configuration 230038.80434781304 ns/iter 232853.83977719437 ns/iter 0.99
E2E_Evaluator_helm_chart_lock 358357.4250253474 ns/iter 354055.76314447983 ns/iter 1.01
E2E_Evaluator_importmap 48069.085201792666 ns/iter 48219.30467365567 ns/iter 1.00
E2E_Evaluator_jasmine 109069.82948516347 ns/iter 109218.34915676492 ns/iter 1.00
E2E_Evaluator_jshintrc 1200343.1635111878 ns/iter 1206894.2607944678 ns/iter 0.99
E2E_Evaluator_jsconfig 424040.5526476175 ns/iter 425977.00000000553 ns/iter 1.00
E2E_Evaluator_krakend 206044.57368882265 ns/iter 206794.19652488834 ns/iter 1.00
E2E_Evaluator_lazygit 147007.52943658893 ns/iter 149479.2280516223 ns/iter 0.98
E2E_Evaluator_lerna 136696.2394998878 ns/iter 137618.26061087765 ns/iter 0.99
E2E_Evaluator_nest_cli 178116.46258327801 ns/iter 177414.7790519641 ns/iter 1.00
E2E_Evaluator_omc 18002.0440692772 ns/iter 19310.22784599812 ns/iter 0.93
E2E_Evaluator_omnisharp 616706.1662292138 ns/iter 611693.1387683825 ns/iter 1.01
E2E_Evaluator_openapi 9325977.500000935 ns/iter 10621023.415386004 ns/iter 0.88
E2E_Evaluator_pre_commit_hooks 471409.90571234206 ns/iter 468876.2365951752 ns/iter 1.01
E2E_Evaluator_pulumi 670436.5984329025 ns/iter 667798.7309160471 ns/iter 1.00
E2E_Evaluator_semantic_release 98822.7774798966 ns/iter 97949.03927534183 ns/iter 1.01
E2E_Evaluator_stale 158316.43740058944 ns/iter 153606.37639831344 ns/iter 1.03
E2E_Evaluator_stylecop 287560.92976728117 ns/iter 285147.4105263582 ns/iter 1.01
E2E_Evaluator_tmuxinator 96844.61350792692 ns/iter 96015.39409202515 ns/iter 1.01
E2E_Evaluator_ui5 500675.54205601924 ns/iter 505460.9850634179 ns/iter 0.99
E2E_Evaluator_ui5_manifest 2485658.8333335794 ns/iter 2467501.11785689 ns/iter 1.01
E2E_Evaluator_unreal_engine_uproject 435875.9626400996 ns/iter 432733.357894732 ns/iter 1.01
E2E_Evaluator_users_array 681676.3623046507 ns/iter 680782.8156862636 ns/iter 1.00
E2E_Evaluator_vercel 302628.82670696883 ns/iter 307588.24250322365 ns/iter 0.98
E2E_Evaluator_yamllint 8688.776162499324 ns/iter 9026.880821624056 ns/iter 0.96
Micro_Draft4_Meta_1_No_Callback 189.30039873171853 ns/iter 190.00692363689362 ns/iter 1.00
Micro_Draft4_Required_Properties 881.8281189062379 ns/iter 874.0680031799344 ns/iter 1.01
Micro_Draft4_Many_Optional_Properties_Minimal_Match 21.640877806116706 ns/iter 21.637076329871082 ns/iter 1.00
Micro_Draft4_Few_Optional_Properties_Minimal_Match 11.21425763891869 ns/iter 11.205051641122072 ns/iter 1.00
Micro_Draft4_Items_Schema 287.8046871882901 ns/iter 287.91176574567623 ns/iter 1.00
Micro_Draft4_Nested_Object 1.8144282970675132 ns/iter 1.8206473744843918 ns/iter 1.00
Micro_Draft4_Properties_Triad_Optional 325.8828888385878 ns/iter 318.28178440392145 ns/iter 1.02
Micro_Draft4_Properties_Triad_Closed 267.5900108804861 ns/iter 263.0765354307927 ns/iter 1.02
Micro_Draft4_Properties_Triad_Required 349.84893905463053 ns/iter 343.53572110709484 ns/iter 1.02
Micro_Draft4_Properties_Closed 55.894260583499594 ns/iter 55.71762994947032 ns/iter 1.00
Micro_Draft4_Non_Recursive_Ref 11.768148139417383 ns/iter 11.467051951454696 ns/iter 1.03
Micro_Draft4_Pattern_Properties_True 166.75065997047514 ns/iter 164.67239825813186 ns/iter 1.01
Micro_Draft4_Ref_To_Single_Property 11.206870987269099 ns/iter 11.219508584388683 ns/iter 1.00
Micro_Draft4_Additional_Properties_Type 24.313900231275557 ns/iter 21.257654696768256 ns/iter 1.14
Micro_Draft4_Nested_Oneof 56.6615657428739 ns/iter 56.680288766999695 ns/iter 1.00
Micro_Draft4_Short_Enum 11.83724168171391 ns/iter 11.837624422236884 ns/iter 1.00
Micro_Draft4_Long_Enum 14.956285735723496 ns/iter 15.255756765331151 ns/iter 0.98
Micro_Draft4_Long_Enum_Short_Strings 11.844325096027747 ns/iter 11.83851893292263 ns/iter 1.00
Micro_Draft4_Type_Object 3.73862745364453 ns/iter 3.7376175832893064 ns/iter 1.00
Micro_Draft4_Ref_Single_100 2401943.95205482 ns/iter 2394605.887371862 ns/iter 1.00
Micro_Draft4_Compile_Ref_Many_Nested 1735970.3200991834 ns/iter 1729796.9654321235 ns/iter 1.00
Micro_Draft4_Compile_Wrap 2407628.680412236 ns/iter 2371443.383050696 ns/iter 1.02
Micro_Draft6_Property_Names 118.57411438984236 ns/iter 118.7428700020182 ns/iter 1.00
Micro_Draft6_Compile_FHIR 14272340268.999983 ns/iter 14189615287.000038 ns/iter 1.01
Micro_Draft7_If_Then_Else 23.47353879124045 ns/iter 23.346556699799418 ns/iter 1.01
Micro_2019_09_Unevaluated_Properties 27.746680492885112 ns/iter 27.770793895161297 ns/iter 1.00
Micro_2019_09_Compile_Wrap 298990525.4999599 ns/iter 302335993.49998033 ns/iter 0.99
Micro_2020_12_Dynamic_Ref 227.90454095526812 ns/iter 225.88895064181835 ns/iter 1.01
Micro_2020_12_Dynamic_Ref_Single 3.4250043341829866 ns/iter 3.4244722257445197 ns/iter 1.00
Micro_2020_12_Simple_Output_Mask 1071.4315052725747 ns/iter 1074.9458122883093 ns/iter 1.00
Micro_2020_12_Simple_Output_Annotations 112681.19642566147 ns/iter 104184.21433796531 ns/iter 1.08
Micro_2020_12_Compile_NonCircular_Shared_Refs 1111929.4786055079 ns/iter 1098559.16560515 ns/iter 1.01
Micro_2020_12_Exhaustive_Deep_Numeric 8374.846383434166 ns/iter 8528.792656254103 ns/iter 0.98
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput 182230.31538462773 ns/iter 179812.52526800142 ns/iter 1.01
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput 22782.6381755453 ns/iter 22212.581405668065 ns/iter 1.03
Micro_2020_12_Exhaustive_Deep_Numeric_Fail 144.44764974033288 ns/iter 142.23999458020353 ns/iter 1.02
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput 4386.800183169111 ns/iter 4335.839533545494 ns/iter 1.01
Alterschema_Check_Readibility_ISO_Language_Set_3 350038551.00001144 ns/iter 355430121.4999782 ns/iter 0.98
Alterschema_Check_Readibility_OMC 86623307.12499511 ns/iter 85496268.12499866 ns/iter 1.01
Alterschema_Check_Readibility_KrakenD 1245959287.9999945 ns/iter 1215596925.9999893 ns/iter 1.02
Alterschema_Apply_Readibility_KrakenD 122548057074.99997 ns/iter 120622362926.00005 ns/iter 1.02
Alterschema_Check_Invalid_External_Refs 309865294.500014 ns/iter 302096923.0000219 ns/iter 1.03

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Copy Markdown

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

JavaScript (linux/llvm)

Details
Benchmark suite Current: ac043d0 Previous: 3243d56 Ratio
E2E_Evaluator_adaptivecard 112482 ns 113601 ns 0.99
E2E_Evaluator_ansible-meta 505868 ns 516033 ns 0.98
E2E_Evaluator_aws-cdk 135744 ns 140157 ns 0.97
E2E_Evaluator_babelrc 313072 ns 308691 ns 1.01
E2E_Evaluator_cerebrum-criminal-case 2400541 ns 2383160 ns 1.01
E2E_Evaluator_clang-format 258901 ns 265346 ns 0.98
E2E_Evaluator_cmake-presets 17590303 ns 18618263 ns 0.94
E2E_Evaluator_code-climate 494617 ns 491144 ns 1.01
E2E_Evaluator_cql2 1153742 ns 1178269 ns 0.98
E2E_Evaluator_cspell 1442096 ns 1457074 ns 0.99
E2E_Evaluator_cypress 762538 ns 776630 ns 0.98
E2E_Evaluator_deno 994510 ns 1020835 ns 0.97
E2E_Evaluator_dependabot 1046521 ns 1043661 ns 1.00
E2E_Evaluator_draft-04 21169344 ns 24041786 ns 0.88
E2E_Evaluator_fabric-mod 2292873 ns 2372925 ns 0.97
E2E_Evaluator_geojson 25744704 ns 27796782 ns 0.93
E2E_Evaluator_gitpod-configuration 704783 ns 703382 ns 1.00
E2E_Evaluator_helm-chart-lock 1040380 ns 1018027 ns 1.02
E2E_Evaluator_importmap 272095 ns 280243 ns 0.97
E2E_Evaluator_jasmine 299092 ns 304011 ns 0.98
E2E_Evaluator_jsconfig 1214468 ns 1256627 ns 0.97
E2E_Evaluator_jshintrc 2829303 ns 2890582 ns 0.98
E2E_Evaluator_krakend 702889 ns 707840 ns 0.99
E2E_Evaluator_lazygit 494816 ns 506884 ns 0.98
E2E_Evaluator_lerna 446845 ns 462417 ns 0.97
E2E_Evaluator_nest-cli 567895 ns 574838 ns 0.99
E2E_Evaluator_omc 86716 ns 87798 ns 0.99
E2E_Evaluator_omnisharp 1365047 ns 1431610 ns 0.95
E2E_Evaluator_openapi 23749215 ns 26290741 ns 0.90
E2E_Evaluator_pre-commit-hooks 1887869 ns 1939588 ns 0.97
E2E_Evaluator_pulumi 1776289 ns 1912742 ns 0.93
E2E_Evaluator_semantic-release 255756 ns 260548 ns 0.98
E2E_Evaluator_stale 377847 ns 394791 ns 0.96
E2E_Evaluator_stylecop 1113594 ns 1132258 ns 0.98
E2E_Evaluator_tmuxinator 226920 ns 228733 ns 0.99
E2E_Evaluator_ui5 1972050 ns 2059021 ns 0.96
E2E_Evaluator_ui5-manifest 9925652 ns 12508262 ns 0.79
E2E_Evaluator_unreal-engine-uproject 1449476 ns 1498698 ns 0.97
E2E_Evaluator_users-array 2325744 ns 2274438 ns 1.02
E2E_Evaluator_vercel 939434 ns 955536 ns 0.98
E2E_Evaluator_yamllint 28110 ns 28531 ns 0.99

This comment was automatically generated by workflow using github-action-benchmark.

Signed-off-by: Juan Cruz Viotti <jv@jviotti.com>
Copy link
Copy Markdown

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark (linux/gcc)

Details
Benchmark suite Current: ac043d0 Previous: 3243d56 Ratio
Alterschema_Check_Readibility_ISO_Language_Set_3 377478378.9999674 ns/iter 333191799.00001925 ns/iter 1.13
Alterschema_Check_Readibility_OMC 104920676.28570113 ns/iter 99216165.4285805 ns/iter 1.06
Alterschema_Check_Readibility_KrakenD 1479503741.9999063 ns/iter 1413951574.000066 ns/iter 1.05
Alterschema_Apply_Readibility_KrakenD 148450494405.99997 ns/iter 131587600655.99995 ns/iter 1.13
Alterschema_Check_Invalid_External_Refs 312272737.0000575 ns/iter 300409267.99995303 ns/iter 1.04
Micro_2020_12_Dynamic_Ref 286.10345404940097 ns/iter 257.93964287289543 ns/iter 1.11
Micro_2020_12_Dynamic_Ref_Single 4.571739630413694 ns/iter 4.576742041766192 ns/iter 1.00
Micro_2020_12_Simple_Output_Mask 1122.7069676158715 ns/iter 1123.9546881442213 ns/iter 1.00
Micro_2020_12_Simple_Output_Annotations 104735.45837755696 ns/iter 103447.38956367482 ns/iter 1.01
Micro_2020_12_Compile_NonCircular_Shared_Refs 1201954.7470082706 ns/iter 1201271.6820512044 ns/iter 1.00
Micro_2020_12_Exhaustive_Deep_Numeric 8164.458504093962 ns/iter 8064.3160162648865 ns/iter 1.01
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput 164722.02511361183 ns/iter 167340.41979272684 ns/iter 0.98
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput 26168.12385492907 ns/iter 26422.880460387096 ns/iter 0.99
Micro_2020_12_Exhaustive_Deep_Numeric_Fail 134.97764373137585 ns/iter 135.48790929325267 ns/iter 1.00
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput 4500.22231889745 ns/iter 4534.970776400878 ns/iter 0.99
Micro_2019_09_Unevaluated_Properties 28.513144679071587 ns/iter 29.012215018087467 ns/iter 0.98
Micro_2019_09_Compile_Wrap 338474509.99996907 ns/iter 313226673.00003105 ns/iter 1.08
Micro_Draft7_If_Then_Else 25.07440934825611 ns/iter 25.184048026262893 ns/iter 1.00
Micro_Draft6_Property_Names 142.13812451356338 ns/iter 143.52559825992887 ns/iter 0.99
Micro_Draft6_Compile_FHIR 15049447254.999905 ns/iter 14748167392.999903 ns/iter 1.02
Micro_Draft4_Meta_1_No_Callback 172.29569434169792 ns/iter 174.486392767868 ns/iter 0.99
Micro_Draft4_Required_Properties 842.6076224036005 ns/iter 825.1280917813372 ns/iter 1.02
Micro_Draft4_Many_Optional_Properties_Minimal_Match 21.27150318335619 ns/iter 22.641227276729115 ns/iter 0.94
Micro_Draft4_Few_Optional_Properties_Minimal_Match 12.68550765572672 ns/iter 12.668169963755975 ns/iter 1.00
Micro_Draft4_Items_Schema 315.5751684260426 ns/iter 315.7421716642742 ns/iter 1.00
Micro_Draft4_Nested_Object 2.1117643892611895 ns/iter 1.7600460566310043 ns/iter 1.20
Micro_Draft4_Properties_Triad_Optional 446.4799650131817 ns/iter 523.4362564436358 ns/iter 0.85
Micro_Draft4_Properties_Triad_Closed 359.46732424245846 ns/iter 431.0924147854824 ns/iter 0.83
Micro_Draft4_Properties_Triad_Required 472.26049007405135 ns/iter 534.687274318832 ns/iter 0.88
Micro_Draft4_Properties_Closed 62.56430798698332 ns/iter 62.37280024302244 ns/iter 1.00
Micro_Draft4_Non_Recursive_Ref 8.899153803869694 ns/iter 8.830675839169595 ns/iter 1.01
Micro_Draft4_Pattern_Properties_True 193.37102442553547 ns/iter 206.83865257517058 ns/iter 0.93
Micro_Draft4_Ref_To_Single_Property 12.664906260815847 ns/iter 12.669399526574857 ns/iter 1.00
Micro_Draft4_Additional_Properties_Type 15.134058387804577 ns/iter 14.93325748549227 ns/iter 1.01
Micro_Draft4_Nested_Oneof 65.49471399698737 ns/iter 68.83616991139566 ns/iter 0.95
Micro_Draft4_Short_Enum 14.776139545705933 ns/iter 14.819456212424372 ns/iter 1.00
Micro_Draft4_Long_Enum 13.717262172945444 ns/iter 15.108746059367524 ns/iter 0.91
Micro_Draft4_Long_Enum_Short_Strings 14.816583499513117 ns/iter 14.923247468465924 ns/iter 0.99
Micro_Draft4_Type_Object 4.218736343004816 ns/iter 4.573555793859449 ns/iter 0.92
Micro_Draft4_Ref_Single_100 2484976.414893613 ns/iter 2498422.4767023833 ns/iter 0.99
Micro_Draft4_Compile_Ref_Many_Nested 1822747.9844155184 ns/iter 1826052.9270831917 ns/iter 1.00
Micro_Draft4_Compile_Wrap 2586330.7757351976 ns/iter 2593463.011110678 ns/iter 1.00
E2E_Compiler_adaptivecard 68769299.0999949 ns/iter 68435399.100008 ns/iter 1.00
E2E_Compiler_ansible_meta 31823510.50000679 ns/iter 31481725.454537727 ns/iter 1.01
E2E_Compiler_aws_cdk 410680.1668618238 ns/iter 409982.5561403995 ns/iter 1.00
E2E_Compiler_babelrc 2840704.5650405185 ns/iter 2831983.069105574 ns/iter 1.00
E2E_Compiler_clang_format 20696775.60606661 ns/iter 20548362.617646758 ns/iter 1.01
E2E_Compiler_cmake_presets 27858400.67999743 ns/iter 28595239.79167496 ns/iter 0.97
E2E_Compiler_code_climate 2900146.489626921 ns/iter 2910345.608333387 ns/iter 1.00
E2E_Compiler_cql2 14121431.480002685 ns/iter 14202304.979595024 ns/iter 0.99
E2E_Compiler_cspell 24351352.4137911 ns/iter 24554210.137929313 ns/iter 0.99
E2E_Compiler_cypress 4280482.773006628 ns/iter 4259430.317072812 ns/iter 1.00
E2E_Compiler_deno 8545070.743901683 ns/iter 8516555.439025912 ns/iter 1.00
E2E_Compiler_dependabot 4383019.131249455 ns/iter 4363862.662499685 ns/iter 1.00
E2E_Compiler_draft_04 2990448.8595741685 ns/iter 2998342.081545368 ns/iter 1.00
E2E_Compiler_fabric_mod 5294034.659092024 ns/iter 5300923.674242036 ns/iter 1.00
E2E_Compiler_geojson 25658867.499998905 ns/iter 25043059.28571122 ns/iter 1.02
E2E_Compiler_gitpod_configuration 5404821.108528239 ns/iter 5451785.379845269 ns/iter 0.99
E2E_Compiler_helm_chart_lock 745904.9775641777 ns/iter 741440.0329436752 ns/iter 1.01
E2E_Compiler_importmap 303477.25966124475 ns/iter 302274.03369328234 ns/iter 1.00
E2E_Compiler_jasmine 1492273.5881106174 ns/iter 1489255.0170214507 ns/iter 1.00
E2E_Compiler_jshintrc 4768954.877550443 ns/iter 4776577.836733838 ns/iter 1.00
E2E_Compiler_jsconfig 23845371.75861749 ns/iter 23874364.448272835 ns/iter 1.00
E2E_Compiler_krakend 148341548.20000547 ns/iter 144255187.3999946 ns/iter 1.03
E2E_Compiler_lazygit 37006071.94736892 ns/iter 36658663.578954905 ns/iter 1.01
E2E_Compiler_lerna 1758437.9849246154 ns/iter 1763461.9548869953 ns/iter 1.00
E2E_Compiler_nest_cli 8223466.282352627 ns/iter 8172674.71764567 ns/iter 1.01
E2E_Compiler_omc 177203601.00003064 ns/iter 169837492.2500534 ns/iter 1.04
E2E_Compiler_omnisharp 7411351.778948397 ns/iter 7383094.69473662 ns/iter 1.00
E2E_Compiler_openapi 27433568.923076846 ns/iter 27391189.03999952 ns/iter 1.00
E2E_Compiler_pre_commit_hooks 5837797.366666565 ns/iter 5892483.218487251 ns/iter 0.99
E2E_Compiler_pulumi 4464040.464968585 ns/iter 4465325.917198341 ns/iter 1.00
E2E_Compiler_semantic_release 1730381.8740744232 ns/iter 1739884.8511166258 ns/iter 0.99
E2E_Compiler_stale 1687519.5518072778 ns/iter 1689074.4396136329 ns/iter 1.00
E2E_Compiler_stylecop 6693586.838095402 ns/iter 6658180.380953213 ns/iter 1.01
E2E_Compiler_tmuxinator 2134974.698170792 ns/iter 2138645.8567074593 ns/iter 1.00
E2E_Compiler_ui5 51800482.076924495 ns/iter 51062785.1428548 ns/iter 1.01
E2E_Compiler_ui5_manifest 330927271.5000588 ns/iter 325588440.00004685 ns/iter 1.02
E2E_Compiler_unreal_engine_uproject 5033154.550000875 ns/iter 5034406.330935734 ns/iter 1.00
E2E_Compiler_users_array 854170.4705882748 ns/iter 852497.9523227626 ns/iter 1.00
E2E_Compiler_vercel 13470305.923078742 ns/iter 13403066.88461204 ns/iter 1.01
E2E_Compiler_yamllint 373924.9255489757 ns/iter 369699.70116149966 ns/iter 1.01
E2E_Evaluator_adaptivecard 23315.111010862583 ns/iter 23378.14415766371 ns/iter 1.00
E2E_Evaluator_ansible_meta 222892.4847302922 ns/iter 224864.88504545268 ns/iter 0.99
E2E_Evaluator_aws_cdk 43854.74934875638 ns/iter 44582.47475461299 ns/iter 0.98
E2E_Evaluator_babelrc 84308.29708223499 ns/iter 87886.77046709666 ns/iter 0.96
E2E_Evaluator_cerebrum_criminal_case 1078247.1756549326 ns/iter 1063350.684627355 ns/iter 1.01
E2E_Evaluator_clang_format 96842.99724364968 ns/iter 99259.85392780436 ns/iter 0.98
E2E_Evaluator_cmake_presets 4804951.191175632 ns/iter 4488719.286764067 ns/iter 1.07
E2E_Evaluator_code_climate 174127.65642802246 ns/iter 173691.76172838637 ns/iter 1.00
E2E_Evaluator_cql2 206746.3022913681 ns/iter 208256.02824021463 ns/iter 0.99
E2E_Evaluator_cspell 501845.8123188701 ns/iter 495608.0358187474 ns/iter 1.01
E2E_Evaluator_cypress 145705.0296884678 ns/iter 143080.67971457524 ns/iter 1.02
E2E_Evaluator_deno 272405.4775942999 ns/iter 281886.83913223806 ns/iter 0.97
E2E_Evaluator_dependabot 364234.05726185295 ns/iter 381272.52178646065 ns/iter 0.96
E2E_Evaluator_draft_04 8445582.506170962 ns/iter 7944609.062498387 ns/iter 1.06
E2E_Evaluator_fabric_mod 708875.6424816264 ns/iter 713531.659509196 ns/iter 0.99
E2E_Evaluator_geojson 16830633.952378906 ns/iter 18683021.026312847 ns/iter 0.90
E2E_Evaluator_gitpod_configuration 222359.77792125806 ns/iter 226511.60244955804 ns/iter 0.98
E2E_Evaluator_helm_chart_lock 217748.94697208345 ns/iter 211986.94505489827 ns/iter 1.03
E2E_Evaluator_importmap 42321.04505780413 ns/iter 39169.25801438325 ns/iter 1.08
E2E_Evaluator_jasmine 102712.44612228121 ns/iter 101934.10261975879 ns/iter 1.01
E2E_Evaluator_jshintrc 1067505.8400599696 ns/iter 1028419.0502958401 ns/iter 1.04
E2E_Evaluator_jsconfig 379240.29492080025 ns/iter 372142.03626657155 ns/iter 1.02
E2E_Evaluator_krakend 180671.0271328037 ns/iter 182833.2207253719 ns/iter 0.99
E2E_Evaluator_lazygit 119518.71554251699 ns/iter 122609.2741098791 ns/iter 0.97
E2E_Evaluator_lerna 120110.16706894444 ns/iter 125921.49464515658 ns/iter 0.95
E2E_Evaluator_nest_cli 180342.6152468937 ns/iter 177501.6880080886 ns/iter 1.02
E2E_Evaluator_omc 20556.29258064585 ns/iter 21715.14993972347 ns/iter 0.95
E2E_Evaluator_omnisharp 569830.0796253232 ns/iter 523240.75574276055 ns/iter 1.09
E2E_Evaluator_openapi 12054103.800001789 ns/iter 10422919.4583354 ns/iter 1.16
E2E_Evaluator_pre_commit_hooks 475946.6006711798 ns/iter 490541.3863308051 ns/iter 0.97
E2E_Evaluator_pulumi 730453.1560208269 ns/iter 720137.7730570522 ns/iter 1.01
E2E_Evaluator_semantic_release 86086.03386086988 ns/iter 86287.65457257474 ns/iter 1.00
E2E_Evaluator_stale 149979.5602071668 ns/iter 151029.25302508453 ns/iter 0.99
E2E_Evaluator_stylecop 287015.61365491565 ns/iter 286466.0199837536 ns/iter 1.00
E2E_Evaluator_tmuxinator 88019.72347630242 ns/iter 86287.37764574995 ns/iter 1.02
E2E_Evaluator_ui5 501058.0720000607 ns/iter 516865.51871254836 ns/iter 0.97
E2E_Evaluator_ui5_manifest 4377237.291666212 ns/iter 2642067.2981134453 ns/iter 1.66
E2E_Evaluator_unreal_engine_uproject 424461.86310616095 ns/iter 442319.0165442413 ns/iter 0.96
E2E_Evaluator_users_array 905844.9805698668 ns/iter 901198.8173691649 ns/iter 1.01
E2E_Evaluator_vercel 256278.47403316846 ns/iter 260973.77022062027 ns/iter 0.98
E2E_Evaluator_yamllint 10226.599729497324 ns/iter 9259.136010909766 ns/iter 1.10

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Copy Markdown

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

JavaScript (linux/gcc)

Details
Benchmark suite Current: ac043d0 Previous: 3243d56 Ratio
E2E_Evaluator_adaptivecard 116108 ns 117679 ns 0.99
E2E_Evaluator_ansible-meta 537082 ns 526340 ns 1.02
E2E_Evaluator_aws-cdk 126809 ns 124616 ns 1.02
E2E_Evaluator_babelrc 306230 ns 296664 ns 1.03
E2E_Evaluator_cerebrum-criminal-case 3131679 ns 2634494 ns 1.19
E2E_Evaluator_clang-format 282659 ns 262220 ns 1.08
E2E_Evaluator_cmake-presets 20634625 ns 17414581 ns 1.18
E2E_Evaluator_code-climate 486093 ns 479583 ns 1.01
E2E_Evaluator_cql2 1200407 ns 1196115 ns 1.00
E2E_Evaluator_cspell 1721866 ns 1568378 ns 1.10
E2E_Evaluator_cypress 878407 ns 832732 ns 1.05
E2E_Evaluator_deno 1067069 ns 1013885 ns 1.05
E2E_Evaluator_dependabot 1077414 ns 1006523 ns 1.07
E2E_Evaluator_draft-04 25559893 ns 20267740 ns 1.26
E2E_Evaluator_fabric-mod 2903361 ns 2431968 ns 1.19
E2E_Evaluator_geojson 29155100 ns 27457388 ns 1.06
E2E_Evaluator_gitpod-configuration 762959 ns 698122 ns 1.09
E2E_Evaluator_helm-chart-lock 1020178 ns 989571 ns 1.03
E2E_Evaluator_importmap 274015 ns 273178 ns 1.00
E2E_Evaluator_jasmine 285091 ns 291957 ns 0.98
E2E_Evaluator_jsconfig 1535477 ns 1430338 ns 1.07
E2E_Evaluator_jshintrc 3233172 ns 2927949 ns 1.10
E2E_Evaluator_krakend 673374 ns 657127 ns 1.02
E2E_Evaluator_lazygit 470207 ns 438083 ns 1.07
E2E_Evaluator_lerna 429652 ns 436735 ns 0.98
E2E_Evaluator_nest-cli 597295 ns 572755 ns 1.04
E2E_Evaluator_omc 90557 ns 90817 ns 1.00
E2E_Evaluator_omnisharp 1528496 ns 1472945 ns 1.04
E2E_Evaluator_openapi 26935961 ns 22507554 ns 1.20
E2E_Evaluator_pre-commit-hooks 2100564 ns 1903760 ns 1.10
E2E_Evaluator_pulumi 2119731 ns 1904854 ns 1.11
E2E_Evaluator_semantic-release 237538 ns 231185 ns 1.03
E2E_Evaluator_stale 380007 ns 367128 ns 1.04
E2E_Evaluator_stylecop 1154307 ns 1117144 ns 1.03
E2E_Evaluator_tmuxinator 220413 ns 213318 ns 1.03
E2E_Evaluator_ui5 2014911 ns 1970844 ns 1.02
E2E_Evaluator_ui5-manifest 12297607 ns 9583553 ns 1.28
E2E_Evaluator_unreal-engine-uproject 1615286 ns 1520906 ns 1.06
E2E_Evaluator_users-array 2361619 ns 2279256 ns 1.04
E2E_Evaluator_vercel 977011 ns 950032 ns 1.03
E2E_Evaluator_yamllint 27041 ns 26404 ns 1.02

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Copy Markdown

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark (macos/llvm)

Details
Benchmark suite Current: ac043d0 Previous: 3243d56 Ratio
E2E_Compiler_adaptivecard 115150161.49999724 ns/iter 63334317.75001941 ns/iter 1.82
E2E_Compiler_ansible_meta 42556619.466662 ns/iter 25489053.571431797 ns/iter 1.67
E2E_Compiler_aws_cdk 397692.2545872162 ns/iter 287527.48191319354 ns/iter 1.38
E2E_Compiler_babelrc 3564541.4915967467 ns/iter 2410397.123778494 ns/iter 1.48
E2E_Compiler_clang_format 23836468.184209768 ns/iter 18264019.736839622 ns/iter 1.31
E2E_Compiler_cmake_presets 41463833.38462119 ns/iter 26994621.80769038 ns/iter 1.54
E2E_Compiler_code_climate 3157929.4244897473 ns/iter 2270051.453968422 ns/iter 1.39
E2E_Compiler_cql2 19320560.975612774 ns/iter 12028693.965519246 ns/iter 1.61
E2E_Compiler_cspell 28065110.52173609 ns/iter 19441279.771425407 ns/iter 1.44
E2E_Compiler_cypress 5110944.999998992 ns/iter 3621785.191709904 ns/iter 1.41
E2E_Compiler_deno 9113898.744187789 ns/iter 6911112.113401913 ns/iter 1.32
E2E_Compiler_dependabot 5586257.04225275 ns/iter 3723544.1459464757 ns/iter 1.50
E2E_Compiler_draft_04 3105841.8949775333 ns/iter 2108660.429378477 ns/iter 1.47
E2E_Compiler_fabric_mod 6115115.170731348 ns/iter 3712953.5105266673 ns/iter 1.65
E2E_Compiler_geojson 38289335.399997525 ns/iter 22838539.062497888 ns/iter 1.68
E2E_Compiler_gitpod_configuration 6364486.255317891 ns/iter 4923357.258065798 ns/iter 1.29
E2E_Compiler_helm_chart_lock 855399.6494736949 ns/iter 537624.6821646398 ns/iter 1.59
E2E_Compiler_importmap 343537.7829561137 ns/iter 212131.15106119425 ns/iter 1.62
E2E_Compiler_jasmine 1878564.455398806 ns/iter 1109722.2900640592 ns/iter 1.69
E2E_Compiler_jshintrc 5272986.394556999 ns/iter 3395034.2870816686 ns/iter 1.55
E2E_Compiler_jsconfig 28775304.58620421 ns/iter 19712218.749999817 ns/iter 1.46
E2E_Compiler_krakend 208248791.66669536 ns/iter 142867614.5000054 ns/iter 1.46
E2E_Compiler_lazygit 52275901.78571973 ns/iter 34641708.33333247 ns/iter 1.51
E2E_Compiler_lerna 2298939.1126754885 ns/iter 1360440.3327203793 ns/iter 1.69
E2E_Compiler_nest_cli 9786425.253968634 ns/iter 6331235.745613796 ns/iter 1.55
E2E_Compiler_omc 379629520.99996984 ns/iter 176402114.74997613 ns/iter 2.15
E2E_Compiler_omnisharp 12003191.780821322 ns/iter 5986978.991869342 ns/iter 2.00
E2E_Compiler_openapi 50293005.2500119 ns/iter 25679476.00000204 ns/iter 1.96
E2E_Compiler_pre_commit_hooks 6469421.484210838 ns/iter 4227145.833333452 ns/iter 1.53
E2E_Compiler_pulumi 5205477.080000946 ns/iter 3253223.5233647274 ns/iter 1.60
E2E_Compiler_semantic_release 2050087.049295831 ns/iter 1219440.0162160993 ns/iter 1.68
E2E_Compiler_stale 2000162.499999878 ns/iter 1235804.2735503777 ns/iter 1.62
E2E_Compiler_stylecop 7865206.443181126 ns/iter 5545035.527131066 ns/iter 1.42
E2E_Compiler_tmuxinator 2260262.8424653807 ns/iter 1551402.59060407 ns/iter 1.46
E2E_Compiler_ui5 102635152.77776808 ns/iter 55990605.76922127 ns/iter 1.83
E2E_Compiler_ui5_manifest 546062749.999919 ns/iter 303560458.49998736 ns/iter 1.80
E2E_Compiler_unreal_engine_uproject 6217257.113821984 ns/iter 3853574.0212770426 ns/iter 1.61
E2E_Compiler_users_array 1188589.4981502867 ns/iter 813953.5458562003 ns/iter 1.46
E2E_Compiler_vercel 21559100.435897797 ns/iter 12672786.728810519 ns/iter 1.70
E2E_Compiler_yamllint 457914.4267990858 ns/iter 312609.78612712986 ns/iter 1.46
E2E_Evaluator_adaptivecard 30714.02344760597 ns/iter 18548.907038241796 ns/iter 1.66
E2E_Evaluator_ansible_meta 233033.62060730325 ns/iter 160348.99677124713 ns/iter 1.45
E2E_Evaluator_aws_cdk 53621.994953187736 ns/iter 33241.91186685354 ns/iter 1.61
E2E_Evaluator_babelrc 125857.40695595619 ns/iter 77789.81665605292 ns/iter 1.62
E2E_Evaluator_cerebrum_criminal_case 880431.1534885168 ns/iter 649511.9202834169 ns/iter 1.36
E2E_Evaluator_clang_format 142115.6012800456 ns/iter 94930.65908200321 ns/iter 1.50
E2E_Evaluator_cmake_presets 4648835.449151871 ns/iter 3247552.4162897496 ns/iter 1.43
E2E_Evaluator_code_climate 166200.75145448168 ns/iter 123387.60416666142 ns/iter 1.35
E2E_Evaluator_cql2 194289.87560981966 ns/iter 150140.03385102923 ns/iter 1.29
E2E_Evaluator_cspell 599075.7614165209 ns/iter 396071.2090208627 ns/iter 1.51
E2E_Evaluator_cypress 205781.10263522327 ns/iter 133994.51005920544 ns/iter 1.54
E2E_Evaluator_deno 324153.92772664235 ns/iter 223227.5544249097 ns/iter 1.45
E2E_Evaluator_dependabot 380047.59246232704 ns/iter 335276.82473776577 ns/iter 1.13
E2E_Evaluator_draft_04 8832665.02941136 ns/iter 6020488.577777778 ns/iter 1.47
E2E_Evaluator_fabric_mod 640465.2424624776 ns/iter 560885.6249998553 ns/iter 1.14
E2E_Evaluator_geojson 22730619.241381895 ns/iter 12120683.785716275 ns/iter 1.88
E2E_Evaluator_gitpod_configuration 389601.0911261197 ns/iter 192015.11932652368 ns/iter 2.03
E2E_Evaluator_helm_chart_lock 382627.55785115226 ns/iter 229134.2428673627 ns/iter 1.67
E2E_Evaluator_importmap 46936.99442393482 ns/iter 32770.57811428214 ns/iter 1.43
E2E_Evaluator_jasmine 138406.9437319248 ns/iter 102440.43825603626 ns/iter 1.35
E2E_Evaluator_jshintrc 1529587.9120878035 ns/iter 1079831.0276563023 ns/iter 1.42
E2E_Evaluator_jsconfig 535611.7441861411 ns/iter 328980.3695150125 ns/iter 1.63
E2E_Evaluator_krakend 225933.0720282279 ns/iter 141010.05434781656 ns/iter 1.60
E2E_Evaluator_lazygit 146271.87857477035 ns/iter 102375.21183174773 ns/iter 1.43
E2E_Evaluator_lerna 176085.5096325784 ns/iter 116340.62926435299 ns/iter 1.51
E2E_Evaluator_nest_cli 182555.51148511152 ns/iter 133787.92735041422 ns/iter 1.36
E2E_Evaluator_omc 21476.753074393888 ns/iter 15047.299830204998 ns/iter 1.43
E2E_Evaluator_omnisharp 455289.30900963186 ns/iter 493152.1827177491 ns/iter 0.92
E2E_Evaluator_openapi 11200668.695124011 ns/iter 5863844.512194236 ns/iter 1.91
E2E_Evaluator_pre_commit_hooks 619214.089638083 ns/iter 348777.44360893307 ns/iter 1.78
E2E_Evaluator_pulumi 787740.1913746181 ns/iter 688802.7059829208 ns/iter 1.14
E2E_Evaluator_semantic_release 86912.31612764958 ns/iter 74870.49241181542 ns/iter 1.16
E2E_Evaluator_stale 117026.63497788075 ns/iter 121440.443880248 ns/iter 0.96
E2E_Evaluator_stylecop 216564.0925077116 ns/iter 205314.52044164573 ns/iter 1.05
E2E_Evaluator_tmuxinator 79737.08202259407 ns/iter 76773.21567484841 ns/iter 1.04
E2E_Evaluator_ui5 386591.2379404005 ns/iter 354474.6271452022 ns/iter 1.09
E2E_Evaluator_ui5_manifest 2018947.5868421956 ns/iter 1967325.3916447503 ns/iter 1.03
E2E_Evaluator_unreal_engine_uproject 314996.41017417394 ns/iter 341811.47298587643 ns/iter 0.92
E2E_Evaluator_users_array 561868.71516074 ns/iter 617535.5919998158 ns/iter 0.91
E2E_Evaluator_vercel 248417.43203526284 ns/iter 247148.08339452674 ns/iter 1.01
E2E_Evaluator_yamllint 8865.506904356947 ns/iter 6588.514717451714 ns/iter 1.35
Micro_Draft4_Meta_1_No_Callback 187.99117393041175 ns/iter 134.43944645349438 ns/iter 1.40
Micro_Draft4_Required_Properties 846.7185056611453 ns/iter 651.5156384657464 ns/iter 1.30
Micro_Draft4_Many_Optional_Properties_Minimal_Match 19.958807338354017 ns/iter 24.894397989284126 ns/iter 0.80
Micro_Draft4_Few_Optional_Properties_Minimal_Match 7.987262226265806 ns/iter 9.024603719713221 ns/iter 0.89
Micro_Draft4_Items_Schema 341.13095031925354 ns/iter 275.90195273885 ns/iter 1.24
Micro_Draft4_Nested_Object 0.779646051055477 ns/iter 0.7442753361378756 ns/iter 1.05
Micro_Draft4_Properties_Triad_Optional 222.57501212161227 ns/iter 209.16801462724638 ns/iter 1.06
Micro_Draft4_Properties_Triad_Closed 201.3986732216784 ns/iter 192.3336702627979 ns/iter 1.05
Micro_Draft4_Properties_Triad_Required 260.0110711448033 ns/iter 223.02475351130948 ns/iter 1.17
Micro_Draft4_Properties_Closed 53.71433018240268 ns/iter 38.42397320956992 ns/iter 1.40
Micro_Draft4_Non_Recursive_Ref 15.452975760945808 ns/iter 13.119438524418703 ns/iter 1.18
Micro_Draft4_Pattern_Properties_True 168.01949564147802 ns/iter 152.4266735722784 ns/iter 1.10
Micro_Draft4_Ref_To_Single_Property 10.43960442321733 ns/iter 7.345484336216691 ns/iter 1.42
Micro_Draft4_Additional_Properties_Type 28.720165114476124 ns/iter 26.343402891800025 ns/iter 1.09
Micro_Draft4_Nested_Oneof 53.531249999991815 ns/iter 50.380487500024174 ns/iter 1.06
Micro_Draft4_Short_Enum 6.249477563869403 ns/iter 5.714578357148465 ns/iter 1.09
Micro_Draft4_Long_Enum 11.597465066427446 ns/iter 10.550880000544938 ns/iter 1.10
Micro_Draft4_Long_Enum_Short_Strings 6.282643798447356 ns/iter 6.387192531071904 ns/iter 0.98
Micro_Draft4_Type_Object 2.4609203200340426 ns/iter 2.2867838331665036 ns/iter 1.08
Micro_Draft4_Ref_Single_100 2048775.868657251 ns/iter 2046917.3959895384 ns/iter 1.00
Micro_Draft4_Compile_Ref_Many_Nested 1549266.749999788 ns/iter 1291075.2403845785 ns/iter 1.20
Micro_Draft4_Compile_Wrap 2984510.338346193 ns/iter 2202655.0711981473 ns/iter 1.35
Micro_Draft6_Property_Names 150.20968097025346 ns/iter 103.24345071089076 ns/iter 1.45
Micro_Draft6_Compile_FHIR 14474294874.99994 ns/iter 12761245832.999975 ns/iter 1.13
Micro_Draft7_If_Then_Else 20.144097214864026 ns/iter 18.395119289093778 ns/iter 1.10
Micro_2019_09_Unevaluated_Properties 34.05067289905296 ns/iter 27.848772324217514 ns/iter 1.22
Micro_2019_09_Compile_Wrap 389872833.50002146 ns/iter 423191395.49999815 ns/iter 0.92
Micro_2020_12_Dynamic_Ref 207.37516832350127 ns/iter 235.06681581779796 ns/iter 0.88
Micro_2020_12_Dynamic_Ref_Single 2.5337267494104734 ns/iter 2.43769368496607 ns/iter 1.04
Micro_2020_12_Simple_Output_Mask 899.6051324034341 ns/iter 889.5204384532661 ns/iter 1.01
Micro_2020_12_Simple_Output_Annotations 101823.94442750508 ns/iter 95308.3051398297 ns/iter 1.07
Micro_2020_12_Compile_NonCircular_Shared_Refs 985036.1450488062 ns/iter 913548.6440283116 ns/iter 1.08
Micro_2020_12_Exhaustive_Deep_Numeric 6043.815559237042 ns/iter 5253.990568090646 ns/iter 1.15
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput 136793.0854085714 ns/iter 116961.09555300014 ns/iter 1.17
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput 17384.022469781106 ns/iter 14236.267422514424 ns/iter 1.22
Micro_2020_12_Exhaustive_Deep_Numeric_Fail 110.06246170864065 ns/iter 93.50124840593648 ns/iter 1.18
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput 5467.20865357448 ns/iter 5148.884237568722 ns/iter 1.06
Alterschema_Check_Readibility_ISO_Language_Set_3 287594500.00006837 ns/iter 294478513.66664207 ns/iter 0.98
Alterschema_Check_Readibility_OMC 83324620.44444987 ns/iter 91079430.55556057 ns/iter 0.91
Alterschema_Check_Readibility_KrakenD 956280541.0000693 ns/iter 857433291.9997687 ns/iter 1.12
Alterschema_Apply_Readibility_KrakenD 91882175499.99991 ns/iter 78883855832.99988 ns/iter 1.16
Alterschema_Check_Invalid_External_Refs 205975666.6667454 ns/iter 168558770.99999362 ns/iter 1.22

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Copy Markdown

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

JavaScript (macos/llvm)

Details
Benchmark suite Current: ac043d0 Previous: 3243d56 Ratio
E2E_Evaluator_adaptivecard 171469 ns 102273 ns 1.68
E2E_Evaluator_ansible-meta 539000 ns 394223 ns 1.37
E2E_Evaluator_aws-cdk 187457 ns 145256 ns 1.29
E2E_Evaluator_babelrc 357654 ns 290539 ns 1.23
E2E_Evaluator_cerebrum-criminal-case 2076316 ns 1806914 ns 1.15
E2E_Evaluator_clang-format 304973 ns 200569 ns 1.52
E2E_Evaluator_cmake-presets 21781949 ns 12885938 ns 1.69
E2E_Evaluator_code-climate 709263 ns 406350 ns 1.75
E2E_Evaluator_cql2 1668742 ns 1051243 ns 1.59
E2E_Evaluator_cspell 1828196 ns 1207043 ns 1.51
E2E_Evaluator_cypress 920031 ns 635595 ns 1.45
E2E_Evaluator_deno 1252988 ns 754990 ns 1.66
E2E_Evaluator_dependabot 1486136 ns 728135 ns 2.04
E2E_Evaluator_draft-04 25714423 ns 16067553 ns 1.60
E2E_Evaluator_fabric-mod 2988071 ns 1551307 ns 1.93
E2E_Evaluator_geojson 33213918 ns 17944491 ns 1.85
E2E_Evaluator_gitpod-configuration 991151 ns 588988 ns 1.68
E2E_Evaluator_helm-chart-lock 1716695 ns 962226 ns 1.78
E2E_Evaluator_importmap 401773 ns 259975 ns 1.55
E2E_Evaluator_jasmine 273263 ns 249087 ns 1.10
E2E_Evaluator_jsconfig 1212376 ns 1087896 ns 1.11
E2E_Evaluator_jshintrc 2474408 ns 2890891 ns 0.86
E2E_Evaluator_krakend 581652 ns 487277 ns 1.19
E2E_Evaluator_lazygit 352946 ns 412361 ns 0.86
E2E_Evaluator_lerna 467245 ns 334040 ns 1.40
E2E_Evaluator_nest-cli 1056644 ns 461500 ns 2.29
E2E_Evaluator_omc 149886 ns 70705 ns 2.12
E2E_Evaluator_omnisharp 1868758 ns 1021783 ns 1.83
E2E_Evaluator_openapi 31858768 ns 17020214 ns 1.87
E2E_Evaluator_pre-commit-hooks 2541217 ns 1365340 ns 1.86
E2E_Evaluator_pulumi 1916778 ns 1417874 ns 1.35
E2E_Evaluator_semantic-release 245259 ns 214405 ns 1.14
E2E_Evaluator_stale 474868 ns 296987 ns 1.60
E2E_Evaluator_stylecop 1920388 ns 732892 ns 2.62
E2E_Evaluator_tmuxinator 382186 ns 164787 ns 2.32
E2E_Evaluator_ui5 3236261 ns 1596037 ns 2.03
E2E_Evaluator_ui5-manifest 17038526 ns 7533652 ns 2.26
E2E_Evaluator_unreal-engine-uproject 1730402 ns 1304060 ns 1.33
E2E_Evaluator_users-array 2842588 ns 2095905 ns 1.36
E2E_Evaluator_vercel 1056837 ns 752085 ns 1.41
E2E_Evaluator_yamllint 40982 ns 29044 ns 1.41

This comment was automatically generated by workflow using github-action-benchmark.

@jviotti jviotti closed this Apr 16, 2026
@jviotti jviotti deleted the optimise-canonical branch April 16, 2026 19:51
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant