Skip to content

home: minimal#691

Open
isabelroses wants to merge 1 commit into
mainfrom
minimal-hm
Open

home: minimal#691
isabelroses wants to merge 1 commit into
mainfrom
minimal-hm

Conversation

@isabelroses

Copy link
Copy Markdown
Owner

No description provided.

@github-actions

github-actions Bot commented Apr 18, 2026

Copy link
Copy Markdown
Contributor

Nix Eval Stats: amaterasu

Metric Before (mean ± σ) After (mean ± σ) Δ %
cpuTime 18.686 ± 0.206 18.735 ± 0.240 +0.050 +0.3%
envs.bytes 273,738,624 ± 0.000 270,919,112 ± 0.000 -2,819,512 -1.0%
envs.elements 20,474,284 ± 0.000 20,277,996 ± 0.000 -196,288 -1.0%
envs.number 13,743,044 ± 0.000 13,586,893 ± 0.000 -156,151 -1.1%
gc.heapSize 1,292,107,776 ± 0.000 1,325,662,208 ± 0.000 +33,554,432 +2.6%
gc.totalBytes 2,161,727,488 ± 7334.905 2,149,231,024 ± 3885.036 -12,496,464 -0.6%
list.bytes 34,986,008 ± 0.000 34,587,712 ± 0.000 -398,296 -1.1%
list.concats 645,054 ± 0.000 643,179 ± 0.000 -1,875 -0.3%
list.elements 4,373,251 ± 0.000 4,323,464 ± 0.000 -49,787 -1.1%
nrAvoided 15,697,987 ± 0.000 15,556,355 ± 0.000 -141,632 -0.9%
nrFunctionCalls 11,910,544 ± 0.000 11,775,004 ± 0.000 -135,540 -1.1%
nrLookups 7,848,826 ± 0.000 7,758,948 ± 0.000 -89,878 -1.1%
nrOpUpdateValuesCopied 45,738,376 ± 0.000 45,698,071 ± 0.000 -40,305 -0.1%
nrOpUpdates 1,122,983 ± 0.000 1,117,681 ± 0.000 -5,302 -0.5%
nrPrimOpCalls 6,638,158 ± 0.000 6,571,001 ± 0.000 -67,157 -1.0%
nrThunks 19,399,464 ± 0.000 19,225,891 ± 0.000 -173,573 -0.9%
sets.bytes 1,045,167,072 ± 0.000 1,042,371,968 ± 0.000 -2,795,104 -0.3%
sets.elements 63,432,076 ± 0.000 63,280,009 ± 0.000 -152,067 -0.2%
sets.number 3,781,732 ± 0.000 3,736,478 ± 0.000 -45,254 -1.2%
sizes.Attr 16 ± 0.000 16 ± 0.000 0 +0.0%
sizes.Bindings 8 ± 0.000 8 ± 0.000 0 +0.0%
sizes.Env 8 ± 0.000 8 ± 0.000 0 +0.0%
sizes.Value 8 ± 0.000 8 ± 0.000 0 +0.0%
symbols.bytes 1,352,301 ± 0.000 1,311,241 ± 0.000 -41,060 -3.0%
symbols.number 113,285 ± 0.000 110,075 ± 0.000 -3,210 -2.8%
values.bytes 0 ± 0.000 0 ± 0.000 0 N/A
values.number 0 ± 0.000 0 ± 0.000 0 N/A

@isabelroses

Copy link
Copy Markdown
Owner Author

can't seem to reproduce the eval speed improvments that CI seems to get

@github-actions

This comment was marked as outdated.

@isabelroses isabelroses force-pushed the minimal-hm branch 3 times, most recently from f3728e1 to 7bfb277 Compare April 20, 2026 12:08
@isabelroses isabelroses force-pushed the minimal-hm branch 2 times, most recently from 82c83c7 to c9f0e4c Compare May 12, 2026 19:46
@github-actions

github-actions Bot commented May 12, 2026

Copy link
Copy Markdown
Contributor

Nix Eval Stats

Paired comparison across 7 host(s). Metrics with identical values across all hosts are listed under Unchanged; the rest get a paired t-test (p-value, t-stat).

Unchanged values

metric value
gc.cycles1 6
sizes.Attr2 16
sizes.Bindings3 8
sizes.Env4 8
sizes.Value5 8

Updated values

metric mean_before mean_after mean_diff mean_pct_change p_value t_stat
time.cpu6 10.7090 10.5115 -0.1975 -1.8637 0.0459 -2.5106
time.gc7 0.8284 0.8314 0.0030 0.4057 0.6388 0.4942
time.gcFraction8 0.0783 0.0801 0.0019 2.3189 0.0021 5.1553
gc.heapSize9 923009024.0000 920612278.8571 -2396745.1429 -0.2232 0.3559 -1.0000
gc.totalBytes10 1345502957.7143 1335140676.5714 -10362281.1429 -0.7741 0.0010 -6.0005
envs.bytes11 170353788.5714 168034238.8571 -2319549.7143 -1.3644 0.0010 -6.0000
list.bytes12 20330526.8571 19993106.2857 -337420.5714 -1.6750 0.0010 -6.0000
sets.bytes13 647602538.2857 645275852.5714 -2326685.7143 -0.3617 0.0010 -6.0000
symbols.bytes14 1275818.5714 1239875.1429 -35943.4286 -2.7971 0.0010 -6.0000
values.bytes15 10332674.2857 10249321.1429 -83353.1429 -0.8101 0.0010 -6.0000
envs.number16 8442162.1429 8313508.7143 -128653.4286 -1.5265 0.0010 -6.0000
nrAvoided17 9316386.4286 9200788.4286 -115598.0000 -1.2483 0.0010 -6.0000
nrExprs18 5434343.5714 5223609.0000 -210734.5714 -3.8054 0.0010 -6.0000
nrFunctionCalls19 7097723.8571 6986219.5714 -111504.2857 -1.5740 0.0010 -6.0000
nrLookups20 4898047.0000 4825866.8571 -72180.1429 -1.4710 0.0010 -6.0000
nrOpUpdateValuesCopied21 27822210.4286 27790758.7143 -31451.7143 -0.1142 0.0010 -6.0000
nrOpUpdates22 717505.4286 713094.4286 -4411.0000 -0.6214 0.0010 -6.0000
nrPrimOpCalls23 3385721.0000 3329536.8571 -56184.1429 -1.6675 0.0010 -6.0000
nrThunks24 11250576.0000 11107205.7143 -143370.2857 -1.2771 0.0010 -6.0000
sets.number25 2668600.7143 2630013.5714 -38587.1429 -1.4513 0.0010 -6.0000
symbols.number26 107972.4286 105166.0000 -2806.4286 -2.5770 0.0010 -5.9999
values.number27 1291584.2857 1281165.1429 -10419.1429 -0.8101 0.0010 -6.0000
envs.elements28 12852061.4286 12690771.1429 -161290.2857 -1.2580 0.0010 -6.0000
list.concats29 374297.5714 372801.7143 -1495.8571 -0.4035 0.0010 -6.0000
list.elements30 2541315.8571 2499138.2857 -42177.5714 -1.6750 0.0010 -6.0000
sets.elements31 39140858.2857 39014734.0000 -126124.2857 -0.3245 0.0010 -6.0000

Footnotes

  1. Number of times garbage collection has been performed.

  2. Size in bytes of the Attr type.

  3. Size in bytes of the Bindings type.

  4. Size in bytes of the Env type.

  5. Size in bytes of the Value type.

  6. Number of seconds of CPU time accounted by the OS to the Nix evaluator process. On UNIX systems, this comes from getrusage(RUSAGE_SELF).

  7. Number of seconds of CPU time accounted by the Boehm garbage collector to performing GC.

  8. What fraction of the total CPU time is accounted towards performing GC.

  9. Size in bytes of the garbage collector heap.

  10. Size in bytes of all allocations in the garbage collector.

  11. Size in bytes of all Env objects allocated by the Nix evaluator.

  12. Size in bytes of all lists allocated by the Nix evaluator.

  13. Size in bytes of all attrsets allocated by the Nix evaluator.

  14. Size in bytes of all items in the Nix evaluator symbol table.

  15. Size in bytes of all values allocated by the Nix evaluator.

  16. The count of all Env objects allocated.

  17. The number of thunks avoided being created.

  18. The number of expression objects ever created.

  19. The number of function calls ever made.

  20. The number of lookups into an attrset ever made.

  21. The number of attrset values copied in the process of merging attrsets.

  22. The number of attrset merge operations (//) performed.

  23. The number of function calls to primops (Nix builtins) ever made.

  24. The number of thunks ever made.

  25. The number of attrsets ever made.

  26. The number of symbols ever added to the symbol table.

  27. The number of values ever made.

  28. The number of values contained within an Env object.

  29. The number of list concatenation operations (++) performed.

  30. The number of values contained within a list.

  31. The number of values contained within an attrset.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant