Skip to content

feat: publish tested static distill-fs release binaries - #1

Merged
tianyuzhou95 merged 3 commits into
mainfrom
codex/distill-fs-release
Sep 10, 2026
Merged

tianyuzhou95 merged 3 commits into
mainfrom
codex/distill-fs-release

Conversation

@tianyuzhou95

@tianyuzhou95 tianyuzhou95 commented Sep 10, 2026 •

Copy link
Copy Markdown
Collaborator

Downstream AKernel builds currently compile distill-fs from source. Add a Linux/amd64 musl release artifact so AKernel can download a versioned binary with a pinned SHA-256 instead.

The release workflow builds with the pinned Rust 1.85.0 image and Cargo.lock, runs the default tests plus real raw/Nydus FUSE mount tests, checks static ELF linkage and execution in an empty chroot, and packages the binary with checksums, licenses, and source provenance. Pull requests and manual runs upload an Actions artifact; matching version tags on main publish the tested archive without rebuilding in the release job.

AKernel owns downstream artifact pins and installation. This change does not require a sandboxd pipeline or gitlink update.

Validation on an Ubuntu 24.04 x86_64 test node: 126 regular tests, 3 raw/Nydus tests, static ELF and empty-chroot checks, 8 downstream installer checks, and AKernel's Docker download stage passed. No release has been published.

Dedup unit tests count foreground reads independently of asynchronous dedup/sync reads, avoiding scheduler-dependent assertions on small CI runners. The missing-chunk fixture now uses the reader's data ID and checks that metadata exists while the global chunk is absent.

Validation of commit f3e8820: PR workflow and manual workflow both passed, including all 126 regular tests, 3 FUSE/Nydus tests, static checks, packaging, and artifact upload. On the designated test node, the corrected unit suite passed 20 repetitions on two CPUs and 30 on four CPUs; the actual manual-workflow artifact also passed all 8 AKernel installer checks.

The old tests also produced an intermittent segmentation fault after an assertion failure and background-thread mutex-poison panic. That crash reproduced outside the debugger, but a native stack was not captured. It has not recurred with the corrected tests in the above validation; this change does not claim to independently fix a native memory bug.

Build Linux amd64 musl artifacts with the pinned Rust toolchain and
package version, source provenance, licenses, and SHA-256 checksums.
Validate static linkage, unit tests, and real raw and Nydus FUSE mounts
before publishing matching version tags from main.

Upload tested artifacts without rebuilding in the release job so
AKernel and sandboxd can consume verified binaries instead of compiling
distill-fs in each downstream pipeline.

Signed-off-by: Tianyu Zhou <albert.zty@antgroup.com>
Point downstream release integration at AKernel's own artifact manifest
and installer instead of introducing a sandboxd pipeline dependency.
Document pull request, manual, and tag-based workflow triggers so the
first release can be validated and published in the correct order.

Signed-off-by: Tianyu Zhou <albert.zty@antgroup.com>
Count foreground backend reads separately from asynchronous dedup and
sync reads so cache-hit and fallback assertions remain deterministic on
small CI runners. Remove the timing-based sleep from the mixed-read test
and assert its exact foreground read count.

Use the reader's data ID in the missing-chunk fixture and verify that its
metadata exists while its global chunk is absent. This makes the test
exercise the intended fallback branch instead of missing metadata.

Signed-off-by: Tianyu Zhou <albert.zty@antgroup.com>
@tianyuzhou95
tianyuzhou95 merged commit ce643a0 into main Sep 10, 2026
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants