Skip to content

Added new scenario and updated FIPS testing related documentation#1427

Open
besteffects wants to merge 24 commits into
Altinity:masterfrom
besteffects:fips_140_autotests
Open

Added new scenario and updated FIPS testing related documentation#1427
besteffects wants to merge 24 commits into
Altinity:masterfrom
besteffects:fips_140_autotests

Conversation

@besteffects

Copy link
Copy Markdown
Member
  • Added test for GODEBUG modes
  • Added support for --stress mode to run all specified cipher tests
  • Coverage reports for FIPS tests

besteffects and others added 17 commits June 17, 2026 13:30
- Added godebug_fips140_modes scenario
…in, improve TestKill which actually test .pid remove
Bumps [github.com/aws/aws-sdk-go-v2/feature/s3/transfermanager](https://github.com/aws/aws-sdk-go-v2) from 0.2.6 to 0.2.8.
- [Release notes](https://github.com/aws/aws-sdk-go-v2/releases)
- [Commits](aws/aws-sdk-go-v2@feature/s3/transfermanager/v0.2.6...feature/s3/transfermanager/v0.2.8)

---
updated-dependencies:
- dependency-name: github.com/aws/aws-sdk-go-v2/feature/s3/transfermanager
  dependency-version: 0.2.8
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Bumps [golang.org/x/sync](https://github.com/golang/sync) from 0.20.0 to 0.21.0.
- [Commits](golang/sync@v0.20.0...v0.21.0)

---
updated-dependencies:
- dependency-name: golang.org/x/sync
  dependency-version: 0.21.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
…anges

restic 0.19.0 (test installs releases/latest) crossed the 0.17.0 boundary
where exit codes were formalized, breaking two custom-storage scripts that
had not changed in years:

- upload.sh: restic now returns exit code 3 ("backed up some source files,
  but not all") whenever a command-line path does not exist. Most disks have
  no backup directory, so the skipped paths flip the exit code even though the
  snapshot is saved. set -euo pipefail aborted before restic forget, so
  clickhouse-backup saw a failure. Accept exit code 3, fail on anything else.

- list.sh: restic stats --json now writes a progress line to stdout before the
  JSON (even with --quiet), poisoning the jq parse and failing list_custom.
  Keep only the JSON object line via grep.

Verified live in the running container and with the full TestCustomRestic run.
-  `fips.xml` to disable insecure listeners and enforce secure ports with a specified cipher list
- Added `listeners-fips-cipher-stress.xml`
@besteffects

besteffects commented Jun 17, 2026

Copy link
Copy Markdown
Member Author

@Slach
This task is in progress. Please do not merge yet.

@besteffects besteffects marked this pull request as ready for review June 19, 2026 17:30
@besteffects

Copy link
Copy Markdown
Member Author

@Slach The PR is ready to be merged. Please review.

@Slach

Slach commented Jun 19, 2026

Copy link
Copy Markdown
Collaborator

@besteffects please fix failed CI/CD first

@besteffects

Copy link
Copy Markdown
Member Author

@Slach I increased timeout in RestartContainer from 10 to 12 minutes. This was the place where integration tests sometimes failed.
It is not related to Testflows/FIPS tests.

return err
}
return tc.waitHealthy(ctx, name, 10*time.Minute, t.Name())
// 12min restart headroom.

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

remove useless comment

# These requirements were auto generated
# from software requirements specification (SRS)
# document by TestFlows v2.1.240306.1133530.
# document by TestFlows v2.0.250110.1002922.

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

why do you use outdated testflows version? look requirements.txt
testflows==2.4.19
use separate venv for it

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants