Skip to content

devops: submit e2e tests to Flakiness dashboard - #7907

Open
aslushnikov wants to merge 2 commits into
getredash:masterfrom
aslushnikov:first-tests
Open

aslushnikov wants to merge 2 commits into
getredash:masterfrom
aslushnikov:first-tests

Conversation

@aslushnikov

@aslushnikov aslushnikov commented Nov 3, 2026 •

Copy link
Copy Markdown

Submit first batch of test results to Flakiness.io.
I'll follow up with PRs to submit more test results, such as:

  • visual tests
  • backend pytest
  • jest

PRs from forks (including this one) get neither GitHub secrets nor OIDC tokens, so the reporter can't upload from them by default. To cover them, the e2e job uses the new authentication flow for fork PRs via flakiness/authenticate-fork-prs. It does nothing in other runs, which keep using OIDC.

Once landed, the project admin should enable Accept uploads from pull requests from forks in https://flakiness.io/redash/redash/access

@request-info

request-info Bot commented Nov 3, 2026

Copy link
Copy Markdown

We would appreciate it if you could provide us with more info about this issue/pr!

@chatgpt-codex-connector

chatgpt-codex-connector Bot commented Nov 3, 2026 •

Copy link
Copy Markdown

Codex Review Summary

This comment shows the latest Codex review activity on this pull request.

Review Status Commit Review trigger
📝 Code Review ✅ Completed 2026-11-06T04:34:12.270968Z 58bb3a4 New commits
ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review" or "@codex security review".

Codex reacts with 👀 while any review is running, comments if it has suggestions, and reacts with 👍 once all reviews finish with no findings.

@greptile-apps

greptile-apps Bot commented Nov 3, 2026 •

Copy link
Copy Markdown

RetriggerView in GreptileConfidence Score: 5/5

[Medium impact] No confirmed issue in the reviewed changes blocks merging.

Summary

Adds Flakiness.io reporting to the end-to-end test suite.

  • Playwright E2E runs now add their results to Flakiness.io.

No actionable new issues were established in the changes since the previous review.

Reviews (2) · Last reviewed commit: "devops: send e2e results to Flakiness.io..." · Reviewed by Greptile

@cubic-dev-ai cubic-dev-ai Bot left a comment •

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

All reported issues were addressed across 5 files

Reply to a comment to ask cubic a question or push back. It learns from your replies.

View guided diff | Re-trigger cubic

Comment thread .github/workflows/ci.yml Resolved
GitHub gives jobs of PRs from forks neither secrets nor OIDC tokens, so
the reporter can't upload. flakiness/authenticate-fork-prs gets it a
token for these runs: https://docs.flakiness.io/ci/github-actions-open-source/

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@aslushnikov

Copy link
Copy Markdown
Author

@arikfr we released the new authentication workflow for prs, I updated this PR to include it. Now prs-from-forks will get test dashboard too.

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants