Skip to content

Use commit statuses for UI test comments - #867

Merged
Kyle-Ye merged 2 commits into
mainfrom
codex/uitest-commit-statuses
May 17, 2026
Merged

Use commit statuses for UI test comments#867
Kyle-Ye merged 2 commits into
mainfrom
codex/uitest-commit-statuses

Conversation

@Kyle-Ye

@Kyle-Ye Kyle-Ye commented May 17, 2026

Copy link
Copy Markdown
Member

Summary

  • Switch comment-triggered UI test reporting from Checks API to Commit Status API
  • Publish stable contexts for UI Tests / iOS and UI Tests / macOS
  • Keep same-repository protection for status updates

Validation

  • ruby -e 'require "psych"; Psych.parse_file(".github/workflows/uitests.yml")'
  • git diff --check origin/main..HEAD

Note: actionlint is not installed locally.

@augmentcode

augmentcode Bot commented May 17, 2026

Copy link
Copy Markdown
🤖 Augment PR Summary

Summary: This PR changes UI-test reporting triggered by PR comments from the Checks API to the Commit Status API.

Changes:

  • Updates workflow permissions from checks: write to statuses: write
  • Creates initial commit statuses for UI Tests / iOS and UI Tests / macOS when /uitest comments are received
  • Updates those statuses during execution and sets final success/failure/error on completion
  • Adds a status-enabled output to skip status updates for fork PRs (same-repo guard)

Technical Notes: Uses stable status contexts (per platform) so downstream tooling/branch protection can key off consistent names.

🤖 Was this summary useful? React with 👍 or 👎

@augmentcode augmentcode Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Review completed. 1 suggestion posted.

Fix All in Augment

Comment augment review to trigger a new review at any time.

Comment thread .github/workflows/uitests.yml
@codecov

codecov Bot commented May 17, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 25.81%. Comparing base (7371deb) to head (a858b1d).

Additional details and impacted files
@@             Coverage Diff             @@
##             main     #867       +/-   ##
===========================================
+ Coverage   13.80%   25.81%   +12.00%     
===========================================
  Files         637      672       +35     
  Lines       41270    46453     +5183     
===========================================
+ Hits         5697    11990     +6293     
+ Misses      35573    34463     -1110     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@Kyle-Ye
Kyle-Ye merged commit ae64d8f into main May 17, 2026
1 of 6 checks passed
@Kyle-Ye
Kyle-Ye deleted the codex/uitest-commit-statuses branch May 17, 2026 18:42
@Kyle-Ye Kyle-Ye added area: tooling Developer tooling, package manifests, Tuist, scripts, formatting, or release tooling. type: ci GitHub Actions, test infrastructure, runners, checks, or automation. labels May 20, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area: tooling Developer tooling, package manifests, Tuist, scripts, formatting, or release tooling. type: ci GitHub Actions, test infrastructure, runners, checks, or automation.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant