Skip to content

Link baseline builds when creating AdHoc builds on a branch #79786

Closed as not planned

Description

@roryabraham

Background

It's an increasingly common practice to request Applause QA on AdHoc builds of E/App branches. This can increase confidence in large PRs before merge and reduce the number of deploy blockers we encounter on staging.

When Applause performs regression tests on AdHoc branches, if they encounter issues, they first check to see if the same bug is reproducible on staging before reporting it. They do this because when we request QA on AdHoc branches, we typically only want issues reported to us that are introduced by the changes on the branch. What can happen is:

  • A bug exists on main, but isn't deployed to staging yet
  • We create an AdHoc build of our branch, created off an up-to-date main
  • We request QA of our branch
  • The bug is reported, even though it exists on main and was not introduced in our branch.

Problem

When bugs exist on main, if you request AdHoc regression testing of a branch created off main, those bugs will be reported as having been introduced by your PR, which prevents us from efficiently identifying problems introduced in a branch.

Solution:

Activity

  1. self-assigned this
    on Jan 16, 2026
  2. roryabraham commented on Feb 19, 2026

    @roryabraham
    ContributorAuthor

    Still HOLDing this for now

  3. changed the title [-][HOLD] Link baseline builds when creating AdHoc builds on a branch[/-] [+]Link baseline builds when creating AdHoc builds on a branch[/+] on Apr 1, 2026
  4. roryabraham commented on Apr 1, 2026

    @roryabraham
    ContributorAuthor

    Taking this off hold, keeping it a monthly

  5. roryabraham commented on May 5, 2026

    @roryabraham
    ContributorAuthor

    not going to prioritize this over other stuff right now

  6. roryabraham commented on Jun 8, 2026

    @roryabraham
    ContributorAuthor

    Not planning to prioritize this in the near term. Closing for now

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions