Workarounds for too frequent Review Needed flags

Introduction

In Autify, a "Review Needed" label may appear on steps during scenario execution. This label is added to steps where the result should be reviewed—either due to AI's automated judgment or unexpected interaction behavior.
This article explains the main cases where the “Review Needed” label is applied and how to address them.

Main Cases Where “Review Needed” Appears

The “Review Needed” label may be applied in the following situations:

1. The target element is covered by another element

• Example: A popup or modal window covers the target element
• In this case, Autify may perform a forced click, which results in the label being added

2. The target element is non-interactive (unusable)

• Example: The element has pointer-events: none; set via CSS
• Since normal interaction is not possible, Autify forces the click and flags the step

3. Low reproducibility or unstable UI changes

• Example: Popups that display different content each time
• If Autify cannot determine the validity of the action, the label will be added

Example Workarounds

Using JavaScript Steps

In cases like the following, JavaScript steps may help avoid the label:

• Popups appear intermittently and block the test
• A forced click triggers the “Review Needed” label

Sample (detect and close a popup):

setTimeout(() => {
  const popup = document.querySelector('.popup-close-button');
  if (popup) {
    popup.click();
  }
}, 10000);

• This code waits for 10 seconds after page load and clicks the element if it exists

When Fundamental Resolution Is Difficult

• If the issue is not reproducible or the cause is unclear, consider using the "Ignore if failed" setting for the step
• For further investigation, please contact our support team

How Users Can Infer “Review Needed”

Currently, there is no explicit way in the UI to distinguish between "low AI confidence" and "forced click." However, the following clues may help:

• Logs or screenshots showing elements overlapped or hidden
• A popup appears just before the labeled step

Frequently Asked Questions (FAQ)

Q: Is “Review Needed” different from a test failure?

A: Yes. “Review Needed” does not necessarily mean failure. The test may still be marked as successful, but the step is flagged for manual review.

Q: Can I ignore the “Review Needed” label?

A: Yes, if it does not indicate a real issue. However, if it keeps appearing, consider adding JS steps or modifying the scenario.