What is a Prompt Assertion
Prompt Assertion is a feature that allows you to perform assertions on screen screenshots using custom, free-form prompts.
This beta feature is only available upon request to our Support. Reach out if you want to try it.
Note that as an experimental feature, it may not always behave as expected. If you find any behavior that seems like an issue, inform our Support.
How to Add Prompt Assertion Steps to a Scenario
You add Prompt Assertion steps from the Scenario details screen. Please note that these steps cannot be added during a recording session.
-
On the Scenario details screen, hover your mouse over a recorded step and click the icon below.
-
Enter your prompt in the dialog, click the Test button to verify the behavior.
-
Once you confirm the assertion's behavior, click the Save button. A Prompt Assertion step will be added to your scenario.
Additionally, since Prompt Assertion evaluates the results based on the visual appearance of the screen, it cannot verify functional behaviors, such as whether a button is disabled.
Reviewing Prompt Assertion Steps in Test Results
On the Test Result details screen, you can hover your cursor over the question mark icon next to "See the detail" to view the specific judgment made for your prompt and the reasoning behind it.
.png?sv=2022-11-02&spr=https&st=2026-03-13T22%3A58%3A30Z&se=2026-03-13T23%3A09%3A30Z&sr=c&sp=r&sig=36qs0DlMAi8K3jK7v7jC0PjnGlxTLdQDRJljAstWeHY%3D)
Tips for Using Prompt Assertion Effectively
When prompts are ambiguous, assertion results may become unstable, leading to false negatives (failing when it should pass) or false positives. Therefore, we highly recommend writing instructions as clearly as possible.
Even with clear instructions, hallucinations can still occur, leading to unintended results. For validations that can be handled by ML Assertion, we recommend using ML Assertion instead.