Scenario Creation and Maintenance

How is "Ignore and continue" handled during test execution?

If a step is set to "Ignore and continue", Autify will continue passed that step, even if it were it to fail, and the test result will still have a "passed" status (assuming the conditions for all other steps are also met). If you'd like a failed ...

Written by Autify Customer success team , Yoko Rizzo

Updated on : 09 Apr 2022

Is it possible to merge two scenarios and use them as one [Scenario]?

Currently, it is not possible to merge multiple existing [Scenarios] . However, a [Scenario] created as a [Step Group] can be used anywhere within a newly created, or already existing [Scenario] . This saves you from having to re-recor...

+ 1

Written by Autify Customer success team , Rieko Araki , Ryota Nishimura and 1 others

Updated on : 26 Dec 2022

Is Digest authentication supported?

It depends. For more information, please refer to section 2 of the following FAQ article on how to embed information in URLs. Related article: Is BASIC authentication supported?

Written by Autify Customer success team , Rieko Araki

Updated on : 30 Mar 2022

Can I test two-factor authentication (2FA) using Authenticator apps using Autify?

Yes, you can. Using a JS Step, you can test two-factor authentication (2FA) using Authenticator apps. lease see the reference article below for more information on how to do this. Reference article How to test two-factor authentication (2...

+ 1

Written by Autify Customer success team , Rieko Araki , Autify Member and 1 others

Updated on : 15 Aug 2022

Does Autify support Google Sign-In?

Autify does not support Google Sign-In. Google Sign-In has a mechanism that determines and rejects mechanical operations, which Autify cannot yet test. However, you can work around this and create automated tests by using the fixed IP address ...

Written by Meiko Hori

Updated on : 19 Apr 2022

Can I branch [Scenarios] with if statements and while statements?

At this time, we do not support branching or looping when testing. However, there are ways to create a single [Test Scenario] without a need for branching: If you want to check if one of the branches fails : In the Scenario Edit Page, ...

Written by Autify Customer success team , Rieko Araki , Yoko Rizzo

Updated on : 09 Apr 2022

Can I make assertions in JavaScript?

Yes, you can. Open the [Scenario Details Page] and insert a [JS Step] where you want the assertion. Sample code if(not the expected result) { throw new Error("Error message")} For your convenience, we have created a resource wh...

+ 1

Written by Autify Customer success team , Rieko Araki , Ryota Nishimura and 1 others

Updated on : 26 Dec 2022

Does Autify support SMS verification?

Autify does not natively support SMS verification. However, this can be possible if your authentication system offers an API that performs a process equivalent to SMS verification. For further details, please check the specifications of the authen...

Written by Autify Customer success team , Rieko Araki , Yoko Rizzo

Updated on : 09 Apr 2022

Can I test websites that use WebSocket?

Autify does not block WebSocket communications, and in many cases, websites that use it can be tested. However, due to functional limitations, if even one BASIC authentication or custom hostname is set in a workspace, WebSocket communication can...

Written by Autify Customer success team , Rieko Araki

Updated on : 30 Mar 2022

Can I make a transition by directly entering the URL?

Yes, it is possible. In the [Autify recorder] , click the arrow icon, and then enter the URL of the page you want to move to. By using this function, you can also perform a test to move to a page that does not have a link on the previous ...

Written by Autify Customer success team , Rieko Araki

Updated on : 01 Apr 2022

What's the difference between Record here and Record here without replay?

If you select Record here , the recording window opens so that you can add steps. [Local Replay] will begin afterward. If you select Record here without replay , the recording window will open without [Local Replay] . Reference Article ...

Written by Autify Customer success team , Rieko Araki , Ryota Nishimura

Updated on : 26 Dec 2022

What can I do with Record Here?

Autify's Local Replay feature comes in handy when adding steps to an existing scenario. Local Replay automatically performs steps until it reaches the section of your choosing, after which you can add more steps. For example, imagine you have a te...

+ 1

Written by Autify Customer success team , Rieko Araki , Autify Member and 1 others

Updated on : 07 Sep 2022

It's hard to find the desired scenario. Do you have any advice for naming scenarios?

As the number of [scenarios] increase as you continue to use Autify, finding the desired [scenario] becomes difficult. Since the scenario list screen supports searching for multiple words by scenario name, it will be easier to find the des...

Written by Autify Customer success team , Rieko Araki , Yoko Rizzo

Updated on : 20 Apr 2022

What is the maximum number of steps per [Scenario]?

Currently, there is no functional limit. We provide support up to the 200th step of a [Scenario]. If an issue occurs past the 200th step, we may refuse to investigate. In general, we recommend creating short test scenarios to avoid the following p...

+ 1

Written by Autify Customer success team , Rieko Araki , Yoko Rizzo and 1 others

Updated on : 25 Nov 2022

Can I change test target URLs of a Scenario in bulk?

Yes, you can replace specific URLs within a Scenario by using the [URL Replacement] feature in the [Test Plan] section. For details on how to set it up and what to replace, please see this article .

+ 4

Written by Autify Customer success team , Rieko Araki , Ryota Nishimura and 4 others

Updated on : 31 Jan 2023

How many seconds does the [Sleep step] support?

The [Sleep step] that can be inserted into an Autify test scenario can be up to 600 seconds (10 minutes) . However, Autify automatically waits for a certain amount of time until an element appears, so it is rarely necessary to set a sleep ste...

Written by Autify Customer success team , Rieko Araki , Yoko Rizzo

Updated on : 20 Apr 2022

Are there only two screen sizes? Can I select a mobile screen size or full HD (1920 x 1080 pixels) or larger?

Currently, the following three window sizes are available 1280x1024 1600x1200 375x812 (iPhoneX) We are planning on adding more screen sizes. We are considering what size options to offer at the moment, so if you would like to use screen ...

+ 1

Written by Autify Customer success team , Rieko Araki , Ryota Nishimura and 1 others

Updated on : 26 Dec 2022

Can I test contact forms?

Yes, you can also test form inputs and validation checks. By using a [fixed email address] from [Email Testing] (optional feature), you can also check whether an email was successfully sent from a contact form. For details on how to use ...

+ 1

Written by Autify Customer success team , Rieko Araki , Ryota Nishimura and 1 others

Updated on : 26 Dec 2022

In the screenshot, the frame around the element is misaligned. Why is this?

One of the following may be the cause. The size of the new window opened during recording was changed. The zoom in/out function of the browser was used while recording. Your PC resolution is low (1280 x 1024 or higher recommended). If yo...

Written by Autify Customer success team , Rieko Araki , Yoko Rizzo

Updated on : 20 Apr 2022

Can I add wait and sleep?

It is possible to sleep for a certain period of time by adding a [Sleep Step] . However, Autify automatically waits for a certain period of time until an element appears and the operation or verification set in that step becomes possible, so it...

+ 1

Written by Autify Customer success team , Rieko Araki , Ryota Nishimura and 1 others

Updated on : 26 Dec 2022

No scroll is recorded. Is it possible to scroll to a specific position?

In Autify, scrolling operations are not recorded as steps, but you can verify and operate on elements that do not appear above the fold. Therefore, you generally don't have to worry about scrolling when creating a scenario. If you want to explicit...

+ 1

Written by Autify Customer success team , Rieko Araki , Ryota Nishimura and 1 others

Updated on : 28 Dec 2022

Can I run tests on smartphones and tablets? How do I record scenarios?

Yes, you can. This article explains how to how to record and execute scenarios for mobile devices such as smartphones and tablets. How to Record Scenarios for Mobile Devices There are two main ways to record test scenarios for mobile devices: ...

Written by Rieko Araki , Ryota Nishimura , Yoko Rizzo

Updated on : 01 Feb 2023

Is it possible to change the URL that the test is executed on?

Yes, it is possible. Open the details of the scenario for which you want to change the URL, and change the URL specified in step 1.

Written by Autify Customer success team , Rieko Araki , Yoko Rizzo

Updated on : 20 Apr 2022

Can I transition to another site during the test?

If you make a transition by directly changing the URL field of the browser, it will not be recorded. However, there is a function on the recorder that makes a transition by directly specifying the URL, and by using it, it is possible to a record the...

Written by Autify Customer success team , Rieko Araki , Yoko Rizzo

Updated on : 20 Apr 2022

I can’t successfully duplicate Scenarios as a Step Group. Why is this?

Cannot duplicate as a Step Group If the first step of a Scenario is a Step Group , [Duplicate as Step Group] will not work. Please change the first step to a Visit step before duplicating. To change the first step of a Scenario to a Visi...

+ 2

Written by Autify Customer success team , Rieko Araki , Ryota Nishimura and 2 others

Updated on : 31 Jan 2023

Can I copy Scenarios as a Step Group?

Yes, you can! Please follow the steps below. Duplicate from the Scenario Details Page Click the kebab menu in the upper right corner of the Scenario Details Page. Click [Duplicate as Step Group] . Duplicate from the Scenario List ...

+ 3

Written by Autify Customer success team , Rieko Araki , Ryota Nishimura and 3 others

Updated on : 31 Jan 2023

Can I record drag-and-drop?

Currently, drag-and-drop is not supported natively, but we have provided a JavaScript snippet to facilitate this action. Whether it can be applied to your use case depends on how the drag-and-drop is implemented on your website, but please give it ...

Written by Rieko Araki , Yoko Rizzo

Updated on : 01 Nov 2022

Do you support puzzle authentication?

No. Please turn off puzzle authentication in your test environment.

Written by Autify Customer success team , Rieko Araki

Updated on : 30 Mar 2022

Can I test file upload?

Yes. With Autify, if you upload the file upload as usual, it will be recorded naturally and you can replace the file to be used later. To replace a file, open the details of the step by clicking the thumbnail of the step that is performing the f...

+ 1

Written by Autify Customer success team , Rieko Araki , Yuka Saito and 1 others

Updated on : 10 Jan 2023

Can I test file downloads?

You can record and execute tests that involve file downloads. However, you cannot test whether the download was complete or run tests on the downloaded file(s). We are considering the following feature improvements: Check if the downloaded fil...

Written by Autify Customer success team , Rieko Araki , Hiroki Iizuka

Updated on : 01 Apr 2022

Can I test using an email address?

We offer an [ Email Testing] feature as an optional add-on. This allows you to create and execute tests using an email address. You can test using two types of email addresses: [Random email address] : a different email address is issued...

Written by Autify Customer success team , Rieko Araki

Updated on : 30 Mar 2022

Can I test an email authentication?

Yes, you can do it with our [email testing feature] (option) . Its [random email address] functionality generates an email address every time you run your test. Please refer to the manual for details. Please contact sales for trying the ...

Written by Autify Customer success team , Rieko Araki

Updated on : 30 Mar 2022

How do I click on the Nth item in the list?

You can click on the Nth item in a list using a [Locator] or a [JS Step] . Use the [Locator] feature if you want to always specify the Nth element in a Click Step. If you cannot do this for whatever reason, use a [JS Step]. We are explorin...

+ 1

Written by Autify Customer success team , Rieko Araki , Ryota Nishimura and 1 others

Updated on : 31 Jan 2023

Why does Autify stop at file upload steps during Local Replay?

Currently, Local Replay does not support file uploads. Therefore, Local Replay will always stop at file upload steps. When Local Replay stops at a file upload step, you can manually upload the file and then restart Local Replay. See Local Repl...

+ 2

Written by Autify Customer success team , Rieko Araki , Ryota Nishimura and 2 others

Updated on : 26 Dec 2022

I want to test different string patterns in one scenario.

You can test multiple data patterns in one scenario by using the function called [Data] . To learn more about [Data] , click here !

Written by Autify Customer success team , Rieko Araki , Hiroki Iizuka

Updated on : 03 Aug 2022

Can I test elements that disappear after a certain amount of time?

Currently, we do not support testing elements that disappear after a certain amount of time, such as toast and flash. You can record assertions and clicks before the target element disappears. However, it is likely that the test won’t pass consist...

Written by Autify Customer success team , Rieko Araki

Updated on : 01 Apr 2022

Can I test actions against the print dialog?

Unfortunately, no. Because the print dialog is displayed by the browser, you cannot perform actions against elements within the dialog on Autify (clicking and scrolling, for example). Please consider testing another way, such as manual testing. ...

+ 1

Written by Autify Customer success team , Rieko Araki , Ryota Nishimura and 1 others

Updated on : 31 Jan 2023

Can I specify the time zone of the execution environment?

The time zones of Autify's test execution environment are as follows. If you need to get the date and time value reflecting the time zone, such as in a test that requires calendar input from the browser, please use a Dynamic date in the Dynami...

Written by Autify Customer success team , Rieko Araki , Hiroki Iizuka

Updated on : 19 Dec 2022

Can I test mouse operations such as right-clicks and hover?

How to record mouseover action To record mouseover (hover), right-click the target element while recording and select "Add Hover Step" from the context menu that appears.

+ 2

Written by Autify Customer success team , Rieko Araki , Ryota Nishimura and 2 others

Updated on : 26 Dec 2022

Can I use the current date and time or random numbers as variables?

It is possible by using [Dynamic value] feature. For more information about this, please see the following documents: Dynamic value generation

+ 1

Written by Autify Customer success team , Rieko Araki , Yuka Saito and 1 others

Updated on : 13 Dec 2022

Can I change Step 1 of an existing [Scenario] to a [Step Group]?

Yes, you can! Please follow the steps below to change [Visit] in the first step of an existing [Scenario] to [Execute step group] . Open the details section of Step 1. In the pull-down menu under Action, select [Execute step group] . ...

Written by Autify Customer success team , Rieko Araki , Hiroki Iizuka

Updated on : 20 May 2022

Is it possible to update (reload), back and forward the screen?

Yes, it is possible by using JavaScript. Open the scenario details and insert the JS step where you want to reload. Please refer to this snippet .

Written by Autify Customer success team , Rieko Araki , Ryota Nishimura

Updated on : 26 Dec 2022

What should I do when the displayed content is long and I want to press the target at the scroll destination?

Autify does not record the scroll operation, but generally it automatically scrolls to the operation target element/detection target element without any special settings or operations. If it does not scroll, another problem may be the cause so pleas...

Written by Autify Customer success team , Rieko Araki

Updated on : 30 Mar 2022

Why can't I create a Step Group for the selected steps?

If the steps you've selected in the Scenario Details Page contain steps that fit some of the conditions, they cannot be turned into a Step Group. For more information, please refer to the following article: Step Group for the middle/end of a ...

+ 2

Written by Rieko Araki , Ryota Nishimura , Autify Member and 2 others

Updated on : 14 Feb 2023

How can I insert a Step Group in the middle of a scenario?

To insert a Step Group in the middle of a scenario, please refer to the following article: Step Group for the middle/end of a Scenario

Written by Rieko Araki , Ryota Nishimura , Autify Member

Updated on : 31 Jan 2023

Is it possible to specify the language to be displayed for a test execution?

Browser language for test execution Default Language Settings When you sign up for Autify, a default language (English or Japanese) is set for each organization. For sites where the initial display language changes depending on the browser envi...

Written by Rieko Araki , Yoko Rizzo

Updated on : 25 Aug 2022

Is it possible to call external APIs?

You can call external APIs synchronously using this snippet. XHR snippet

Written by Rieko Araki , Ryosuke Iwanaga

Updated on : 24 Oct 2022

Is it possible to set and delete cookies?

Cookies may be used for switching display languages and A/B tests. By using [ JS Step ] , you can set the Cookie value as follows: document.cookie = 'cookie_name=cookie_parameter'; document.cookie = 'lang=en'; /* Common language settings */ ...

Written by Rieko Araki , Hiroki Iizuka

Updated on : 19 Dec 2022

Is it possible to test the absence of a specific element?

There are several ways to check that a certain element is not found. If the target is a string You can use the standard assertion command. Please click here for further information. If the target does not have a string If you want to chec...

Written by Rieko Araki , Yuka Saito , Hiroki Iizuka

Updated on : 19 Dec 2022

Can I test emojis and surrogate pairs?

Due to browser specifications, you cannot use emojis and surrogate pairs in tests that will be run on Chrome and Chromium-based browsers (e.g. Edge). Emojis and surrogate pairs are not an issue on other browsers. If you need to run tests on Chrome...

Written by Yuka Saito , Autify Member

Updated on : 12 Aug 2022

Why aren’t the screenshots of my scenario showing?

If screenshots do not appear on the scenario after recording, the problem may be one of the following. If screenshots aren't displayed at all You may not be able to see any screenshots if access to the website is restricted on the Autify Reco...

Written by Yuka Saito , Sho Fujita , Autify Member

Updated on : 29 Aug 2022

Is the domain generated by the email testing feature fixed?

The domain of the email address generated by the Email Testing Feature is fixed to @testmail.autify.com . Please see the following article for more information on other email test functions: Email Testing Feature Random vs. Fixed Ema...

Written by Ryota Nishimura , Autify Member

Updated on : 15 Aug 2022

Can I test PDF content?

Autify does not support verifying PDF content (e.g., checking text content). However, you can check whether the URL of a PDF opened in a separate tab is correct . Reference articles Can I test file downloads?

+ 1

Written by Ryota Nishimura , Meiko Hori , Autify Member and 1 others

Updated on : 26 Dec 2022

Can I record alert dialogs?

You can record actions taken on alert dialogs, but there are some limitations depending on the type of dialog. See the table below for details. Currently, the selections for the "Handle Alert" and "Input Text Into Alert" steps are fixed. For e...

Written by Hiroki Iizuka , Autify Member

Updated on : 15 Aug 2022

If I get a value using a JS Step, can I use it in other scenarios?

Currently, values you get using JS Steps can only be used in the same scenario, not in other scenarios. If you have any questions or requests, please feel free to contact us via Autify chat!

Written by Ryota Nishimura , Autify Member

Updated on : 06 Sep 2022

How do I add a time delay in a JS Step?

When testing, you often want to wait a certain period of time before executing the next process. In JavaScript, setTimeout() is used to add a time delay. However, since JS Step is executed asynchronously, the following process will happen befor...

Written by Hiroki Iizuka , Sho Fujita , Autify Member

Updated on : 29 Aug 2022

Why doesn't the desired assertion appear when recording?

If you cannot record an assertion after clicking an element, or if the desired type of assertion does not appear as an option, the following may be the cause. You have selected a different element close to the one you intended. First, please ens...

Written by Hiroki Iizuka , Autify Member

Updated on : 07 Sep 2022

Can I restore a deleted scenario or step group?

Currently, Autify does not allow deleted scenarios or step groups to be restored. Please be careful when deleting a scenario or step group. If you have any questions or requests, please feel free to contact us via Autify chat!

Written by Hiroki Iizuka , Nicholas Carter

Updated on : 02 Sep 2022

What is the difference between "Page Should Contain Element" and "Element Should Be Visible"?

"Page Should Contain Element" succeeds if the target element is present in the HTML code. Whether the element is visible or not doesn't affect the result: success or failure. Note that it succeeds even if the element is not visible on the page, ...

Written by Yuka Saito

Updated on : 29 Aug 2022

Is it possible to check that the specified element does not exist?

If the element you want to check does not exist contains a string, you can use "Page Should Not Contain" or "Element Should Not Contain" . "Page Should Not Contain" will check the entire page to make sure that no specific text is present, an...

Written by Yuka Saito

Updated on : 29 Aug 2022

Can I validate pull-down menu options?

Have you ever wanted to test pull-down menu options? Validate the values in a pull-down menu. Validate that a particular value exists (or does not exist) in the pull-down menu. With Autify, you can test the values in pull-down menus by usi...

Written by Hiroki Iizuka , Autify Member , Nicholas Carter

Updated on : 07 Sep 2022

Why can't I select a Step Group in "Insert Step"?

To insert a Step Group, click the [+] button between two steps on the scenario page, and click [Insert Step] > [Step Group]. However, if you have not created a Step Group for the middle or the end of a Scenario , the Step Group button will be gra...

Written by Ryota Nishimura , Autify Member , Rie Kuromiya

Updated on : 28 Oct 2022

Can I allow location, microphone, and camera alert dialogs when recording?

Depending on the execution environment, it is possible. On Autify, you cannot record actions against dialogs that set browser permissions (for example, clicking the Allow or Block buttons like in the image below). During test execution, permi...

Written by Autify Member , Rie Kuromiya

Updated on : 16 Jan 2023

Can I run tests on IE and Edge legacy?

Following Internet Explorer's retirement, we ended its support on December 16, 2022 - you cannot run tests on IE or Edge legacy.

Written by Yuka Saito , Autify Member

Updated on : 06 Jan 2023

Can I perform visual regression testing?

Currently, Autify does not offer a visual regression testing (image comparison) feature, but we have a feature that compares images during test execution and highlights the differences. For more information, please see the Visual diff for test res...

Written by Yuka Saito , Autify Member

Updated on : 24 Nov 2022

Can I create a test scenario that switches between two screens (e.g. user account and admin account)?

Yes, you can. You can switch between multiple screens by adding a Go to URL step . Currently, you can't run tests across multiple scenarios, such as checking whether an action taken in one scenario is reflected in another. However, you can switc...

Written by Autify Member , Rie Kuromiya

Updated on : 17 Jan 2023

When creating a Step Group to use in the middle/end of a scenario, I cannot add a "Switch to new window" step. What should I do?

Currently on Autify, you cannot create Step Groups for the middle/end of a scenario that includes a "Switch to New Window" step. However, you can add a "Switch to New Window" step by re-recording the step in a Step Group you've already created! H...

Written by Ryota Nishimura , Autify Member

Updated on : 31 Jan 2023

Frequently Asked Questions about JS Steps

I can't select the element that I want to perform an action on. What should I do? In some cases, you can't use the selector you got from Developer Tools as is, for example, if an element contains dynamic data. If you want to perform an action on ...

Written by Autify Customer success team , Autify Member , Mami Kono

Updated on : 13 Mar 2023

I don't see [Allow in incognito] on the Autify Recorder extensions page. How can I display it?

※ English in this website is translated using machine translation. Please note that the content may not be 100% accurate. If you do not see the "Allow in incognito" setting in the Autify Recorder extensions page, the following may be t...

Written by Ryota Nishimura

Updated on : 09 Mar 2023

Is there a list of Javascript methods available in the JS step?

※ English in this website is translated using machine translation. Please note that the content may not be 100% accurate. We do not provide a list of methods that can be used in the JS step, but they can be used as long as the syntax is supp...

Written by Mami Kono

Updated on : 13 Mar 2023