Product documentation Docs
    • English
    • Deutsch
    • 日本語
    • 한국어
    • Français
  • More Sites
    • Now Community
    • Developer Site
    • Knowledge Base
    • Product Information
    • ServiceNow.com
    • Training
    • Customer Success Center
    • ServiceNow Support Videos
  • Log in

Product documentation

  • Home
How search works:
  • Punctuation and capital letters are ignored
  • Special characters like underscores (_) are removed
  • Known synonyms are applied
  • The most relevant topics (based on weighting and matching to search terms) are listed first in search results
Topics are ranked in search results by how closely they match your search terms
  • A match on the entire phrase you typed
  • A match on part of the phrase you typed
  • A match on ALL of the terms in the phrase you typed
  • A match on ANY of the terms in the phrase you typed

Note: Matches in titles are always highly ranked.

  • Release version
    Table of Contents
    • Orlando release notes
Table of Contents
Choose your release version
    Home Orlando Release Notes Orlando release notes Learn about Orlando Release notes for upgrading from New York Features and changes by product Now Platform App Engine release notes Automated Test Framework (ATF) release notes

    Automated Test Framework (ATF) release notes

    • Save as PDF Selected topic Topic & subtopics All topics in contents
    • Unsubscribe Log in to subscribe to topics and get notified when content changes.
    • Share this page

    Automated Test Framework (ATF) release notes

    ServiceNow® Automated Test Framework product enhancements and updates in the Orlando release.

    The Automated Test Framework (ATF) enables you to create and run automated tests to confirm that your instance works after making a change. For example, after an upgrade, during application development, or when deploying instance configurations with update sets. Review failed test results to identify the changes that caused the failure and the changes that you should review.

    Orlando upgrade information

    Copy and customize quick start tests provided by the Now Platform® to validate that your instance works after you make any configuration changes. For example, if you apply an upgrade or develop an application.

    The tests can only produce a pass result when you run them with the default demo data that's provided with the application or feature plugin. To apply a quick start test to your instance-specific data, copy the quick start test and add your custom data. See Available quick start tests by application or feature.

    New in the Orlando release

    Copy an automated test suite
    Reduce time in creating tests by copying an entire test suite. Rename and modify the test suite after copying. The Copy Test Suite button on the Test Suite form copies all the nested tests and child test suites within the test suite.
    Custom UI test steps
    Test workspaces using the Form category test steps. The Custom UI category steps don't support available workspace.
    List and Related List
    Validate the functionality and visibility of records and UI actions in lists and related lists.
    Validate Related List Visibility
    Validate the visibility of the selected related lists on a form.
    Apply Filter to List
    Apply a filter to a list to find the required record.
    Validate Record Present in List
    Validate the presence of a record in a list. A valid form must be open and the list containing the record must be visible to proceed.
    Open a Record in List
    Open a specific record in a list.
    Validate List UI Action Visibility
    Validate that a UI action is visible in a list. If you're impersonating a user, the visibility of a UI action can change depending on the user being impersonated.
    Click a List UI Action
    Select a list UI action in a list on a form.
    Email category
    Use Automated Test Framework (ATF) to test email notifications, outbound email flows, and inbound email responses.
    Validate Outbound Email
    Verify that a certain outbound email exists by searching for it in the Email [sys_email] table.
    Validate Outbound Email Generated by Flow
    Verify that a certain outbound email exists by searching for it in the Email [sys_email] table. Use this step to test that a flow is triggered as expected.
    Validate Outbound Email Generated by Notification
    Verify that a certain outbound email exists by searching for it in the Email [sys_email] table. Use this step to test that an email notification is triggered as expected.
    Generate Inbound Email
    Create an email record that looks like an email that's sent to your instance. Use the email record to test an inbound email flow or an inbound email action.
    Generate Inbound Reply Email
    Create a reply email record to test how the system handles a user response to an email notification.
    Generate Random String
    Generate a string of random alphanumeric characters that you can use as test data for another step.

    Changed in this release

    Form category
    Some test steps under the Form category now let you select an available workspace.
    Create a Custom UI test
    Warning messages show up if a test doesn't yield any components after selecting Retrieve Components. Ensure that the client test runner tabs used in the retrieval process are running in the foreground.
    Page Inspector
    The Custom UI category test steps can now interact with UI formatters. The UI formatters have been whitelisted to enable access by the Custom UI test steps.
    Forms in Service Portal Category
    For the Open a Form (SP), Click UI Action (SP), Submit a Form (SP) test step in Automated Test Framework (ATF) forms, you can now specify the number of seconds allowed before the step fails.

    Activation information

    Automated Test Framework is a Now Platform feature that is active by default.
    Note: By default, the system property that is used to run automated tests is disabled to prevent you from accidentally running these tests on a production system. To avoid data corruption or an outage, run tests only on development, test, and other non-production instances. See Enable or disable executing Automated Test Framework tests.

    To use the quick start tests for an application, activate the plugin that is associated with the application. See Available quick start tests by application or feature for plugin requirements.

    Browser requirements

    Automated Test Framework only supports running tests from desktop browsers. You can't run tests or test suites from tablets, mobile browsers, or the mobile UI. Some desktop browsers require additional configuration. See Browser recommendations for Automated Test Framework.

    Automated Test Framework offers limited support for test design on tablets. You can't add new custom UI test steps from tablets because tablets can't retrieve any components. Review existing custom UI test steps that were added from a desktop browser.

    Related ServiceNow products

    Notifications
    Use Automated Test Framework (ATF) to test email notifications, outbound email flows, and inbound email responses.
    Service Portal
    Validate the functionality of fields and UI actions in ServiceNow® Service Portal form widgets.

    Tags:

    Feedback
    On this page

    Previous topic

    Next topic

    • Contact Us
    • Careers
    • Terms of Use
    • Privacy Statement
    • Sitemap
    • © ServiceNow. All rights reserved.

    Release version
    Choose your release version

      Automated Test Framework (ATF) release notes

      • Save as PDF Selected topic Topic & subtopics All topics in contents
      • Unsubscribe Log in to subscribe to topics and get notified when content changes.
      • Share this page

      Automated Test Framework (ATF) release notes

      ServiceNow® Automated Test Framework product enhancements and updates in the Orlando release.

      The Automated Test Framework (ATF) enables you to create and run automated tests to confirm that your instance works after making a change. For example, after an upgrade, during application development, or when deploying instance configurations with update sets. Review failed test results to identify the changes that caused the failure and the changes that you should review.

      Orlando upgrade information

      Copy and customize quick start tests provided by the Now Platform® to validate that your instance works after you make any configuration changes. For example, if you apply an upgrade or develop an application.

      The tests can only produce a pass result when you run them with the default demo data that's provided with the application or feature plugin. To apply a quick start test to your instance-specific data, copy the quick start test and add your custom data. See Available quick start tests by application or feature.

      New in the Orlando release

      Copy an automated test suite
      Reduce time in creating tests by copying an entire test suite. Rename and modify the test suite after copying. The Copy Test Suite button on the Test Suite form copies all the nested tests and child test suites within the test suite.
      Custom UI test steps
      Test workspaces using the Form category test steps. The Custom UI category steps don't support available workspace.
      List and Related List
      Validate the functionality and visibility of records and UI actions in lists and related lists.
      Validate Related List Visibility
      Validate the visibility of the selected related lists on a form.
      Apply Filter to List
      Apply a filter to a list to find the required record.
      Validate Record Present in List
      Validate the presence of a record in a list. A valid form must be open and the list containing the record must be visible to proceed.
      Open a Record in List
      Open a specific record in a list.
      Validate List UI Action Visibility
      Validate that a UI action is visible in a list. If you're impersonating a user, the visibility of a UI action can change depending on the user being impersonated.
      Click a List UI Action
      Select a list UI action in a list on a form.
      Email category
      Use Automated Test Framework (ATF) to test email notifications, outbound email flows, and inbound email responses.
      Validate Outbound Email
      Verify that a certain outbound email exists by searching for it in the Email [sys_email] table.
      Validate Outbound Email Generated by Flow
      Verify that a certain outbound email exists by searching for it in the Email [sys_email] table. Use this step to test that a flow is triggered as expected.
      Validate Outbound Email Generated by Notification
      Verify that a certain outbound email exists by searching for it in the Email [sys_email] table. Use this step to test that an email notification is triggered as expected.
      Generate Inbound Email
      Create an email record that looks like an email that's sent to your instance. Use the email record to test an inbound email flow or an inbound email action.
      Generate Inbound Reply Email
      Create a reply email record to test how the system handles a user response to an email notification.
      Generate Random String
      Generate a string of random alphanumeric characters that you can use as test data for another step.

      Changed in this release

      Form category
      Some test steps under the Form category now let you select an available workspace.
      Create a Custom UI test
      Warning messages show up if a test doesn't yield any components after selecting Retrieve Components. Ensure that the client test runner tabs used in the retrieval process are running in the foreground.
      Page Inspector
      The Custom UI category test steps can now interact with UI formatters. The UI formatters have been whitelisted to enable access by the Custom UI test steps.
      Forms in Service Portal Category
      For the Open a Form (SP), Click UI Action (SP), Submit a Form (SP) test step in Automated Test Framework (ATF) forms, you can now specify the number of seconds allowed before the step fails.

      Activation information

      Automated Test Framework is a Now Platform feature that is active by default.
      Note: By default, the system property that is used to run automated tests is disabled to prevent you from accidentally running these tests on a production system. To avoid data corruption or an outage, run tests only on development, test, and other non-production instances. See Enable or disable executing Automated Test Framework tests.

      To use the quick start tests for an application, activate the plugin that is associated with the application. See Available quick start tests by application or feature for plugin requirements.

      Browser requirements

      Automated Test Framework only supports running tests from desktop browsers. You can't run tests or test suites from tablets, mobile browsers, or the mobile UI. Some desktop browsers require additional configuration. See Browser recommendations for Automated Test Framework.

      Automated Test Framework offers limited support for test design on tablets. You can't add new custom UI test steps from tablets because tablets can't retrieve any components. Review existing custom UI test steps that were added from a desktop browser.

      Related ServiceNow products

      Notifications
      Use Automated Test Framework (ATF) to test email notifications, outbound email flows, and inbound email responses.
      Service Portal
      Validate the functionality of fields and UI actions in ServiceNow® Service Portal form widgets.

      Tags:

      Feedback

          Share this page

          Got it! Feel free to add a comment
          To share your product suggestions, visit the Idea Portal.
          Please let us know how to improve this content

          Check any that apply

          To share your product suggestions, visit the Idea Portal.
          Confirm

          We were unable to find "Coaching" in Jakarta. Would you like to search instead?

          No Yes
          • Contact Us
          • Careers
          • Terms of Use
          • Privacy Statement
          • Sitemap
          • © ServiceNow. All rights reserved.

          Subscribe Subscribed Unsubscribe Last updated: Tags: January February March April May June July August September October November December No Results Found Versions Search preferences successfully updated My release version successfully updated My release version successfully deleted An error has occurred. Please try again later. You have been unsubscribed from all topics. You are now subscribed to and will receive notifications if any changes are made to this page. You have been unsubscribed from this content Thank you for your feedback. Form temporarily unavailable. Please try again or contact  docfeedback@servicenow.com  to submit your comments. The topic you requested does not exist in the release. You were redirected to a related topic instead. The available release versions for this topic are listed There is no specific version for this documentation. Explore products Click to go to the page. Release notes and upgrades Click to open the dropdown menu. Delete Remove No selected version Reset This field is required You are already subscribed to this topic Attach screenshot The file you uploaded exceeds the allowed file size of 20MB. Please try again with a smaller file. Please complete the reCAPTCHA step to attach a screenshot
          Log in to personalize your search results and subscribe to topics
          No, thanks Login