Compare results and execution times for different automated test and suite results

You can compare execution times for different runs of an automated test or automated test suite. You can also compare results over time for a single automated test suite.

Before you begin

Role required: [atf_test_admin] or [atf_test_designer].

Compare execution times for different runs of an automated test

Compare how long it took the system to execute each test step across different runs of the same test.

  1. Navigate to Automated Test Framework > Tests.
  2. Select the row for the test whose results you want to compare.
    The system displays the Test record.
  3. Navigate to the Test Results related list.
  4. Check the rows for the test results you want to compare.
  5. From the Actions on selected rows control, click Compare test step results.
    The system displays the Compare test result execution times bar graph.

Compare execution times for different runs of the same automated test suite

Compare how long it took the system to execute each test across different runs of the same test suite.

  1. Navigate to Automated Test Framework > Suites.
  2. Select the row for the test suite whose results you want to compare.
    The system displays the Test Suite record.
  3. Navigate to the Test Suite Results related list.
  4. Check the rows for the test suite results you want to compare.
  5. From the Actions on selected rows control, click Compare test results.
    The system displays the Compare test result execution times bar graph.

Compare results for automated test suite runs (aging report)

Compare how many tests passed versus failed across different runs of the same test suite.

  1. Navigate to Automated Test Framework > Suites.
  2. Select the row for the test suite whose results you want to compare.
    The system displays the Test Suite record.
  3. Under Related Links, click Display aging report.
    The system displays the Test suite aging report.