Suite Analysis

abstract Suite Analysis is designed to help quick fix of scripts causing most failures with a consolidated failure report. Historical results, for each scripts which are having at least one failure history, are also provided. This feature is available since Sahi Pro V8.0.0.

Click on Suite Analysis link on Suite Report and Script Report pages.

infoNote: If you are upgrading to Sahi Pro V8.0.0 please navigate to localhost:9999/_s_/dyn/pro/LoadOriginalSuitePath_loadData and wait for SUCCESS response inorder to generate report for old data as well. Use appropriate Sahi host and port.

Failure Report

For easy debugging the failures, Sahi provides a consolidated failure report with respect to scripts/testcases causing failure.

Step Message column gives the steps which are failed followed by the number of times it has failed.
Number of Steps Failed column gives the total number of steps failed for that specific script followed by number of times it has failed in the whole suite.
Failed Script Reports column contains the scripts which are failed. Clicking on the scripts takes you to the corresponding script report.

Failed Scripts History

The history of past run results for the failed scripts along with their pass percentage are showcased in this table. It helps to keep track of failed scripts.
The history tables are categorized into 2 as:

Within the same Suite: Script executed from the same suite is considered in this section.
Within Sahi: This section covers the history of script whenever it is executed irrespective of the suite from which it is executed.

info Latest Status column gives, the status of each script execution followed by number of times the script ran, separated by comma.
The sequence of status shown starts with the most recent execution.

Success Scripts With Failure History

Scripts which are passed in the current suite but having atleast one failure history are displayed here.

Alphabets S and F are used to represent SUCCESS and FAILURE scripts respectively.
If script is retried multiple times by setting Retry Count while playback, final status of the script followed by number of times the script ran will be shown.
Eg: If a script is retried 1 time after it fails in the first run, and if it is failed in the second run as well, it is denoted in the Failed Scripts History table as F2.

infoNote: Scripts which are in ABORTED and ERROR status is considered as FAILURE (F)

Maximum number of report status shown in the table can be configured by setting below property in sahi_pro/userdata/config/userdata.properties

sahi.count.script_status_to_be_shown=10

infoNote: Default value is 10. Can change it to any desired value