Reporting
All the execution reports for a project can be found on the executions page within the app’s website. These reports are sorted based on the most recent executions.
Executions run with multiple datasets are marked with a filled stacked disc icon at the beginning of the row, distinguishing them from the individual test executions.
Clicking on an execution’s name opens the associated report. If it is an execution run with multiple datasets, it opens the consolidated report, otherwise, it opens the single dataset report as shown below:
To download the execution report, simply click on the download icon located in the “Report” column.
Let’s delve into the details of both the execution type reports below.
Single Dataset report
The Single Dataset report that is generated contains the execution details such as Test Name, Result, Started At time, Dataset information, Environment details and more. It also includes details of each step - step name, input & output parameters, component name, step result, log messages and so on.
Displayed below is a sample report for such an execution:
For this report, Detailed and Summary report PDFs are available for download. Simply click the download button at the top right and choose the report of your choice.
Detailed Report PDF
The Detailed report PDF includes execution details such as Test Name, Result, Started At time, Dataset information, environment details and more. It also comprises detailed step information, encompassing step names, input and output parameters, log messages, and additional details.
Following is the link to the sample PDF.
Summary Report PDF
The summary report PDF contains execution details such as Test Name, Result, Started At time, Dataset information, environment details and more. It also contains the step wise summary of the test steps which includes the step name, component name, total duration and result.
Following is the link to the sample PDF.
Consolidated report for Multiple Datasets
The consolidated report that is generated for the test run with multiple datasets, provides a summarized result distribution chart along with execution details of each dataset. This report offers a comprehensive overview of the test’s performance across different datasets.
The following is a sample consolidated report for an execution:
The report contains a pie chart displaying the Passed/Failed/Cancelled/Not Run result distribution of the datasets executed. It also displays other execution details like Environment, Started At time, Total Duration, User email and so on. The consolidated summary report PDF can be downloaded by clicking on the download button besides the execution result at the top right.
Additionally, a table displays individual dataset execution details. By clicking on the dataset name, you can view the specific report for that dataset’s execution. For each dataset, both a summary and a detailed report are available to download via their respective download icons.
Consolidated Summary Report PDF
The summary report PDF contains the result distribution pie chart and information of the datasets and a step wise summary of each dataset executed. It offers the advantage of easy sharing via email or as an attachment, facilitating seamless collaboration and comprehensive test result discussions among team members.
Below is the sample PDF.