Artifact: Test Results
This artifact summarizes the analysis of one or more Test Logs and Change Requests, providing a relatively detailed assessment of the quality of the Target Test Items and the status of the test effort.
Domains: Test
Work Product Kinds: Project Data
  • To record the detailed findings of the test effort, and
  • To subsequently calculate the different key measures of testing.
Main DescriptionTest Results are sometimes a large set of many Test Results.
Brief Outline

The information (as opposed to raw data) contained by the Test Results may vary depending on the technology and tools used both during test execution to capture the test log, and after the fact to conduct analysis of the raw Test Log data.  Here are some ideas for data that can be determined, and made available for review and evaluation:

  • Test Results identifier (ID for identifying these Test Results from others)
  • time, date, name of tester, and environment information (such as O/S, machine characteristics, and so forth)
  • specific identification of the Target Test Items (such as version, objects, and files)
  • Test Cases intended to be executed (and traced to the requirements for test) 
  • Test Cases executed (and traced to the requirements for test)
  • size measurement of Target Test Items to be executed
  • size measurement of Target Test Items executed
  • response time for specified sequences of events
  • trace data containing the details of the conversations between actors and the Target Test Items, and/or between objects in the Target Test Items.
  • actual result of each Test Case executed
  • differences between expected result and actual result
  • an indication of pass or fail for each Test Case executed
  • actual level of completeness and positive results from each Test Suite executed
  • any unexpected or abnormal results or behaviors
Representation Options

If you are using automated test tools, such as those found in Rational Suite or Test Studio, a lot of the determination of the above information can be simplified by the analysis capabilities of the tools. The tools also offer saved and customizable views of the information for reporting purposes.

Sometimes the test results are referenced from or enclosed directly within a Test Evaluation Summary

More Information