Module 47 - T204 Part 1 of 2
T204 Part 1 of 2: How to Develop Test Procedures for an ITS Standards-Based Test Plan
HTML of the Student Supplement
(Note: This document has been converted from the Student Supplement to 508-compliant HTML. The formatting has been adjusted for 508 compliance, but all the original text content is included, plus additional text descriptions for the images, photos and/or diagrams have been provided below.)
T204 Part 1 of 2: How to Develop Test Procedures for an ITS Standards-Based Test Plan, Part 1 of 2
Table of Contents
This module is part of the non-SE path; thus, students must learn How to Write a Test Plan (T201); followed by an Overview of Test Design Specifications, Test Cases, and Test Procedures (T202); and then How to Develop Test Cases for ITS Standards-Based Test Plans (T203 Parts 1 and 2). This module extends this discussion by providing participants with detailed information on how to prepare their own test procedure specifications, including using the test cases, creating test logs, test summaries, and anomaly reports. This module ends with an overview of the Test Procedure Generator (TPG), which is an automated tool available at no cost from the U.S. Department of Transportation (USDOT) that students may download try before Part 2 of this module, which will provide examples of how to perform tests.
The purpose of this module is to teach the student how to develop a Test Procedure Specification (TPS) and show them how said document fits into the testing process and relates to the test plan, test design specification, and test case specification. In addition, the student will be taught how to develop the TPS to meet specific project requirements for the interface (as found in the Protocol Requirements List (PRL)) or Needs to Requirements Traceability Matrix (NRTM).
2.1. Understand the purpose and structure of a test procedure
2.2. Understand the role of Test Procedure Specification within a test plan and the overall testing process
(Extended Text Description: A graphic illustration created for this slide that depicts the testing tasks within the overall system workflow. The topmost gray box labeled "Test Plan" includes an arrow from the lower side of that box directed downward to a second gray box labeled "Test Design Specification" that includes three arrows as follows: Arrow 1 from the left side of "Test Design Specification" is directed to the left then down to a gray box labeled "Test Case 1". Arrow 2 from the lower side of "Test Design Specification" is directed downward to a gray box labeled "Test Case 2". Arrow 3 from the right side of "Test Design Specification" is directed to the right then downward to a gray box labeled "Test Case 3". The gray box labeled "Test Case 1" includes an arrow from the lower side of that box directed downward to a gray box labeled "Test Procedure 1". The gray box labeled "Test Case 2" includes an arrow from the left side of that box directed to the left then downward to the gray box labeled "Test Procedure 1". The gray box labeled "Test Case 3" includes two arrows, one arrow from that box directed to the left and then downward, and then to the left to the gray box labeled "Test Procedure 2". The second arrow is directed downward from the lower side of "Test Case 3" to a gray box labeled "Test Procedure 3".)
2.3. Synchronize the test procedure specification to the contract Terms and Conditions (T&Cs) for successful contract execution
(Extended Text Description: Odds of Success: Pie chart graphic reproduced from FHWA Systems Engineering Handbook, 2007. The pie chart indicates 24% Succeeded, 15% Failed and 51% Challenged.)
(Extended Text Description: Author's relevant notes: VEE model graphic reproduced from FHWA Systems Engineering Handbook, 2007, located to the right of the slide text. Above the V to the left, pointing to the left side of the V, is the text "Write Terms and Conditions here..." Above the V to the right, pointing to the right side of the V, is the text "as if you are here." The point of the graphic image is to convey the idea to synchronize the TPS to the contract trems and conditions.)
2.4.Write the reports produced at the end of testing and understand their relationship to successful Procurement Contracts
(Extended Text Description: Master Test Report: Graphic identical to graphic shown in 2.2.3 above, with another row of four green boxes located below labeled "Output Records 1", "Output Records 2", "Output Records 3" and "Output Records 4" respectively from left to right. An arrow extends from the bottom of "Test Procedure 1" to the top of "Output Records 1" and "Output Records 2" boxes. A second arrow extends from the bottom of "Test Procedure 2" to the top of "Output Records 3" box. A third arrow extends from the bottom of "Test Procedure 3" to the top of "Output Records 4".)
2.5. Use tools to develop the Test Procedures for a sample TPS structure
(Extended Text Description: Test Procedure 01.00: Screenshot taken from TPG. Author's key notes for illustration purposes: This image shows the screen when Requirements are then populated, in this case, 126.96.36.199 through 188.8.131.52, for example. The Current Test Procedure tab is selected, indicating the current document.)
(Extended Text Description: XML Report: Screenshot taken from TPG. Author's key notes for illustration purposes: This image shows the screen with the XML Representation of the example, in this case NTCIP C2F Device Interface Standard. The Reports tab is selected indicating the current XML representation.)
2.6. Preparing for T204 Part 2
Between T204 Part 1 and T204 Part 2, please become familiar with the installation and operation of the TPG. T204 Part 2 will use the TPG to develop Test Procedures for different equipment types using the NTCIP standards. Please resolve all TPG installation and operation issues before the start of Part 2, as we will begin immediately with the course work using the TPG as the tool.
3. Reference to Other Standards
6. Study Questions
1. Which of the following is a FALSE statement?
2. In addition to inputs, outputs, and execution conditions, test case specification includes:
3. The TPS should be synchronized to the contract terms and conditions...
4. Which of the following statements is FALSE?
5. Which statement is TRUE? The TPG...