Module 47 - T204 Part 1 of 2

T204 Part 1 of 2: How to Develop Test Procedures for an ITS Standards-Based Test Plan

HTML of the PowerPoint Presentation

(Note: This document has been converted from a PowerPoint presentation to 508-compliant HTML. The formatting has been adjusted for 508 compliance, but all the original text content is included, plus additional text descriptions for the images, photos and/or diagrams have been provided below.)

 

Slide 1:

Welcome - Graphic image of introductory slide. Please see the Extended Text Description below.

(Extended Text Description: Welcome - Graphic image of introductory slide. A large dark blue rectangle with a wide, light grid pattern at the top half and bands of dark and lighter blue bands below. There is a white square ITS logo box with words "Standards ITS Training" in green and blue on the middle left side. The word "Welcome" in white is to the right of the logo. Under the logo box is the logo for the U.S. Department of Transpotation, Office of the Assistant Secretary for Research and Technology.)

 

Slide 2:

Welcome slide with Ken Leonard and screen capture of home webpage. Please see the Extended Text Description below.

(Extended Text Description: This slide, entitled "Welcome" has a photo of Ken Leonard, Director, ITS Joint Program Office, on the left hand side, with his email address, Ken.Leonard@dot.gov. A screen capture snapshot of the home webpage is found on the right hand side - for illustration only - from August 2014. Below this image is a link to the current website: www.pcb.its.dot.gov - this screen capture snapshot shows an example from the Office of the Assistant Secretary for Research and Development - Intelligent Transportation Systems Joint Program Office - ITS Professional Capacity Building Program/Advanced ITS Education. Below the main site banner, it shows the main navigation menu with the following items: About, ITS Training, Knowledge Exchange, Technology Transfer, ITS in Academics, and Media Library. Below the main navigation menu, the page shows various content of the website, including a graphic image of professionals seated in a room during a training program. A text overlay has the text Welcome to ITS Professional Capacity Building. Additional content on the page includes a box entitled What's New and a section labeled Free Training. Again, this image serves for illustration only. The current website link is: http://www.pcb.its.dot.gov.)

 

Slide 3:

Activity. A placeholder graphic with an image of hand over a computer keyboard to show that an activity is taking place.

 

Slide 4:

T204 Part 1 of 2:

How to Develop Test Procedures for an ITS Standards-Based Test Plan

 

Slide 5:

Instructor

Headshot photo of Dave Miller

Dave Miller,

Chair: NEMA / AASHTO / ITE

Joint Committee on ATC

Chair: 3TS Technical Committee

Principal Systems Engineer

Siemens Industry, Inc.

RC-US MO MM-ITS R&D

Austin, Texas, USA

 

Slide 6:

Target Audience

 

Slide 7:

Recommended Prerequisite(s)

 

Slide 8:

Curriculum Path

Curriculum Path: A graphical illustration indicating the sequence of training modules that lead up to and follow each course. Please see the Extended Text Description below.

(Extended Text Description: Curriculum Path: A graphical illustration indicating the sequence of training modules that lead up to and follow each course. Each modules is represented by a box with the name of the module in it and an arrow showing the logical flow of the modules and the current module highlighted. This slide focuses on the modules that lead up to the current course. The first box is labeled "T101 Introduction to ITS Standards Testing" followed by a line that connects to a box labeled "T201 How to Write a Test Plan" followed by a line that connects to a box labeled "T202 Overview of Test Design Specifications, Test Cases and Test Procedures," followed by a line that connects to a box labeled "T203 Part 1 of 2 How to Develop Test Cases for an ITS Standards-based Test Plan, Part 1 of 2," followed by a line that connects to a box labeled "T203 Part 2 of 2 How to Develop Test Cases for an ITS Standards-based Test Plan, Part 2 of 2." This box, in turn, connects to a box, colored purple to indicate that it represents this module, labeled "T204 Part 1 of 2 How to Develop Test Procedures for an ITS Standard-based Test Plan, Part 1 of 2.")

 

Slide 9:

abbrs and Terminology Used

A graphic illustration created for this slide that depicts the testing tasks within the overall system workflow. Please see the Extended Text Description below.

(Extended Text Description: abbrs and Terminology Used: A graphic illustration created for this slide that depicts the testing tasks within the overall system workflow. The topmost gray box labeled "Test Plan" includes an arrow from the lower side of that box directed downward to a second gray box labeled "Test Design Specification" that includes three arrows as follows: Arrow 1 from the left side of "Test Design Specification" is directed to the left then down to a gray box labeled "Test Case 1". Arrow 2 from the lower side of "Test Design Specification" is directed downward to a gray box labeled "Test Case 2". Arrow 3 from the right side of "Test Design Specification" is directed to the right then downward to a gray box labeled "Test Case 3". The gray box labeled "Test Case 1" includes an arrow from the lower side of that box directed downward to a gray box labeled "Test Procedure 1". The gray box labeled "Test Case 2" includes an arrow from the left side of that box directed to the left then downward to the gray box labeled "Test Procedure 1". The gray box labeled "Test Case 3" includes two arrows, one arrow from that box directed to the left and then downward, and then to the left to the gray box labeled "Test Procedure 2". The second arrow is directed downward from the lower side of "Test Case 3" to a gray box labeled "Test Procedure 3".)

See Student Supplement for Details

 

Slide 10:

Learning Objectives

Part 1 of 2

  1. Recognize the purpose and structure of a test procedure
  2. Identify the role of a Test Procedure Specification (TPS) within a test plan and the overall testing process
  3. Synchronize the test procedure specification to the contract terms and conditions for successful contract execution
  4. Write the reports produced at the end of testing and understand their relationship to successful procurement contracts
  5. Use tools to develop the test procedures for a sample TPS structure

Part 2 of 2

  1. Use the Test Plan Generator (TPG) to generate test procedures for a variety of equipment
  2. Adapt the generated test procedures to procurement contract terms and conditions for successful project conclusion
  3. Develop complex test procedures that pull together NTCIP elements using the TPG

 

Slide 11:

Learning Objective #1: Recognize the Purpose and Structure of a Test Procedure Specification

 

Slide 12:

Definitions

Three graphic illustrations created for this module, positioned vertically above one another located at the right side of the slide. Please see the Extended Text Description below.

(Extended Text Description: Definitions: Three graphic illustrations created for this module, positioned vertically above one another located at the right side of the slide. The topmost graphic illustration depicts a white box containing the text "Test Procedure". A light blue arrow containing the text "Inputs are Test Cases" is directed towards and touches the left side of "Test Procedure" box. A second light blue arrow containing the text "Outputs are Test Results" touches the right side of "Test Procedure" box, directed towards the right. The middle graphic illustration depicts a white box with light blue border containing the green text "Test Procedure Specification TPS". The lower graphic illustration contains a depiction of a gray "Device Under Test (DUT)" box and two gray laptop computers labeled "Test Software" and "Data Analyzer". A white depiction of a cloud labeled "Communications" is positioned below "Device Under Test (DUT)", above "Test Software" and to the left of "Data Analyzer". )

 

Slide 13:

Learning Objective #1

Purpose and Structure of a Test Procedure

Purpose of Test Procedure

 

Slide 14:

Learning Objective #1

What does IEEE Std 829 Provide?

What does IEEE Std 829 Provide? A screen shot of the cover of IEEE 829 standard inserted to the right of the text

 

Slide 15:

Learning Objective #1

Purpose and Structure of a Test Procedure (cont.)

Structure of a Test Procedure (IEEE Standard 829)

1. Introduction

2. Details

3. General

 

Slide 16:

Learning Objective #1

Purpose and Structure of a Test Procedure (cont.)

Related Details

Purpose and structure of a Test Procedure (cont.): A white text box with light blue border containing the green text Test Procedure Specification (TPS). Please see the Extended Text Description below.

 

Slide 17:

Learning Objective #1

Where does TPS Fit in Documentation Structure?

Where does TPS Fit in Documentation Structure? Please see the Extended Text Description below.

(Extended Text Description: Where does TPS Fit in Documentation Structure? Author's relevant notes: A light blue arrow directed from the right of a white text box with light blue border containing the green text "Test Procedure Specification (TPS)". To the right of that light blue arrow is located a graphic recreated from "PCB Module-IEEE 829-1998" that depicts the six steps to execute a test: 1) Topmost "Master Test Plan", below that, "Test Design Specification", below that, "Test Case Specification", below that, "Test Procedure Specification", below that, "Test Execution" and below that, "Test Reports". Within each of these steps is depicted one or more labeled boxes showing the workflow recreated from IEEE 829-1998 without alteration in this graphic.)

Source: PCB Module-IEEE 829-1998

 

Slide 18:

Learning Objective #1

Inputs and Expected Outputs

A Test Procedure is Conducted on Test Inputs to Produce Test Outputs

Inputs and Expected Outputs. Please see the Extended Text Description below.

(Extended Text Description: Inputs and Expected Outputs: A light blue arrow "Inputs are Test Cases" located at the center-left of the slide, directed towards the left edge of white box "Test Procedures with Expected Outputs". A light blue arrow "Outputs are Test Results" directed from the left side of "Test Procedures with Expected Outputs" to the left edge of light brown "Test Results:" box, which contains the text, Test Logs, Test Summaries, Discrepancy Reports-documents unexpected outputs, and The deliverables are formatted per IEEE 829. Light blue "Output Categories" box is located below "Test Results" box, which contains the text, Expected outputs ("PASS"), Unexpected outputs (requires further investigation).)

 

Slide 19:

Learning Objective #1

Role of Test Procedures

Role of Test Procedures. Please see the Extended Text Description below.

(Extended Text Description: Role of Test Procedures: Light blue "ITS Project Functional Features-Capabilities" box, with "ITS Project Functional Features-Capabilities" highlighted in yellow, located along the right side of the slide. Four colored text boxes are located within "ITS Project Functional Features-Capabilities" box. Light blue "Test Case" box is located at the upper left within "ITS Project Functional Features-Capabilities". Red "Test Procedures" box is located at the upper right within "ITS Project Functional Features-Capabilities". Green "User Needs" box is located at the lower right within "ITS Project Functional Features-Capabilities". Dark blue "Requirements" box is located at the lower right within "ITS Project Functional Features-Capabilities". Four arrows are also located within "ITS Project Functional Features-Capabilities". A red arrow is located to the right of "Test Procedure" directed towards "Test Cases". A second red arrow is located below "Test Cases" directed towards "Requirements". A third red arrow is located to the right of "Requirements" directed towards "Use Needs". A green arrow is located below "Test Procedures" directed towards "User Needs".)

 

Slide 20:

Learning Objective #1

Role of Test Procedures (cont.)

Test Procedure Insures the System is Built Correctly as Expected by the User

Did we build the system as intended by a project specification?

-users, owners, developers, vendors

Role of Test Procedures (cont.). Please see the Extended Text Description below.

(Extended Text Description: Role of Test Procedures (cont.): Reproduction of a portion of the VEE model graphic taken from Systems Engineering for Intelligent Transportation Systems, USDOT, January 2007. Graphic depicts three levels of the right side of the VEE which are 1) System Validation level, 2) System Verification & Deployment level and 3) Subsystem Verification level. A red arrow points to the word "Deployment", which is highlighted in red.)

Source: FHWA

 

Slide 21:

Learning Objective #1

Special Needs from a Test Procedure Standpoint

Special Needs from a Test Procedure Standpoint. Please see the Extended Text Description below.

(Extended Text Description: Special Needs from a Test Procedure Standpoint: White box with light blue outline containing the text "Test procedure" centered on the left of the slide. A light blue, double-ended arrow projecting +45 degrees and located between the "Test Procedure" box and the text to the upper right. The box to the upper right contains the text, Special Needs Outside of the Standards - Special security measures, Special access rights (permission) to data bases, Documentation control for archiving deliverables, Configuration management to reproduce the same results, Records of any automated test tools, Special skill sets required of test operators. A second light blue, double-ended arrow projecting -45 degrees and located between the "Test Procedure" box and the text to the lower right, which contains the text, Special contract provisions (if any): Special needs do not show up for the first time in the TPS, Special Needs of contracts move through TDS and TCS.)

 

Slide 22:

Learning Objective #1

IEEE 829 Level Test Procedure Steps

LEVEL TEST PROCEDURE # ID
LOG: Logging tools and methods
  List ...
SETUP: Sequence of actions to prepare for testing
  List ...
START: Actions to begin test execution
  List ...
MEASUREMENT: Describe how measurements are to be made
  List ...
SHUT DOWN: Actions to suspend testing for unscheduled events
  List ...
RESTART: Procedure to restart testing from shutdown
  List ...
STOP: Procedure for orderly halt to testing
  List ...
WRAP UP: Actions after execution has been completed
  List ...
CONTINGENCIES: Actions necessary to deal with anomolies
  List ...

 

Slide 23:

Activity. A placeholder graphic with an image of hand over a computer keyboard to show that an activity is taking place.

 

 

Slide 24:

Learning Objective #1

Which of the following is a FALSE statement?

Answer Choices

  1. ITS standards define objects and dialogs to be tested
  2. ITS standards provide format and steps for test procedures
  3. Test procedures can merge with test cases
  4. Test cases trace to requirements

 

Slide 25:

Learning Objective #1

Review of Answers

A small graphical red and yellow X representing incorrect.a) ITS standards define objects and dialogs to be tested
Incorrect. Objects defined in the ITS standards. The most recent version of several NTCIP standards include dialogs

A small graphical green and yellow check mark representing correct.b) ITS standards provide format and steps for test procedures
Correct! ITS standards do not provide formats and steps for TPS, ONLY IEEE 829 does.

A small graphical red and yellow X representing incorrect.c) Test procedures can merge with test cases
Incorrect. Std 829 links test cases as inputs to a test procedure.

A small graphical red and yellow X representing incorrect.d) Test cases trace to requirements
Incorrect. A test cases traces to requirements.

 

Slide 26:

Summary of Learning Objective #1

Recognize the Purpose and Structure of a Test Procedure

 

Slide 27:

Learning Objective #2: Identify the Role of a Test Procedure Specification Within a Test Plan and the Overall Testing Process

 

Slide 28:

Learning Objective #2

Brief Review of Test Design Specification (TDS)

TDS Details What a Test is to Demonstrate

 

Slide 29:

Learning Objective #2

Example of TDS

TDS Outlines Requirements to Be Tested

NTCIP 1203 Protocol Requirements List (PRL)

USER NEED SECTION NUMBER USER NEED FR SECTION NUMBER FUNCTIONAL REQUIREMENT CONFORMANCE SUPPORT/PROJECT REQUIREMENT ADDITIONAL PROJECT REQUIREMENTS
2.3.2.3 DMS Display Matrix Configuration M Yes The DMS shall be 9,000 millimeters wide (0 .65535) and 2,700 millimeters high (0. .65535), inclusive of borders.

The Sign's Border shall be at least 400 millimeters wide (0 .65535) and 400 millimeters high (0..65535).
2.3.2.3.1 Non-Matrix 0.2 (1) Yes/[No]  
2.3.2.3.2 (Matrix) Matrix 0.2(1) [Yes]/No The pitch between pixels shall be at least 66 millimeters (0..255).
2.3.2.3.2.1 Full Matrix 0.3 (1) Yes/[No] The sign shall be ____ pixels wide (0..65535) and ____ pixels high (0..65535).
2.3.2.3.2.2 Line Matrix 0.3 (1) Yes/[No] The siqn shall have ____ lines with each line being ____ pixels wide and ____ pixels high.
2.3.2.3.2.3 Character Matrix 0.3 (1) [Yes]/No The sign shall be 18 characters wide and 3 characters high with each character being 5 pixels wide (0. 255), 7 pixels high (0..255).

Source: NTCIP 1203 DMS

 

Slide 30:

Learning Objective #2

Brief Review of Test Case Specification (TCS)

TCS Specifies Conditions and Sequence of Verification

 

Slide 31:

Learning Objective #2

Brief Review of TCS (continued)

TCS Specifies Purpose of Verification

 

Slide 32:

Learning Objective #2

Role of TPS within Test Plan & Testing Process

TPS Defines the Steps to Perform the Test

 

Slide 33:

Learning Objective #2

Role of TPS within Test Plan & Testing Process

Requirements to Test Case Matrix (RTCM) : Example from NTCIP 1204 ESS v03, C.2.2

ANNEX C TEST PROCEDURES [NORMATIVE] - 152

C.1 Purpose - 152

C.1.1 Scope - 152

C.1.2 Keywords - 152

C.1.3 Rules for Following Test Procedures - 153

C.2 Testing Requirements - 153

C.2.1 Field Device Test Environment - 153

C.2.2 Traceability Table - 153

C.2.3 Test Procedures - 161

Table 30 Requirements to Test Case Traceability Table

Requirement Test Case
ID Title ID Title
3,5 Data Exchange Requirements
3.5.1 ESS Manager Requirements
3.5.1.1 ESS Configuration Requirements
3.5.1.1.1 Retrieve ESS Characteristics
    C.2.3.1.1 ESS Characteristics

Source: NTCIP 1204 ESS v03

 

Slide 34:

Learning Objective #2

Role of TPS within Test Plan & Testing Process

Test Workflow: Continued from Module T202

Test Workflow: Identical graphic described in Slide 9, located to the right of the slide text.

 

Slide 35:

Activity. A placeholder graphic with an image of hand over a computer keyboard to show that an activity is taking place.

 

Slide 36:

Learning Objective #2

In addition to inputs, outputs, and execution conditions, test case specification includes:

Answer Choices

  1. Test objective to provide guidance to the test operator
  2. Test environment hardware and software
  3. Special procedures, such as automated tools
  4. All of the above

 

Slide 37:

Learning Objective #2

Review of Answers

A small graphical red and yellow X representing incorrect.a) Test objective to provide guidance to the test operator
All are true.

A small graphical red and yellow X representing incorrect.b) Test environment hardware and software
All are true.

A small graphical red and yellow X representing incorrect.c) Special procedures, such as automated tools
All are true.

A small graphical green and yellow check mark representing correct.d) All of the above
Correct! All are true.

 

Slide 38:

Summary of Learning Objective #2

Role of Test Procedure Specification within a Test Plan and Overall Testing Process

 

Slide 39:

Learning Objective #3: Synchronize the Test Procedure Specification to the Contract Terms and Conditions for Successful Contract Execution

 

Slide 40:

Learning Objective #3

ITS Projects Background (cont.)

Pie chart graphic. Please see the Extended Text Description below.

(Extended Text Description: Figure 6: Pie chart graphic reproduced from FHWA Systems Engineering Handbook, 2007, located in the upper right of the slide. The pie chart indicates 24% Succeeded, 15% Failed and 51% Challenged.)

Source: FHWA SE Handbook, 2007 See student supplement for reference

 

Slide 41:

Learning Objective #3

Synchronizing the TPS to the Contract Terms and Conditions

Start the Project with an Eye on the Finish Line

 

Slide 42:

Learning Objective #3

Synchronizing the TPS to the Contract Terms and Conditions (cont.)

 

Slide 43:

Learning Objective #3

Synchronizing the TPS to the Contract Terms and Conditions (cont.)

Synchronizing the TPS to the Contract Terms and Conditions. Please see the Extended Text Description below.

(Extended Text Description: Author's relevant notes: VEE model graphic reproduced from FHWA Systems Engineering Handbook, 2007, located to the right of the slide text. Above the V to the left, pointing to the left side of the V, is the text "Write Terms and Conditions here..." Above the V to the right, pointing to the right side of the V, is the text "as if you are here." The point of the graphic image is to convey the idea to synchronize the TPS to the contract trems and conditions.)

 

Slide 44:

Learning Objective #3

Synchronizing the TPS to the Contract Terms and Conditions (cont.)

Additional Concerns to be Aware Of

 

Slide 45:

Activity. A placeholder graphic with an image of hand over a computer keyboard to show that an activity is taking place.

 

Slide 46:

Learning Objective #3

The TPS should be synchronized to the contract terms and conditions...

Answer Choices

  1. Project ending without unexpected issues
  2. Minimizing the project planning costs and time
  3. Replicating the wording of a similar prior project
  4. Enforcement after the project is late and over budget

 

Slide 47:

Learning Objective #3

Review of Answers

A small graphical green and yellow check mark representing correct.a) Project ending without unexpected issues
Correct! Contract terms including the tests allow the suppliers to test deliverables throughout the project, eliminating unexpected results.

A small graphical red and yellow X representing incorrect.b) Minimizing the project planning costs and time
Incorrect. Studies of IT project show that investing 15% or more of the total project cost in planning will save more than15% in cost overruns.

A small graphical red and yellow X representing incorrect.c) Replicating the wording of a similar prior project
Incorrect. Replication of "boilerplate" acceptance wording does not provide clear acceptance criteria for differing equipment and software.

A small graphical red and yellow X representing incorrect.d) Enforcement after the project is late and over budget
Incorrect. Enforcing design changes for unexpected results is more expensive than planning the final acceptance before the project begins.

 

Slide 48:

Summary of Learning Objective #3

Synchronize the TPS to the Contract Terms and Conditions for Successful Contract Execution

 

Slide 49:

Learning Objective #4: Write the Reports Produced at the End of the Testing and Understand Their Relationship to Successful Procurement Contracts

 

Slide 50:

Learning Objective #4

Reports Produced at the End of Testing and Their Relationship to Successful Procurement

Logs, Including the Data, Information, Files and Fulfilled Requirements That are Captured During the Test

 

Slide 51:

Learning Objective #4

Reports Produced at the End of Testing and Their Relationship to Successful Procurement

Workflow: Test Procedure Outputs

Workflow: Test Procedure. Please see the Extended Text Description below.

(Extended Text Description: Workflow: Test Procedure Outputs: Graphic identical to Slide 9 "abbrs" with another row of four green boxes located below labeled "Output Records 1", "Output Records 2", "Output Records 3" and "Output Records 4" respectively from left to right. An arrow extends from the bottom of "Test Procedure 1" to the top of "Output Records 1" and "Output Records 2" boxes. A second arrow extends from the bottom of "Test Procedure 2" to the top of "Output Records 3" box. A third arrow extends from the bottom of "Test Procedure 3" to the top of "Output Records 4".)

 

Slide 52:

Learning Objective #4

Reports Produced at the End of Testing and Their Relationship to Successful Procurement

Anomaly Report, Including a Failure Description and the Investigation Process

 

Slide 53:

Learning Objective #4

Anomaly Report: IEEE Standard 829 Format

1. Introduction

1.1. Document identifier

1.2. Scope

1.3. References

2. Details

2.1. Summary

2.2. Date anomaly discovered

2.3. Context

2.4. Description of anomaly

2.5. Impact

2 6 Originator's assessment of urgency (see EEEE 1044-1993 [B13])

2.7. Description of the corrective action

2.8. Staros of the anomaly

2.9. Conclusions and recommendations

3. General

3.1 Document change procedures and history

 

Slide 54:

Learning Objective #4

Anomaly Report: IEEE Standard 829 Format

 

Slide 55:

Learning Objective #4

Anomaly Report: IEEE Standard 829 Format

 

Slide 56:

Learning Objective #4

Level Test Reports Produced at the End of Testing

Level Test Report, Providing a Measure of Success Compared to the Stated Goals and Scope of the Test

Plan

 

Slide 57:

Learning Objective #4

Level Test Report: IEEE Standard 829 Format

 

1. Introduction

1.1. Docunient identifier

1.2. Scope

1.3. Reference?

2. Details

2.1. Overview of test re suits

2.2. Detailed test results

2.3. Rationale for decisions

2.4. Conclusions and recommendations

3. General

3.1. Glossary

3.2. Document change procedures and history

 

Slide 58:

Learning Objective #4

Example of a Level Test Report

 

Slide 59:

Learning Objective #4

Master Test Report Produced at the End of Testing

 

1. Introduction

1.1. Document identifier

1.2. Scope

1.3. References

2. Details of the Master Test Report

2.1. Overview of all asgresate test results

2.2. Rationale for decisions

2.3. Conclusions and recommendations

3. General

3.1. Glossary

3.2. Document change procedures and history

 

Slide 60:

Activity. A placeholder graphic with an image of hand over a computer keyboard to show that an activity is taking place.

 

Slide 61:

Learning Objective #4

Which of the following statements is FALSE?

Answer Choices

  1. Only one test case used as input to each test procedure
  2. A test procedure can use multiple test cases as inputs

 

Slide 62:

Learning Objective #4

Review of Answers

A small graphical green and yellow check mark representing correct.a) Only one test case used as input to each test procedure
Correct! This statement is false. Test cases that are independent of each other will likely be the single input to a test procedure. However, several dependent test cases are often used as multiple Inputs to one test procedure.

A small graphical red and yellow X representing incorrect.b) A test procedure can use multiple test cases as inputs
Incorrect. This statement is true. Test cases that require similar equipment with related functions can be tested with one procedure.

 

Slide 63:

Summary of Learning Objective #4

Reports Produced at the End of Testing and Their Relationship to Successful Procurement

 

Slide 64:

Learning Objective #5: Using the Test Procedure Generator (TPG) to Develop the Test Procedures for a Sample TPS Structure

 

Slide 65:

Learning Objective #5

Using a Tool to Develop the Test Procedures

Test Procedure Generator (TPG) for a Sample TPS Structure

 

Slide 66:

Learning Objective #5

Using TPG to Develop the Test Procedures

Test Procedure Generator (TPG)

 

Slide 67:

Learning Objective #5

Using a Tool to Develop the Test Procedures

Test Procedure Generator (TPG)

Test Procedure Generator: Screenshot. Please see the Extended Text Description below.

(Extended Text Description: Test Procedure Generator: Screenshot taken from TPG "Installation Wizard" located in the lower left of the slide. Author's key notes: A copy of the TPG can be obtained as a no-cost download. A copy of the TPG must be initiated with a request that identifies the requestor for records, such as notification of updates, etc. The request is acknowledged with a link to download the TPG, installation instructions and operations manual.)

 

Slide 68:

Learning Objective #5

How to Use TPG (cont.)

Opening a New TPG Session

Opening a New TPG Session. Please see the Extended Text Description below.

(Extended Text Description: Opening a New TPG Session: Screenshot taken from TPG "New Session" occupying the entire slide. Author's key notes for illustration purposes: This slide shows the dialog box and screen when opening a new session.)

 

Slide 69:

Learning Objective #5

How to Use TPG (cont.)

Opening a Standard

Extracting the Table of Contents data. Please see the Extended Text Description below.

(Extended Text Description: Extracting the Table of Contents data: Screenshot taken from TPG occupying the entire slide. Author's key notes for illustration purposes: This slide shows the dialog box and screen when opening a standard, which then shows the commands being executed in the progress window, such as Extracting the Table of Contents data and other related processes.)

 

Slide 70:

Learning Objective #5

How to Use TPG (cont.)

Create a New set of Test Procedures

New Set of Test Procedures. Please see the Extended Text Description below.

(Extended Text Description: New Set of Test Procedures: Screenshot taken from TPG occupying the entire slide. Author's key notes for illustration purposes: This slide shows the dialog box, menu and screen when creating a new set of Test Procedures. The user can select the File menu, then select New Set of Test Procedures to begin the process.)

 

Slide 71:

Learning Objective #5

How to Use TPG (cont.)

Test Procedure 01.00

Test Procedure 01.00. Please see the Extended Text Description below.

(Extended Text Description: Test Procedure 01.00: Screenshot taken from TPG occupying the entire slide. Author's key notes for illustration purposes: This slide shows the windows and screen when the screen displays Test Procedure 01.00. The Current Test Procedure tab is selected, indicating the current document.)

 

Slide 72:

Learning Objective #5

How to Use TPG (cont.)

Define the Test Procedure Header

Define Test Procedure Header. Please see the Extended Text Description below.

(Extended Text Description: Define Test Procedure Header: Screenshot taken from TPG occupying the entire slide. Author's key notes for illustration purposes: This slide shows the menu and screen when Define Test Procedure Header is selected from the Test Procedure menu. The Current Test Procedure tab is selected, indicating the current document.)

 

Slide 73:

Learning Objective #5

How to Use TPG (cont.)

Test Procedure Header Window Defined

Test Procedure 01.00. Please see the Extended Text Description below.

(Extended Text Description: Test Procedure 01.00: Screenshot taken from TPG occupying the entire slide. Author's key notes for illustration purposes: This slide shows the header window and screen after the definition of Test Procedure. In this case, the Test Procedure is titled Determine Sign Type and Technology. The Current Test Procedure tab is selected, indicating the current document.)

 

Slide 74:

Learning Objective #5

How to Use TPG (cont.)

Select a Requirement

Select Requirements. Please see the Extended Text Description below.

(Extended Text Description: Select Requirements: Screenshot taken from TPG occupying the entire slide. Author's key notes for illustration purposes: This slide shows the menu and screen when the user selects the Test Procedure menu, then selects the option for Select Requirements. The Current Test Procedure tab is selected, indicating the current document.)

 

Slide 75:

Learning Objective #5

How to Use TPG (cont.)

Select a Requirement From Window

Configure Logging Service. Please see the Extended Text Description below.

(Extended Text Description: Configure Logging Service: Screenshot taken from TPG occupying the entire slide. Author's key notes for illustration purposes: This slide shows the dialog box and screen when the user Selects Requirements, in this case 3.4.2.2 Configure Logging Service. The Current Test Procedure tab is selected, indicating the current document.)

 

Slide 76:

Learning Objective #5

How to Use TPG (cont.)

Requirements Populated

Test Procedure 01.00. Please see the Extended Text Description below.

(Extended Text Description: Test Procedure 01.00: Screenshot taken from TPG occupying the entire slide. Author's key notes for illustration purposes: This slide shows the screen when Requirements are then populated, in this case, 3.4.1.1 through 3.4.2.2, for example. The Current Test Procedure tab is selected, indicating the current document.)

 

Slide 77:

Learning Objective #5

How to Use TPG (cont.)

Define Variables

Define Variables. Please see the Extended Text Description below.

(Extended Text Description: Define Variables: Screenshot taken from TPG occupying the entire slide. Author's key notes for illustration purposes: This slide shows the menu and screen when the user selects Test Procedure, then selects Define variables in the menus. The Current Test Procedure tab is selected, indicating the current document.)

 

Slide 78:

Learning Objective #5

How to Use TPG (cont.)

Saving a Test Procedure

Save Test Procedure. Please see the Extended Text Description below.

(Extended Text Description: Save Test Procedure: Screenshot taken from TPG occupying the entire slide. Author's key notes for illustration purposes: This slide shows the menu and screen after completion, the Test Procedure is saved. The user selects Test Procedure in the menu, then selects Save Test Procedure to save the information.)

 

Slide 79:

Learning Objective #5

How to Use TPG (cont.)

Closing a Test Procedure

Close Test Procedure. Please see the Extended Text Description below.

(Extended Text Description: Close Test Procedure: Screenshot taken from TPG occupying the entire slide. Author's key notes for illustration purposes: This slide shows the menu and screen after Close Test Procedure is selected from the Test Procedure Menu, the procedure is being saved and the Test Procedure is closed.)

 

Slide 80:

Learning Objective #5

How to Use TPG (cont.)

Save XML Set of Test Procedures

Save XML Set of Test Procedures. Please see the Extended Text Description below.

(Extended Text Description: Save XML Set of Test Procedures: Screenshot taken from TPG occupying the entire slide. Author's key notes for illustration purposes: This slide shows the menu and screen when the user selects File then Save XML Set of Test Procedures from the menu, allowing sets of Test Procedures to be saved as a set of XML.)

 

Slide 81:

Learning Objective #5

How to Use TPG (cont.)

XML Representation

XML Report. Please see the Extended Text Description below.

(Extended Text Description: XML Report: Screenshot taken from TPG occupying the entire slide. Author's key notes for illustration purposes: This slide shows the screen with the XML Representation of the example, in this case NTCIP C2F Device Interface Standard. The Reports tab is selected indicating the current XML representation.)

 

Slide 82:

Learning Objective #5

How to Use TPG (cont.)

Other TPG Functionality

 

Slide 83:

Learning Objective #5

Understanding Pre and Postcondition and Different Types of Steps

 

Slide 84:

Activity. A placeholder graphic with an image of hand over a computer keyboard to show that an activity is taking place.

 

Slide 85:

Learning Objective #5

Which statement is TRUE? The TPG...

Answer Choices

  1. Takes test cases directly as inputs
  2. Guides test procedures having MIBs, Dialogs, and RTM
  3. Creates outputs in commonly understood XLS files
  4. Executes test procedures automatically

 

Slide 86:

Learning Objective #5

Review of Answers

A small graphical red and yellow X representing incorrect.a) Takes test cases directly as inputs
Incorrect. The TPG does not read in test cases. It pulls information from various sections of the standard and reads non-TPG created test procedures.

A small graphical green and yellow check mark representing correct.b) Guides test procedures having MIBs, Dialogs and RTM
Correct! The TPG is used to develop test procedure with uniform key words, dialogs and requirements traceability matrix to eliminate manual entry errors and to enable test procedures to be reused.

A small graphical red and yellow X representing incorrect.c) Creates outputs in commonly-understood XLS files
Incorrect. The TPG creates outputs in commonly-understood XML scripts.

A small graphical red and yellow X representing incorrect.d) Executes test procedures automatically
Incorrect. The TPG does not execute test procedures. TPG XML scripts can be used as inputs to automated test equipment.

 

Slide 87:

Summary of Learning Objective #5

How to Use Tools to Develop the Test Procedures for a Sample TSP Structure

 

Slide 88:

What We Have Learned in Part 1

  1. Test Procedure Specification (TSP) inputs are test cases used to create outputs of expected results and anomaly reports of unexpected results in IEEE 829 standard format.
  2. A test design specification details what a test is to demonstrate, a test case specification is a specific example that assigns values, while a test procedure defines the steps to perform the test.
  3. Contract Terms and Conditions should be viewed from the project's end, including test case specifications and test procedures.
  4. A master test report measures project success to stated goals.
  5. Test Procedure Generator (TPG) is an automated tool that generates XML scripts using consistent key words for interoperability.

 

Slide 89:

Resources

 

Slide 90:

Next Course Module

Module T204 Part 2 of 2:

How to Develop Test Procedures for ITS Standards-based Test Plan

Part 2 of 2

(We will cover Learning Objectives 6, 7, and 8)

 

Slide 91:

Next Course Module

Homework between T204 Part 1 and T204 Part 2

 

Slide 92:

Questions? A placeholder graphic image with word Questions? at the top, and an image of a lit light bulb on the lower right side.