Module 48 - T204 Part 2 of 2

T204 Part 2 of 2: How to Develop Test Procedures for an ITS Standards-Based Test Plan

HTML of the PowerPoint Presentation

(Note: This document has been converted from a PowerPoint presentation to 508-compliant HTML. The formatting has been adjusted for 508 compliance, but all the original text content is included, plus additional text descriptions for the images, photos and/or diagrams have been provided below.)

 

Slide 1:

Welcome - Graphic image of introductory slide. Please see the Extended Text Description below.

(Extended Text Description: Welcome - Graphic image of introductory slide. A large dark blue rectangle with a wide, light grid pattern at the top half and bands of dark and lighter blue bands below. There is a white square ITS logo box with words "Standards ITS Training" in green and blue on the middle left side. The word "Welcome" in white is to the right of the logo. Under the logo box is the logo for the U.S. Department of Transpotation, Office of the Assistant Secretary for Research and Technology.)

 

Slide 2:

Welcome slide with Ken Leonard. Please see the Extended Text Description below.

(Extended Text Description: This slide, entitled "Welcome" has a photo of Ken Leonard, Director, ITS Joint Program Office, on the left hand side, with his email address, Ken.Leonard@dot.gov. A screen capture snapshot of the home webpage is found on the right hand side - for illustration only - from August 2014. Below this image is a link to the current website: www.pcb.its.dot.gov - this screen capture snapshot shows an example from the Office of the Assistant Secretary for Research and Development - Intelligent Transportation Systems Joint Program Office - ITS Professional Capacity Building Program/Advanced ITS Education. Below the main site banner, it shows the main navigation menu with the following items: About, ITS Training, Knowledge Exchange, Technology Transfer, ITS in Academics, and Media Library. Below the main navigation menu, the page shows various content of the website, including a graphic image of professionals seated in a room during a training program. A text overlay has the text Welcome to ITS Professional Capacity Building. Additional content on the page includes a box entitled What's New and a section labeled Free Training. Again, this image serves for illustration only. The current website link is: http://www.pcb.its.dot.gov.)

 

Slide 3:

Activity. A placeholder graphic with an image of hand over a computer keyboard to show that an activity is taking place.

 

Slide 4:

T204 Part 2 of 2: How to Develop Test Procedures for an ITS Standards-Based Test Plan

 

Slide 5:

Instructor

Headshot photo of Dave Miller

Dave Miller,

Chair: NEMA / AASHTO / ITE Joint Committee on ATC

Chair: 3TS Technical Committee

Principal Systems Engineer

Siemens Industry, Inc.

RC-US MO MM-ITS R&D

Austin, Texas, USA

 

Slide 6:

Target Audience

 

Slide 7:

Recommended Prerequisites

 

Slide 8:

Curriculum Path (Testing)

A graphical illustration indicating the sequence of training modules that lead up to and follow each course. Please see the Extended Text Description below.

(Extended Text Description: Curriculum Path: A graphical illustration indicating the sequence of training modules that lead up to and follow each course. Each modules is represented by a box with the name of the module in it and an arrow showing the logical flow of the modules and the current module highlighted. This slide focuses on the modules that lead up to the current course. The top row of three boxes are labeled T101, T201 and T301 respectfully from left to right along with the course name for each below the course number. The second row of three boxes are labeled T203 Part 1 of 2, T203 Part 2 of 2 and T204 Part 1 of 2 respectfully from left to right along with the course name for each below the course number. The third row consists of one box labeled T204 Part 2 of 2 in the left-most column along with its course name below the course number.)

 

Slide 9:

abbrs and Terminology Used

Term / abbr Definition
C2F Center-to-Field
DMS Dynamic Message Sign
MIB Management Information Base
MSO Manufacturer Specific Object
RTCTM Requirements to Test Case Traceability Matrix
RTM Requirements Traceability Matrix
TCS Test Case Specification
TDS Test Design Specification
TMDD Traffic Management Data Dictionary
TP Test Plan
TPG Test Procedure Generator
TPRTM Test Procedure to Requirements Traceability Matrix
TPS Test Procedure Specification

 

Slide 10:

Learning Objectives

Part 1 of 2

  1. Recognize the purpose and structure of a test procedure
  2. Identify the role of a Test Procedure Specification (TPS) within a test plan and the overall testing process
  3. Synchronize the test procedure specification to the contract terms and conditions for successful contract execution
  4. Write the reports produced at the end of testing and understand their relationship to successful procurement contracts
  5. Use tools to develop the test procedures for a sample TPS structure

Part 2 of 2

  1. Use the Test Procedure Generator (TPG) to generate test procedures for a variety of equipment
  2. Adapt the generated test procedures to procurement contract terms and conditions for successful project conclusion
  3. Develop complex test procedures that pull together National Transportation Communications for Intelligent Transportation Systems Protocol (NTCIP) elements using the TPG

 

Slide 11:

What We Have Learned in Part 1

  1. Test Procedure Specification (TSP) inputs are test cases used to create outputs of expected results and anomaly reports of unexpected results in IEEE 829 standard format.
  2. A test design specification details what a test is to demonstrate; a test case specification specifies inputs, predicted results, and conditions, while a test procedure defines the steps to perform the test.
  3. Contract Terms and Conditions should be viewed from the project's end, including test case specifications and test procedures.
  4. A master test report measures project success to stated goals.
  5. Test Procedure Generator (TPG) is an automated tool that generates XML scripts using consistent key words for interoperability.

 

Slide 12:

Part 1 Discussed the Role of TPS Within Test Plan & Testing Process

Reviewed Test Workflow Steps

The figure depicts the testing flowchart consisting of Test Plan box at the top with a downward arrow to Test Design Specification box. Please see the Extended Text Description below.

(Extended Text Description: The figure depicts the testing flowchart consisting of Test Plan box at the top with a downward arrow to Test Design Specification box. That box has three arrows directed towards three boxes labeled Test Case 1, Test Case 2 and Test Case 3 that are arranged in a horizontal row below. Test Case 1 box has one arrow directed to Test Procedure 1 box below. Test Case 2 box has one arrow directed to Test Procedure 1 box below. Test Case 3 box has two arrows. The first arrow is directed to Test Procedure 2 box, while the second arrow is directed to Test Procedure 3 box. The horizontal row of Test Case boxes is identified by the text Module 203. The horizontal row of Test Procedure boxes is identified by the text Module 204.)

 

Slide 13:

Learning Objective #6: Use the Test Procedure Generator (TPG) to Generate Test Procedures for a Variety of Equipment

 

Slide 14:

Learning Objective #6

NTCIP 8002 Annex B1 Guidance

 

Slide 15:

Learning Objective #6

Role of Test Procedure Generator

Name Mnemonic Specification Number Version Number Source
Microsoft Windows 7 Operation System Windows 7 SP 1 Service Pack 1 2009 Microsoft Corp
Microsoft Word 2010, Professional Edition Word 2010 14.0.7128.5000 or greater 32-bit Microsoft Word 2010, Professional Edition Microsoft Corp

 

Slide 16:

Learning Objective #6

TPG Successful Installation

TPG Shortcut, NTCIP Standards, and Test Procedure Directories

ITS Standards TPG - Test Procedure Generator logo

 

Center-to-Field (C2F) Test Procedure Generator (TPG)

TPG InstallShield Wizard screenshot is shown. Please see the Extended Text Description below.

(Extended Text Description: TPG InstallShield Wizard screenshot is shown. The banner at the top of the InstallShield screenshot is "TPG – InstallShield Wizard". Below the banner is "Welcome to the InstallShield Wizard for TPG" Next line below is "TheInstallShield Wizard will install TPB on your computer. To continue, click Next". At the bottom of the screen are located "Next" and "Cancel" selection buttons. The left area of the screenshot is occupied by a graphic depicting the cover of a typical NTCIP standard title page that is enlarged in three places by magnifying glasses. Both the logo and screenshot were taken with permission from Center-to-Field Test Procedure Generator User Manual, v2.0, FHWA, July 15, 2015.)

Source: Center-to-Field Test Procedure Generator User Manual, v2.0, FHWA, July 15, 2015

 

Slide 17:

Learning Objective #6

TPG Successful Installation (cont.)

TPG Graphical User Interface (GUI)

The Graphical User Interface (GUI) screenshot is shown, consisting of a Microsoft Windows 7 screen with TPG pulldown menu items on the top banner. Please see the Extended Text Description below.

(Extended Text Description: Author's relevant description: The Graphical User Interface (GUI) screenshot is shown, consisting of a Microsoft Windows 7 screen with TPG pulldown menu items on the top banner. These pulldown menu items from left to right are "File", "Test Procedure", "Reports", "Tools", "Session Panel" and "Help" button selections. The left side of the GUI screenshot consists of the vertical "Session Panel" with a list of each item pertaining to the selected standard. Below the TPG menu items are document tabs consisting of "Standard", "Set of Test Procedures", "Current Test Procedure" and "Reports", followed by Embedded Microsoft Word 2010 Document Menu Items consisting of "File", "Home", "Insert Page Layout", "References", "Mailings", "Review" and "View" button selections. Below and to the left of the Session Panel is a main screen area with a sample NTCIP 1203 version v03 title page. Below the title page is a horizontal TPG session status text area. At the bottom is the TPG Command status text area. This GUI layout will be referenced in the later slides. Note that the course presentation does not address each item shown in each area of each screenshot; rather, the relevant pull-down buttons are described along with their effect so that the student is aware of the major GUI functions. Likewise, this description also describes the same pulldown button operation without describing each item shown on the screen. The TPG Graphical User Interface screenshot is shown taken with permission from Center-to-Field Test Procedure Generator User Manual, v2.0, FHWA, July 15, 2015.)

Source: Center-to-Field Test Procedure Generator User Manual, v2.0, FHWA, July 15, 2015

 

Slide 18:

Learning Objective #6

Example Test Procedure

Reset the TPG Environment

Screenshot of the TPG GUI. Please see the Extended Text Description below.

(Extended Text Description: Author's relevant description: Screenshot of the TPG GUI showing the "Tools" button pulled down with the "Option", followed by "Reset Default TPG Settings" selected. "Reset the TPG Environment" screenshot is shown taken with permission from Center-to-Field Test Procedure Generator User Manual, v2.0, FHWA, July 15, 2015.)

Source: Center-to-Field Test Procedure Generator User Manual, v2.0, FHWA, July 15, 2015

 

Slide 19:

Learning Objective #6

Example Test Procedure (cont.)

Begin a New TPG Session

Screenshot of the TPG GUI. Please see the Extended Text Description below.

(Extended Text Description: Author's relevant description: Screenshot of the TPG GUI showing the "File" button pulled down with the "New Session" selection highlighted. Overlapping and to the right is a rectangular box with a description of the button operation. "Begin a New TPG Session" screenshot is shown taken with permission from Center-to-Field Test Procedure Generator User Manual, v2.0, FHWA, July 15, 2015.)

Source: Center-to-Field Test Procedure Generator User Manual, v2.0, FHWA, July 15, 2015

 

Slide 20:

Learning Objective #6

Example Test Procedure (cont.)

Select the C2F Standard

Screenshot of the TPG GUI. Please see the Extended Text Description below.

(Extended Text Description: Author's relevant description: Screenshot of the TPG GUI showing a popup screen titled "New Session". Below that banner are four data entry boxes to select the standard and version. Below are two selections for "New Session Options". Below are three selections for "Verification Options". At the bottom of the popup screen are buttons for Browse, OK and Cancel. Below the popup and at the bottom of the GUI is a text field stating the TPG Status. Again, we do not go into detail of each text string shown, only the location and function of that screen. Select the C2F Standard screenshot is shown taken with permission from Center-to-Field Test Procedure Generator User Manual, v2.0, FHWA, July 15, 2015.)

Source: Center-to-Field Test Procedure Generator User Manual, v2.0, FHWA, July 15, 2015

 

Slide 21:

Learning Objective #6

Example Test Procedure (cont.)

Processing the Entries

Screenshot of the TPG GUI. Please see the Extended Text Description below.

(Extended Text Description: Author's relevant description: Screenshot of the TPG GUI showing a popup screen titled "Command in Progress, Please wait" Below that banner the popup screen depicts a green horizontal bar graph showing the progress, with the processing results listed in a table below that bar graph. "Processing the Entries" screenshot is shown taken with permission from Center-to-Field Test Procedure Generator User Manual, v2.0, FHWA, July 15, 2015.)

Source: Center-to-Field Test Procedure Generator User Manual, v2.0, FHWA, July 15, 2015

 

Slide 22:

Learning Objective #6

Example Test Procedure (cont.)

Map NTCIP 8002 Annex B1 Required Sections

Screenshot of the TPG GUI. Please see the Extended Text Description below.

(Extended Text Description: Author's relevant description: Screenshot of the TPG "Map NTCIP 8002 Annex B1 Required Sections". The left of the screenshot shows a list of six radio buttons to select Dialogs. The right of the screenshot shows the NTCIP C2F Table of Contents for that standard. Again, the format and use of the screen is shown without a detailed description of the text shown. "Map NTCIP 8002 Annex B1 Required Sections" is shown taken with permission from Center-to-Field Test Procedure Generator User Manual, v2.0, FHWA, July 15, 2015.)

Source: Center-to-Field Test Procedure Generator User Manual, v2.0, FHWA, July 15, 2015

 

Slide 23:

Learning Objective #6

Example Test Procedure (cont.)

Map NTCIP 8002 Annex B1 Undefined Sections

Screenshot of the TPG GUI. Please see the Extended Text Description below.

(Extended Text Description: Author's relevant description: Screenshot of the TPG "Map NTCIP 8002 Annex B1 Required Sections" is repeated as an example of using the TPG to select undefined sections. The left of the screenshot shows a list of six radio buttons to select dialogs. The right of the screenshot shows the NTCIP C2F Table of Contents. Annex A is selected and highlighted in blue on the right side. "Reset", "OK" and "Cancel" buttons occupy the horizontal area at the bottom of the GUI. "Map NTCIP 8002 Annex B1 Undefined Sections" is shown taken with permission from Center-to-Field Test Procedure Generator User Manual, v2.0, FHWA, July 15, 2015.)

Source: Center-to-Field Test Procedure Generator User Manual, v2.0, FHWA, July 15, 2015

 

Slide 24:

Learning Objective #6

Example Test Procedure (cont.)

Create Requirements Traceability Matrix (RTM)

Screenshot of the TPG GUI. Please see the Extended Text Description below.

(Extended Text Description: Author's relevant description: Screenshot of the TPG GUI showing a popup screen with the banner "4% Complete" at the top. The top third of the popup depicts a green horizontal bar showing 4% complete. Below is a text area to report errors created during the progress. Again, we do not describe the Error text shown, only that the box displays errors that occur during the execution of that command. "Create Requirements Traceability Matrix" is shown taken with permission from Center-to-Field Test Procedure Generator User Manual, v2.0, FHWA, July 15, 2015.)

Source: Center-to-Field Test Procedure Generator User Manual, v2.0, FHWA, July 15, 2015

 

Slide 25:

Activity. A placeholder graphic with an image of hand over a computer keyboard to show that an activity is taking place.

 

Slide 26:

Learning Objective #6

How does TPG relate to NTCIP 8002?

Answer Choices

  1. Draft standards are verified to NTCIP 8002 compliance
  2. Unbroken traceability from requirements through testing
  3. Uniformity of test procedure content and numbering
  4. All of the above

 

Slide 27:

Learning Objective #6

Review of Answers

A small graphical red and yellow X representing incorrect.a) Draft standards are verified to NTCIP 8002 compliance
Incorrect All are true.

A small graphical red and yellow X representing incorrect.b) Unbroken traceability from requirements through testing
Incorrect All are true.

A small graphical red and yellow X representing incorrect.c) Uniformity of test procedure content and numbering
Incorrect. All are true.

A small graphical green and yellow check mark representing correct.d) All of the above
Correct! All of the above answers describe how the TPG relates to NTCIP 8002.

 

Slide 28:

Learning Objective #6

Example: Test Procedure for a DMS

Open the NTCIP 1203 v03 DMS Standard

Screenshot of the TPG GUI. Please see the Extended Text Description below.

(Extended Text Description: Author's relevant description: Screenshot of the TPG GUI with NTCIP 1203-01b title page shown. "Open the NTCIP 1203 v03 DMS Standard" screenshot is shown taken with permission from Center-to-Field Test Procedure Generator User Manual, v2.0, FHWA, July 15, 2015.)

Source: Center-to-Field Test Procedure Generator User Manual, v2.0, FHWA, July 15, 2015

 

Slide 29:

Learning Objective #6

Example: Test Procedure for a DMS (cont.)

Create a New Set of Test Procedures

Screenshot of the TPG GUI. Please see the Extended Text Description below.

(Extended Text Description: Author's relevant description: Screenshot of the TPG GUI with NTICP 1203-01b title page shown from the previous slide, but with the addition of the "File" pull down menu open and "New Set of Test Procedures" line selected in blue. "Create a New Set of Test Procedures" screenshot is shown taken with permission from Center-to-Field Test Procedure Generator User Manual, v2.0, FHWA, July 15, 2015.)

Source: Center-to-Field Test Procedure Generator User Manual, v2.0, FHWA, July 15, 2015

 

Slide 30:

Learning Objective #6

Example Test Procedure for a DMS (cont.)

Create Test Procedure Requirements Traceability Matrix

Screenshot of the TPG GUI. Please see the Extended Text Description below.

(Extended Text Description: Author's relevant description: Screenshot of the TPG GUI is shown depicting a popup screen with banner stating "Command in Progress – Please wait." Below is a horizontal green bar depicting the progress in creating a TPRTM.doc file of 4%. Below is shown a list of results. Again, we do not describe the Results text shown, only that the box displays Results that occur during the execution of that command "Create Test Procedure Requirements Traceability Matrix" screenshot is shown taken with permission from Center-to-Field Test Procedure Generator User Manual, v2.0, FHWA, July 15, 2015.)

Source: Center-to-Field Test Procedure Generator User Manual, v2.0, FHWA, July 15, 2015

 

Slide 31:

Learning Objective #6

Example Test Procedure for a DMS (cont.)

Set of Test Procedures

Screenshot of the TPG GUI. Please see the Extended Text Description below.

(Extended Text Description: Author's relevant description: Screenshot of the TPG graphical GUI with NTCIP 1203-01b title page is again shown, but with the "Set of Test Procedures" tab selected. "Set of Test Procedures" screenshot is shown taken with permission from Center-to-Field Test Procedure Generator User Manual, v2.0, FHWA, July 15, 2015.)

Source: Center-to-Field Test Procedure Generator User Manual, v2.0, FHWA, July 15, 2015

 

Slide 32:

Learning Objective #6

Example Test Procedure for a DMS (cont.)

Create a New Test Procedure

Screenshot of the TPG GUI. Please see the Extended Text Description below.

(Extended Text Description: Author's relevant description: Screenshot of the TPG GUI with NTICP 1203-01b title page shown from the previous slide, with the addition of the "Test Procedure" pull down menu open and "New Test Procedure" line selected in blue. "Create a New Test Procedure" screenshot is shown taken with permission from Center-to-Field Test Procedure Generator User Manual, v2.0, FHWA, July 15, 2015.)

Source: Center-to-Field Test Procedure Generator User Manual, v2.0, FHWA, July 15, 2015

 

Slide 33:

Learning Objective #6

Example Test Procedure for a DMS (cont.)

Test Procedure ID

Screenshot of the TPG GUI. Please see the Extended Text Description below.

(Extended Text Description: Author's relevant description: Screenshot of the TPG GUI is shown, with a popup screen with banner at the top labeled "Test Procedure ID". Below is a fill-in box with the ID number. In this case, the Test Procedure ID has been defaulted to "01.00". "Test Procedure ID" screenshot is shown, taken with permission from Center-to-Field Test Procedure Generator User Manual, v2.0, FHWA, July 15, 2015.)

Source: Center-to-Field Test Procedure Generator User Manual, v2.0, FHWA, July 15, 2015

 

Slide 34:

Learning Objective #6

Example Test Procedure for a DMS (cont.)

Test Procedure File

Screenshot of the TPG GUI. Please see the Extended Text Description below.

(Extended Text Description: Author's relevant description: Screenshot of the TPG GUI is shown. The embedded MS Word document depicts a two-column table with "Test Procedure 01.00" in the upper left table entry and all other table entry text is grayed out. "Test Procedure File" screenshot is shown taken with permission from Center-to-Field Test Procedure Generator User Manual, v2.0, FHWA, July 15, 2015.)

Source: Center-to-Field Test Procedure Generator User Manual, v2.0, FHWA, July 15, 2015

 

Slide 35:

Learning Objective #6

Example Test Procedure for a DMS (cont.)

Test Procedure Header

Screenshot of the TPG GUI. Please see the Extended Text Description below.

(Extended Text Description: Author's relevant description: Screenshot of the TPG GUI is shown. The embedded MS Word document depicts a two-column table with "Test Procedure 01.00" in the upper left table entry as in the previous slide. "Test Procedure" menu is pulled down and "Define Test Procedure Header" is selected in blue. "Test Procedure Header" screenshot is shown taken with permission from Center-to-Field Test Procedure Generator User Manual, v2.0, FHWA, July 15, 2015.)

Source: Center-to-Field Test Procedure Generator User Manual, v2.0, FHWA, July 15, 2015

 

Slide 36:

Learning Objective #6

Example Test Procedure for a DMS (cont.)

Populate the Test Procedure Header

Screenshot of the TPG GUI. Please see the Extended Text Description below.

(Extended Text Description: Author's relevant description: Screenshot of the TPG GUI is shown with a popup screen "Define Test Procedure Header" popup includes three data entry boxes labeled "Test Procedure Title", "Description" and "Pass/Fail respectively". "OK" and "Cancel" buttons occupy the lower right corner horizontally arranged. Again, we do not describe the Test Procedure text shown, only that the box allows entry of Test Procedure information. "Populate the Test Procedure Header" screenshot is shown taken with permission from Center-to-Field Test Procedure Generator User Manual, v2.0, FHWA, July 15, 2015.)

Source: Center-to-Field Test Procedure Generator User Manual, v2.0, FHWA, July 15, 2015

 

Slide 37:

Learning Objective #6

Example Test Procedure for a DMS (cont.)

Populate the Test Procedure Header

Screenshot of the TPG GUI. Please see the Extended Text Description below.

(Extended Text Description: Author's relevant description: Screenshot of the TPG GUI is shown. The embedded MS Word document depicts the same two-column table with "Test Procedure 01.00" in the upper left table entry, but now with the "Description" and "Pass/Fail Criteria" data entries populated instead of grayed out. "Continuation of Populate the Test Procedure Header" screenshot is shown taken with permission from Center-to-Field Test Procedure Generator User Manual, v2.0, FHWA, July 15, 2015.)

Source: Center-to-Field Test Procedure Generator User Manual, v2.0, FHWA, July 15, 2015

 

Slide 38:

Learning Objective #6

Example Test Procedure for a DMS (cont.)

Select the Requirements

Screenshot of the TPG GUI. Please see the Extended Text Description below.

(Extended Text Description: Author's relevant description: Screenshot of the TPG GUI is shown. The embedded MS Word document is shown identical to previous slide. "Test Procedure" is pulled down and "Select Requirements" is selected in blue. "Select the Requirements" screenshot is shown taken with permission from Center-to-Field Test Procedure Generator User Manual, v2.0, FHWA, July 15, 2015.)

Source: Center-to-Field Test Procedure Generator User Manual, v2.0, FHWA, July 15, 2015

 

Slide 39:

Learning Objective #6

Example Test Procedure for a DMS (cont.)

Select the Requirements

Screenshot of the TPG GUI. Please see the Extended Text Description below.

(Extended Text Description: Author's relevant description: Screenshot of the TPG GUI is shown with a popup screen "Select Requirements" banner. Popup shows one box depicting the requirements contained in that standard. Below right are OK and "Cancel" buttons arranged horizontally. Again, we do not describe the Requirements text shown, only that the box displays Requirements that occur during the execution of that command "Continuation of Select the Requirements" screenshot is shown taken with permission from Center-to-Field Test Procedure Generator User Manual, v2.0, FHWA, July 15, 2015.)

Source: Center-to-Field Test Procedure Generator User Manual, v2.0, FHWA, July 15, 2015

 

Slide 40:

Learning Objective #6

Example Test Procedure for a DMS (cont.)

Select the Requirements

Screenshot of the TPG GUI. Please see the Extended Text Description below.

(Extended Text Description: Author's relevant description: Identical to previous slide, but with "3.4.2.2 Configure Logging Service" selected in blue. "Further continuation of Select the Requirements" screenshot is shown taken with permission from Center-to-Field Test Procedure Generator User Manual, v2.0, FHWA, July 15, 2015.)

Source: Center-to-Field Test Procedure Generator User Manual, v2.0, FHWA, July 15, 2015

 

Slide 41:

Learning Objective #6

Example Test Procedure for a DMS (cont.)

Populated Test Procedure Document

Screenshot of the TPG GUI. Please see the Extended Text Description below.

(Extended Text Description: Author's relevant description: Screenshot of the TPG GUI with the embedded MS Word document table filled out in entirety except the "Variable(s) entry remains grayed out. "Populated Test Procedure Document" screenshot is shown taken with permission from Center-to-Field Test Procedure Generator User Manual, v2.0, FHWA, July 15, 2015.)

Source: Center-to-Field Test Procedure Generator User Manual, v2.0, FHWA, July 15, 2015

 

Slide 42:

Learning Objective #6

Example Test Procedure for a DMS (cont.)

Define Variables

Screenshot of the TPG GUI. Please see the Extended Text Description below.

(Extended Text Description: Author's relevant description: Identical to slide 41, but with "Define Variables" selected in blue. "Define Variables" screenshot is shown taken with permission from Center-to-Field Test Procedure Generator User Manual, v2.0, FHWA, July 15, 2015.)

Source: Center-to-Field Test Procedure Generator User Manual, v2.0, FHWA, July 15, 2015

 

Slide 43:

Learning Objective #6

Example Test Procedure for a DMS (cont.)

Define Variables

Screenshot of the TPG GUI. Please see the Extended Text Description below.

(Extended Text Description: Author's relevant description: Screenshot of the TPG GUI is shown with a popup screen "Select Variable Name". Below are "Delete", OK and "Cancel" buttons arranged horizontally at the bottom of the GUI. Below the banner "Create a New Variable" text entry box is provided. To the right, "ASN.1 Types" and "Object Types" selection tabs are provided with a "Select Type" pull down button provided for those selections. "Continuation of Define Variables" screenshot is shown taken with permission from Center-to-Field Test Procedure Generator User Manual, v2.0, FHWA, July 15, 2015.)

Source: Center-to-Field Test Procedure Generator User Manual, v2.0, FHWA, July 15, 2015

 

Slide 44:

Learning Objective #6

Example Test Procedure for a DMS (cont.)

Define Variables

Screenshot of the TPG GUI. Please see the Extended Text Description below.

(Extended Text Description: Author's relevant description: Screenshot of the TPG GUI is shown with a popup screen "Test Procedure Variables" Pop identical to the previous slide along with the same text entry boxes. Popup shows one box depicting the "Test Procedure Variables" contained in that standard. Below are "Delete", "OK" and "Cancel" buttons arranged horizontally at the bottom. Above. "Further continuation of Define Variables" screenshot is shown taken with permission from Center-to-Field Test Procedure Generator User Manual, v2.0, FHWA, July 15, 2015.)

Source: Center-to-Field Test Procedure Generator User Manual, v2.0, FHWA, July 15, 2015

 

Slide 45:

Learning Objective #6

Example Test Procedure for a DMS (cont.)

Define Variables

Screenshot of the TPG GUI. Please see the Extended Text Description below.

(Extended Text Description: Author's relevant description: Screenshot of the TPG GUI with the embedded MS Word document table filled out in entirety and without grayed out text. "Further continuation of Define Variables" screenshot is shown taken with permission from Center-to-Field Test Procedure Generator User Manual, v2.0, FHWA, July 15, 2015.)

Source: Center-to-Field Test Procedure Generator User Manual, v2.0, FHWA, July 15, 2015

 

Slide 46:

Learning Objective #6

Example Test Procedure for a DMS (cont.)

Define a Test Procedure Step

Screenshot of the TPG GUI. Please see the Extended Text Description below.

(Extended Text Description: Author's relevant description: Screenshot of the TPG GUI is shown with a popup screen "Test Procedure Step" Pop up shows "Step ID" and "Keyword" data entry boxes. Below are and active "Close" button and grayed out "Insert" buttons. "Define a Test Procedure Step" screenshot is shown taken with permission from Center-to-Field Test Procedure Generator User Manual, v2.0, FHWA, July 15, 2015.)

Source: Center-to-Field Test Procedure Generator User Manual, v2.0, FHWA, July 15, 2015

 

Slide 47:

Learning Objective #6

Example Test Procedure for a DMS (cont.)

Select the Objects for the Test Step

Screenshot of the TPG GUI. Please see the Extended Text Description below.

(Extended Text Description: Author's relevant description: Screenshot of the TPG GUI is shown with a popup screen "Select One or More Objects" Pop up shows two data selection boxes. The box to the left depicts the objects to be selected. Those selections are dragged and dropped into the box to the right. Below are OK and "Cancel" buttons below the left area and "Add to Keyword List" and "Remove from Keyword List" buttons below the right area. Again, we do not describe the text entries shown, only that the boxes are used to select objects. "Select the Objects for a Test Step" screenshot is shown taken with permission from Center-to-Field Test Procedure Generator User Manual, v2.0, FHWA, July 15, 2015.)

Source: Center-to-Field Test Procedure Generator User Manual, v2.0, FHWA, July 15, 2015

 

Slide 48:

Learning Objective #6

Example Test Procedure for a DMS (cont.)

Inserting a Test Procedure Step

Screenshot of the TPG GUI. Please see the Extended Text Description below.

(Extended Text Description: Author's relevant description: Screenshot of the TPG GUI with the embedded MS Word document table filled out in entirety including Test Step Number, Test Procedure list and Results columns. Again, we do not describe the text shown, only how the boxes are used. "Inserting a Test Procedure Step" screenshot is shown taken with permission from Center-to-Field Test Procedure Generator User Manual, v2.0, FHWA, July 15, 2015.)

Source: Center-to-Field Test Procedure Generator User Manual, v2.0, FHWA, July 15, 2015

 

Slide 49:

Learning Objective #6

Example Test Procedure for a DMS (cont.)

Saving the Test Procedure

Screenshot of the TPG GUI. Please see the Extended Text Description below.

(Extended Text Description: Author's relevant description: Screenshot identical to previous slide, but with "Test Procedure" pulled down with "Save Test Procedure" selected in blue. "Saving a Test Procedure" screenshot is shown taken with permission from Center-to-Field Test Procedure Generator User Manual, v2.0, FHWA, July 15, 2015.)

Source: Center-to-Field Test Procedure Generator User Manual, v2.0, FHWA, July 15, 2015

 

Slide 50:

Learning Objective #6

Example Test Procedure for a DMS (cont.)

Closing the Test Procedure

Screenshot of the TPG GUI. Please see the Extended Text Description below.

(Extended Text Description: Author's relevant description: Screenshot identical to previous slide but with "Close Test Procedure" selected in blue. "Closing the Test Procedure" screenshot is shown taken with permission from Center-to-Field Test Procedure Generator User Manual, v2.0, FHWA, July 15, 2015.)

Source: Center-to-Field Test Procedure Generator User Manual, v2.0, FHWA, July 15, 2015

 

Slide 51:

Learning Objective #6

Example Test Procedure for a DMS (cont.)

Saving the Sets of Test Procedure

Screenshot of the TPG GUI. Please see the Extended Text Description below.

(Extended Text Description: Author's relevant description: Screenshot of TPG GUI with "File" pulled down with "Save Set of Test Procedures / TPRTM" selected in yellow. "Saving the Sets of Test Procedure" screenshot is shown taken with permission from Center-to-Field Test Procedure Generator User Manual, v2.0, FHWA, July 15, 2015.)

 

Slide 52:

Learning Objective #6

Example Test Procedure for a DMS (cont.)

Saving the Sets of Test Procedure

Screenshot of the TPG GUI. Please see the Extended Text Description below.

(Extended Text Description: Author's relevant description: Screenshot of the TPG GUI is shown with a popup screen "Save As" banner. Popup shows a selection of "Save In" files for selection. Below are "Save" and "Cancel" buttons. Arranged vertically in the lower right corner. "File Name" and "Save as Type" text entry boxes are shown, arranged vertically in the lower left corner. "Continuation of Saving the Sets of Test Procedure" screenshot is shown taken with permission from Center-to-Field Test Procedure Generator User Manual, v2.0, FHWA, July 15, 2015.)

 

Slide 53:

Learning Objective #6

Example Test Procedure for a DMS (cont.)

Saving XML Test Procedure

Screenshot of the TPG GUI. Please see the Extended Text Description below.

(Extended Text Description: Author's relevant description: Screenshot of TPG GUI with "File" pulled down, and with "Save XML Set of Test Procedures / TPRTM" selected in blue. "Saving XML Test Procedure" screenshot is shown taken with permission from Center-to-Field Test Procedure Generator User Manual, v2.0, FHWA, July 15, 2015.)

Source: Center-to-Field Test Procedure Generator User Manual, v2.0, FHWA, July 15, 2015

 

Slide 54:

Learning Objective #6

Example Test Procedure for a DMS (cont.)

Displaying XML Test Procedure

Screenshot of the TPG GUI. Please see the Extended Text Description below.

(Extended Text Description: Author's relevant description: Screenshot of the TPG GUI with the embedded MS Word document depicting the set of Test Procedures in XML format. Again, we do not describe the XML shown, only that the box displays XML outputs that occur during the execution of that command "Displaying XML Test Procedure" screenshot is shown taken with permission from Center-to-Field Test Procedure Generator User Manual, v2.0, FHWA, July 15, 2015.)

Source: Center-to-Field Test Procedure Generator User Manual, v2.0, FHWA, July 15, 2015

 

Slide 55:

Activity. A placeholder graphic with an image of hand over a computer keyboard to show that an activity is taking place.

 

Slide 56:

Learning Objective #6

Which is the order of the TPG example workflow?

Answer Choices

  1. XML Requirement Step Object Variable
  2. Object Variable Requirement Step XML
  3. Requirement Variable Step Object XML
  4. Object Requirement Variable Step XML

 

Slide 57:

Learning Objective #6

Review of Answers

A small graphical red and yellow X representing incorrect.a) XML Requirement Step Object Variable
Incorrect. XML is an output created at end of workflow.

A small graphical red and yellow X representing incorrect.b) Object variable Requirement Step XML
Incorrect. Objects are not known until Requirements are known.

A small graphical green and yellow check mark representing correct.c) Requirement Variable Step Object XML
Correct! Requirements are populated with Variables that are tested in Steps of Objects that create XML output.

A small graphical red and yellow X representing incorrect.d) Object Requirement Variable Step XML
Incorrect. Objects are not known until Requirements are known and Test Steps must be known before Objects are selected.

 

Slide 58:

Summary of Learning Objective #6

Use the TPG to Generate Test Procedures for a Variety of Equipment

 

Slide 59:

Learning Objective #7: Adapt the Generated Test Procedures to Procurement Contract Terms and Conditions for Successful Project Conclusion

 

Slide 60:

Learning Objective #7

Plan the Test Procedure from the Beginning

BEGIN by Planning As If You Were at the END

 

Slide 61:

Learning Objective #7

Plan the Test Procedure from the Beginning

Plan the Level Tests As If the Project Is Ending

Graphic depicts the USDOT Systems Engineering Process (SEP) VEE mode. Please see the Extended Text Description below.

(Extended Text Description: Graphic depicts the USDOT Systems Engineering Process (SEP) VEE model. The left-hand side of the VEE depicts six blue boxes, descending towards the lower right with a downward arrow labeled "Decomposition and Definition". The box and the bottom valley of the VEE is labeled "Implementation" below. The boxes are labeled "Regional Architecture", "Feasibility Study / Concept Exploration", "Concept of Operations", "System Requirements", "High Level Design" and "Detailed Design", arranged from upper right to lower left to the bottom of the VEE. The right-hand side of the VEE depicts seven boxes ascending towards the upper right labeled "Integration and Recomposition with an arrow directed upwards. The boxes are labeled "Unit / Device Testing", "Subsystem Verification", "System Verification and Deployment" "System Validation", "Operations and Maintenance", "Changes and Upgrades" and "Retirement / Replacement". Connecting the left and right sides of the VEE and at the bottom of the VEE is one box labeled "Software / Hardware Development Field Installation". "VEE workflow" graphic is shown taken with permission from Systems Engineering for Intelligent Transportation Systems, USDOT, January 2007.)

Source: Systems Engineering for Intelligent Transportation Systems, USDOT, January 2007

 

Slide 62:

Learning Objective #7

Lessons Learned from Unsuccessful ITS Projects

From T204 Part 1, Learning Objective #3

 

Slide 63:

Learning Objective #7

How to Avoid Repetition of Failure

Find and Correct Defects Early in the Project

 

Slide 64:

Learning Objective #7

How to Avoid Repetition of Failure (cont.)

Find and Correct Defects Early in the Project

Graphic depicts a grid of five horizontal lines and six vertical lines as a three dimensional graph. Please see the Extended Text Description below.

(Extended Text Description: Graphic depicts a grid of five horizontal lines and six vertical lines as a three dimensional graph. The vertical axis is labeled "Phase the Defect is Created", "ConOps", "Requirements", "Design" and "Construction" from top to bottom and located to the left of the first vertical line. The horizontal axis is labeled "ConOps", "Requirements", "Design", "Construction" and "O&M" from left to right and located below the lower horizontal line. Four perpendicular blue triangular planes are located within each horizontal space between the five horizontal grid lines. Each plane extends in decreasing height from the upper plane to the lower plane. A blue oval encircles the left-most tip of the four planes that is labeled "Fix It Here". A black arrow directed vertically is located to the right of the grid labeled "Cost to Correct". "Phase the Defect is Corrected" graphic is shown taken with permission from Systems Engineering for Intelligent Transportation Systems, USDOT, January 2007.)

Source: Systems Engineering for Intelligent Transportation Systems, USDOT, January 2007

 

Slide 65:

Learning Objective #7

Use Clear and Unambiguous Contract Terms

Contract Provisions Should Provide:

 

Slide 66:

Learning Objective #7

Use Clear and Unambiguous Contract Terms (cont.)

Contract Requirements

 

Slide 67:

Learning Objective #7

Use Clear and Unambiguous Contract Terms (cont.)

Contract Prohibitions

 

Slide 68:

Activity. A placeholder graphic with an image of hand over a computer keyboard to show that an activity is taking place.

 

Slide 69:

Learning Objective #7

ITS project cost and schedule should be developed in which of the following orders?

Answer Choices

  1. From the test procedures back through the project workflow
  2. From the requirements only
  3. To enforce the contract terms at the end of the project
  4. To minimize the planning costs up front

 

Slide 70:

Learning Objective #7

Review of Answers

A small graphical green and yellow check mark representing correct.a) From the test procedures back through the project workflow
Correct! Providing the test procedures in the contract terms allows the manufacturers to use the TPG throughout the design phase to eliminate defects early.

A small graphical red and yellow X representing incorrect.b) From requirements only
Incorrect. Providing only the requirements allows multiple interpretations that will be costly to correct at installation.

A small graphical red and yellow X representing incorrect.c) To enforce contract terms at the end of the project
Incorrect. Contract terms should enforce continuous verification throughout the project, not enforcement at the end.

A small graphical red and yellow X representing incorrect.d) To minimize planning costs up front
Incorrect. Additional up-front planning reduces overall costs.

 

Slide 71:

Summary of Learning Objective #7

Adapt the Generated Test Procedures to Procurement Contract Terms and Conditions for Successful Project Conclusion

 

Slide 72:

Learning Objective #8: Develop Complex Test Procedures That Pull Together NTCIP Elements Using the TPG

 

Slide 73:

Learning Objective #8

Analyze Pre-Existing Central Station from Vendor A

Requirements Currently Supported

 

Slide 74:

Learning Objective #8

Plan Upcoming Procurement Contract to Add Variety of Equipment

Add Equipment and Identify the Gap:

 

Slide 75:

Learning Objective #8

Specify, Create, and Test MSOs for Special Needs

Special Needs Might Include:

 

Slide 76:

Learning Objective #8

Use of TPG As Acceptance Test Throughout the Project

Use the TPG to Guide Each Level Test

 

Slide 77:

Learning Objective #8

Explain How Terms and Conditions Are Based on the Test Procedure

Include Test Procedure and Expected Results

 

Slide 78:

Learning Objective #8

Use TPG Outputs As Pass/Fail Criteria for Project End and Example of Reports for Project End

Compare TPG XML Outputs to Expected XML Outputs

 

Slide 79:

Learning Objective #8

NTCIP 8007

Relationship between NTCIP 8007 and IEEE 829

 

Slide 80:

Learning Objective #8

Standards Supported by TPG

TPG Supports NTCIP 12XX Standards with SE Content

 

Slide 81:

Learning Objective #8

TPG Distribution

Copies of the TPG can be obtained:

 

Slide 82:

What We Have Learned

  1. NTCIP 8002 will define uniform numbering and content for NTCIP 12XX series center-to-field standards.
  2. Using TPG to enter inputs insures the proper use of key words and creates test procedures in IEEE 829 steps.
  3. TPG outputs in XML_format provides test documentation and can be used as inputs to automated test equipment.
  4. Begin by planning test procedures to be used at the end.
  5. Contracts should provide test procedures and expected outputs in order to verify requirements throughout the entire project.
  6. Contract should require objects and dialogs for special needs.
  7. Contracts ban poor practice of undocumented MSOs for interoperability.

 

Slide 83:

Resources

 

Slide 84:

Questions? A placeholder graphic image with word Questions? at the top, and an image of a lit light bulb on the lower right side.