Module 5 - T101

T101: Introduction to ITS Standards Testing

HTML of the PowerPoint Presentation

(Note: This document has been converted from a PowerPoint presentation to 508-compliant HTML. The formatting has been adjusted for 508 compliance, but all the original text content is included, plus additional text descriptions for the images, photos and/or diagrams have been provided below.)

 

Slide 1:

Slide 1: ITS Welcome - see the extended text description below.

(Extended Text Description: Slide 1: Welcome - Graphic image of introductory slide. A large dark blue rectangle with a wide, light grid pattern at the top half and bands of dark and lighter blue bands below. There is a white square ITS logo box with words “Standards ITS Training” in green and blue on the middle left side. The word “Welcome” in white is to the right of the logo. Under the logo box are the words “RITA Intelligent Transportation Systems Joint Program Office.”)

 

Slide 2:

Welcome

Head shot photo of Shelley Row, P.E., PTOE - Director - ITS Joint Program Office

Shelley Row, P.E., PTOE

Director

ITS Joint Program Office

Shelley.Row@dot.gov

Screen capture snapshot of RITA website - for illustration only - see the extended text description below.

(Extended Text Description: Slide 2: Screen capture snapshot of RITA website - for illustration only. Below this image is a link to the current website: http://www.pcb.its.dot.gov - this screen capture snapshot shows an example from the RITA website from June 3, 2011. At the top of the page it shows the RITA logo with the text Research and Innovative Technology Administration - Intelligent Transportation Systems. Below the main site banner, it shows the main navigation menu with the following items: About RITA, Communities of Interest, Contact Us, Press Room, RITA Offices, Site Map, and a Search button. Below the main navigation menu, it shows a sub-navigation menu with the following items: About Us, T3 Webinars, ITS Peer-to-Peer, Resources, Local ITS PCB and Testimonials. Beneath the sub-navigation menu, the page is sub-titled "ITS Professional Capacity Building Program" and is divided into sub-sections such as "Welcome to ITS Professional Building", "News", "ITS Technical Assistance" and "Scheduled T3 Webinars". Again, this image serves for illustration only. The current website link is: http://www.pcb.its.dot.gov)

WWW.PCB.ITS.DOT.GOV

(Note: There is additional text attached to this slide that includes the following introductory information from Shelley Row):

"ITS Standards can make your life easier. Your procurements will go more smoothly and you’ll encourage competition, but only if you know how to write them into your specifications and test them. This module is one in a series that covers practical applications for acquiring and testing standards-based ITS systems.

I am Shelley Row the director of the ITS Joint Program Office for USDOT and I want to welcome you to our newly redesigned ITS standards training program of which this module is a part. We are pleased to be working with our partner, the Institute of Transportation Engineers, to deliver this new approach to training that combines web based modules with instructor interaction to bring the latest in ITS learning to busy professionals like you.

This combined approach allows interested professionals to schedule training at your convenience, without the need to travel. After you complete this training, we hope that you will tell colleagues and customers about the latest ITS standards and encourage them to take advantage of the archived version of the webinars.

ITS Standards training is one of the first offerings of our updated Professional Capacity Training Program. Through the PCB program we prepare professionals to adopt proven and emerging  ITS technologies that will make surface transportation safer, smarter and greener which improves livability for us all. You can find information on additional modules and training programs on our web site www.pcb.its.dot.gov.

Please help us make even more improvements to our training modules through the evaluation process. We look forward to hearing your comments. Thank you for participating and we hope you find this module helpful."

 

Slide 3:

T101: Introduction to ITS Standards Testing

 

Slide 4:

Target Audience

 

Slide 5:

Instructor

Headshot photo of Gary B. Thomas, P.E., Ph.D., Research Engineer

Gary B. Thomas, P.E., Ph.D.

Research Engineer
Texas Transportation Institute
College Station, TX, USA

 

Slide 6:

Recommended Prerequisites

 

Slide 7:

Curriculum Path (Testing)

Slide 7. Curriculum Path (Testing). Please see extended text description below.

(Extended text description. Curriculum Path (Testing). A chart showing the curriculum path for the testing topics.  A linear box chart (boxes are in blue or highlighted with rounded corners and embossed effect on side edges) starting with "T101 – Introduction to ITS Standards Testing" (highlighted box) with an arrow leading to "T201 – How to Write a Test Plan" (blue box) with an arrow leading to "T202 – Overview of Test Design Specifications, Test Cases and Test Procedures" (blue box) with a divided arrow leading up to "T311 – Applying Your Test Plan to the NTCIP 1203 V03 DMS Standard" (higher blue box) and lower arrow leading down to "T313 – Applying Your Test Plan to the NTCIP 1204 V03 ESS Standard" (lower blue box).)

 

Slide 8:

Learning Objectives

  1. Explain the need for and benefits of testing
  2. Describe how ITS standards testing fits into the overall scope of a systems test and a systems life cycle
  3. Discuss how to test an implementation for conformance to standards
  4. Distinguish the difference between standard conformance and project compliance

 

Slide 9:

What is Testing?

Two types:

1. Standards testing

- Provides information to users on the reliability, interoperability, functionality, and performance of systems using the standard

2. System's conformance to documented test plan based upon an ITS standard

- The topic of this Webinar

 

Slide 10:

Activity. Image of hand over a computer keyboard. DOT and RITA logo in lower left corner, Standards ITS Training logo in lower right corner.

 

Slide 11:

Learning Objective #1

Benefits of Testing

 

Slide 12:

Learning Objective #1

Benefits of Testing

 

Slide 13:

Learning Objective #1

Who Does the Testing?

 

Slide 14:

Terminology

 

Slide 15:

Terminology

 

Slide 16:

Learning Objective #2

Testing and the Systems Engineering Process

Testing and the Systems Engineering Process. Traceability. See extended text description below.

(Extended Text Description: Testing and the Systems Engineering Process. A graphic of the systems engineering process (SEP). The main graphic of the SEP is a V-shaped diagram in gradated blue with some additional horizontal extensions on the left and right side of the top of the V shape. Each section is separated with dark blue lines. There is a key at the lower right showing the blue separator lines, and designating them as “Decision Gate.” The left horizontal extension is labeled as “Lifecycle Processes” and include the sections “Regional Architecture” (separated by a white space) to the second section labeled “Needs Assessment,” then “Concept Selection,” (blue line) “Project Planning,” and “Systems Engineering Management Planning” (blue line). At this point the sections begin to descend the left side of the V with “Concept of Operations,” (blue line) “System Requirements,” (blue line) “High-level Design,” “Subsystem Requirements,” (blue line) “Detailed Design,” (blue line) and “Software Coding / Hardware Fabrication” (blue line) at the bottom juncture of the V shape. Underneath the bottom point of the V shape is a long thin horizontal arrow pointing to the right labeled “Time Line.” There is a long thin diagonal arrow pointing down along the left side of the V labeled “Decomposition and Definition.” From the bottom point of the V, the sections begin to ascend up the right side of the V with “Unit Testing,” (blue line) “Subsystem Integration,” (blue line) “Subsystem Verification,” (blue line) “System Integration,” (blue line) “System Verification,” (blue line) “Initial Deployment,” (blue line) “System Validation,” and (blue line) “Operations and Maintenance.” There is a long thin arrow pointing up along the right side of the V shaped labeled “Integration and Recomposition.” At this point the sections on the right “wing” of the V are labeled with “Changes and Upgrades” and (white space) “Retirement/Replacement.” Between the V shape there are a series of gray dashed arrows connecting the related sections on each left/right side of the V shape. The first arrow (top) is labeled “System Validation Plan” and connects “Concept of Operations” on the left and “System Validation” on the right. The second arrow is labeled “System Verification Plan (System Acceptance)” and connects “System Requirements” on the left and “System Verification and Deployment” on the right. The third arrow is labeled “Subsystem Verification Plan (Subsystem Acceptance)” and connects “High-Level Design” on the left and “Subsystem Verification” on the right. The last arrow (at the bottom) is labeled “Unit/Device Test Plan” and connects “Detailed Design” on the left and “Unit/Device Testing” on the right. The empty space in the middle of the V is highlighted in light blue. The right side V diagonal from "Unit Testing," through "Subsystem Verification Subsystem Integration," "System Verification System Integration," to "System Validation Initial Deployment." There is a large word "Traceability" at the top of the graphic with a curved arrow pointing downward to the highlighted space between the V shape. There is another large word "Testing" on the right side of the diagram with a curved arrow pointing into the sections of the right side of the V diagram.)

 

Slide 17:

Learning Objective #2

Testing and the Systems Engineering Process

Unit/Device Testing

Partial graphic of the middle portion of the SEP V Diagram. See extended text description below.

(Extended Text Description. Testing and Systems Engineering Process (SEP) V Diagram, middle portion. The image fades in in the left wing section beginning with “Project Planning,” (blue line representing a "Decision Gate" according to the key to the right of the V Diagram) into “Systems Engineering Management Planning” (blue line). At this point the sections begin to descend the left side of the V with “Concept of Operations,” (blue line) “System Requirements,” (blue line) “High-level Design,” “Subsystem Requirements,” (blue line) “Detailed Design,” (blue line) and “Software Coding / Hardware Fabrication” (blue line) at the bottom juncture of the V shape. There are horizontal arrows pointing from each of these left side sections to the corresponding sections on the right side. Underneath the bottom point of the V shape is a long thin horizontal arrow pointing to the right labeled “Life Cycle Time Line.” There is a long thin diagonal arrow pointing down along the left side of the V labeled “Decomposition and Definition.” From the bottom point of the V, the sections begin to ascend up the right side of the V with “Unit Testing,” (blue line) “Subsystem Integration,” (blue line) “Subsystem Verification,” (blue line) “System Integration,” (blue line) “System Verification,” (blue line) “Initial Deployment,” (blue line) “System Validation,” and (blue line) “Operations and Maintenance.” There is a long thin arrow pointing up along the right side of the V shaped labeled “Integration and Recomposition.” The sections on the right “wing” of the V begin to fade with “Changes and Upgrades.” The section "Unit Testing" on the right side and the corresponding middle space of the V Diagram is outlined in a thick red line and highlighted in light blue.)

 

Slide 18:

Learning Objective #2

Testing and the Systems Engineering Process

Subsystem Testing

Partial graphic of the middle portion of the SEP V Diagram. See extended text description below.

(Extended Text Description. Testing and Systems Engineering Process (SEP) V Diagram, middle portion. The image fades in in the left wing section beginning with “Systems Engineering Management Planning" (blue line representing a "Decision Gate" according to the key to the right of the V Diagram). At this point the sections begin to descend the left side of the V with “Concept of Operations,” (blue line) “System Requirements,” (blue line) “High-level Design,” “Subsystem Requirements,” (blue line) “Detailed Design,” (blue line) and “Software Coding / Hardware Fabrication” (blue line) at the bottom juncture of the V shape. There are horizontal arrows pointing from each of these left side sections to the corresponding sections on the right side. Underneath the bottom point of the V shape is a long thin horizontal arrow pointing to the right labeled “Life Cycle Time Line.” There is a long thin diagonal arrow pointing down along the left side of the V labeled “Decomposition and Definition.” From the bottom point of the V, the sections begin to ascend up the right side of the V with “Unit Testing,” (blue line) “Subsystem Integration,” (blue line) “Subsystem Verification,” (blue line) “System Integration,” (blue line) “System Verification,” (blue line) “Initial Deployment,” (blue line) “System Validation,” and (blue line) “Operations and Maintenance.” There is a long thin diagonal arrow pointing up along the right side of the V labeled "Integration and Recomposition." The sections on the right “wing” of the V begin to fade with “Changes and Upgrades.” The section "Subsystem Verification Subsystem Integration" on the right side and the corresponding middle space of the V Diagram is outlined in a thick red line and highlighted in light blue.)

 

Slide 19:

Learning Objective #2

Testing and the Systems Engineering Process

System Testing

Testing and Systems Engineering Process (SEP), middle portion. See extended text description below.

(Extended Text Description. Testing and Systems Engineering Process (SEP) V Diagram, middle portion. The image fades in in the left wing section beginning with “Systems Engineering Management Planning" (blue line representing a "Decision Gate" according to the key to the right of the V Diagram). At this point the sections begin to descend the left side of the V with “Concept of Operations,” (blue line) “System Requirements,” (blue line) “High-level Design,” “Subsystem Requirements,” (blue line) “Detailed Design,” (blue line) and “Software Coding / Hardware Fabrication” (blue line) at the bottom juncture of the V shape. There are horizontal arrows pointing from each of these left side sections to the corresponding sections on the right side. Underneath the bottom point of the V shape is a long thin horizontal arrow pointing to the right labeled “Life Cycle Time Line.” There is a long thin diagonal arrow pointing down along the left side of the V labeled “Decomposition and Definition.” From the bottom point of the V, the sections begin to ascend up the right side of the V with “Unit Testing,” (blue line) “Subsystem Integration,” (blue line) “Subsystem Verification,” (blue line) “System Integration,” (blue line) “System Verification,” (blue line) “Initial Deployment,” (blue line) “System Validation,” and (blue line) “Operations and Maintenance.” There is a long thin diagonal arrow pointing up along the right side of the V labeled "Integration and Recomposition." The sections on the right “wing” of the V begin to fade with “Changes and Upgrades.” The section "System Verification System Integration" on the right side and the corresponding middle space of the V Diagram is outlined in a thick red line and highlighted in light blue.)

 

Slide 20:

Learning Objective #2

IEEE 829

 

Slide 21:

Activity. Image of hand over a computer keyboard. DOT and RITA logo in lower left corner, Standards ITS Training logo in lower right corner.

 

Slide 22:

Learning Objective #3

What Should a Test Plan Cover?

 

Slide 23:

Learning Objective #3

Testing Considerations

 

Slide 24:

Learning Objective #3

Test Plans

 

Slide 25:

Learning Objective #3

Test Plan Benefits

 

Slide 26:

Learning Objective #3

Test Procedures

 

Slide 27:

Learning Objective #3

Systems Engineering Testing Phases

 

Slide 28:

Learning Objective #3

Systems Engineering Testing Phases

Prototype Test and Inspection

Design Approval Test and Inspection

 

Slide 29:

Learning Objective #3

Systems Engineering Testing Phases

Factory Acceptance Test

Incoming Device Test

 

Slide 30:

Learning Objective #3

Systems Engineering Testing Phases

Site Acceptance Test

Burn-in and Observation Test

 

Slide 31:

Learning Objective #3

Methods of Testing

Methods of Testing graphic. Please see extended text description below.

(Extended Text Description. Methods of Testing. A graph of five blue boxes with rounded corners.  The center box is labeled "Testing Methods." A light blue bi-directional arrow points to a blue box directly above labeled "Inspection." Another bi-directional arrow points to a box on the left labeled "Formal Test." Another bi-directional arrow points to a box below marked "Demonstration." Another bi-directional arrow points to a box labeled "Analysis" on the right.)

 

Slide 32:

Learning Objective #3

Methods of Testing

Inspection

 

Slide 33:

Learning Objective #3

Methods of Testing

Analysis

 

Slide 34:

Learning Objective #3

Methods of Testing

Demonstration

 

Slide 35:

Learning Objective #3

Methods of Testing

Formal testing

 

Slide 36:

Learning Objective #4

Conformance

 

Slide 37:

Learning Objective #4

Compliance

 

Slide 38:

Activity. Image of hand over a computer keyboard. DOT and RITA logo in lower left corner, Standards ITS Training logo in lower right corner.

 

Slide 39:

Learning Objective #4

Why is Conformance Necessary?

 

Slide 40:

Learning Objective #4

The Need for Conformance

 

Slide 41:

Learning Objective #4

Return on Investment

 

Slide 42:

Review of Learning Objectives

Graphic icon of a check mark in a blue circle with a silver gray outline.Explain to decision makers the need for and benefits of standardized testing.

Graphic icon of a check mark in a blue circle with a silver gray outline.Describe how ITS standards testing fits into the overall scope of a systems test and a systems life cycle.

Graphic icon of a check mark in a blue circle with a silver gray outline.Discuss how to test an implementation for conformance to standards.

Graphic icon of a check mark in a blue circle with a silver gray outline.Distinguish the difference between standard conformance and project compliance.

 

Slide 43:

Student Supplement

T101. Introduction to ITS Standards Testing. Cover graphic. Blue background with three light blue lines diagonally across the near center. Logo in lower left corner "Standards ITS Training" in white box. "Student Supplement"

 

Slide 44:

For More Information

RITA/ITS web site

http://standards.its.dot.gov/

ITE web site

http://www.ite.org/standards/

ITS Architecture Implementation Program

http://www.ops.fhwa.dot.gov/its arch imp/

NTCIP web site

http: //www.ntcip.org/

Systems Engineering Guide for ITS

http: //www.fhwa.dot.g ov/cadiv/seg b

 

Slide 45:

Curriculum Path (Testing)

Curriculum Path (Testing). See extended text description below.

(Extended Text Description. Curriculum Path (Testing). A chart showing the curriculum path for the testing topics.  A linear box chart with highlighted and blue boxes (rounded corners, embossed side edges) starting on the left with "T101 – Introduction to ITS Standards Testing" (blue box) with an arrow leading toward the right to "T101 – Introduction to ITS Standards Testing" (highlighted box) leading to the right to "T202 – Overview of Test Design Specifications, Test Cases, and Test Procedures" (blue box) with a divided arrow leading up to "T311 – Applying Your Test Plan to the NTCIP 1203 V03 DMS Standard" (blue box) and the other arrow leading down to "T313 – Applying Your Test Plan to the NTCIP 1204 V03 ESS Standard" (blue box).)

 

Slide 46:

Questions. Graphic image with word "Questions? at the top, and an image of a lit light bulb on the lower right side. Blue background. DOT logo, RITA, US Department of Transportation and Research and Innovative Technology Administration in lower left corner. Standards ITS Training logo in lower right side.