Module 30 - T321

T321: Applying Your Test Plan to TMDD Standard

HTML of the PowerPoint Presentation

(Note: This document has been converted from a PowerPoint presentation to 508-compliant HTML. The formatting has been adjusted for 508 compliance, but all the original text content is included, plus additional text descriptions for the images, photos and/or diagrams have been provided below.)

 

Slide 1:

Welcome - Graphic image of introductory slide. Please see the Extended Text Description below.

(Extended Text Description: Slide 1: Welcome - Graphic image of introductory slide. A large dark blue rectangle with a wide, light grid pattern at the top half and bands of dark and lighter blue bands below. There is a white square ITS logo box with words "Standards ITS Training" in green and blue on the middle left side. The word "Welcome" in white is to the right of the logo. Under the logo box are the words "RITA Intelligent Transportation Systems Joint Program Office.")

 

Slide 2:

Welcome

Head shot photo of Ken Leonard, Director - ITS Joint Program Office

Ken Leonard, Director

ITS Joint Program Office

Ken.Leonard@dot.gov

Screen capture snapshot of RITA website - for illustration only - see the extended text description below.

(Extended Text Description: Intro Slide: Screen capture snapshot of RITA website - for illustration only. Below this image is a link to the current website: http://www.pcb.its.dot.gov - this screen capture snapshot shows an example from the RITA website from April 2013. At the top of the page it shows the RITA logo with the text U.S. Department of Transportation Research and Innovative Technology Administration - Intelligent Transportation Systems Joint Program Office - ITS Professional Capacity Building Program/Advanced ITS Education. Below the main site banner, it shows the main navigation menu with the following items: About, ITS Training, Knowledge Exchange, Technology Transfer, ITS in Academics, and Media Library. Below the main navigation menu, the page shows various content of the website, including a graphic image of professionals seated in a room during a training program. A text overlay has the text Welcome to ITS Professional Capacity Building. Additional content on the page includes a box entitled What's New and sections entitled Available E-Training (free), Free ITS Training and T3 Webinars. Again, this image serves for illustration only. The current website link is: http://www.pcb.its.dot.gov)

www.pcb.its.dot.gov

(Note: There is additional text attached to this slide that includes the following introductory information from Ken Leonard):

"ITS Standards can make your life easier. Your procurements will go more smoothly and you'll encourage competition, but only if you know how to write them into your specifications and test them. This module is one in a series that covers practical applications for acquiring and testing standards-based ITS systems.

I am Ken Leonard, director of the ITS Joint Program Office for USDOT and I want to welcome you to our newly redesigned ITS standards training program of which this module is a part. We are pleased to be working with our partner, the Institute of Transportation Engineers, to deliver this new approach to training that combines web based modules with instructor interaction to bring the latest in ITS learning to busy professionals like yourself.

This combined approach allows interested professionals to schedule training at your convenience, without the need to travel. After you complete this training, we hope that you will tell colleagues and customers about the latest ITS standards and encourage them to take advantage of the archived version of the webinars.

ITS Standards training is one of the first offerings of our updated Professional Capacity Training Program. Through the PCB program we prepare professionals to adopt proven and emerging ITS technologies that will make surface transportation safer, smarter and greener which improves livability for us all. You can find information on additional modules and training programs on our web site www.pcb.its.dot.gov

Please help us make even more improvements to our training modules through the evaluation process. We look forward to hearing your comments. Thank you again for participating and we hope you find this module helpful."

 

Slide 3:

Activity. A placeholder graphic with an image of hand over a computer keyboard to show that an activity is taking place.

 

Slide 4:

T321:

Applying Your Test Plan to the TMDD Standard

 

Slide 5:

Instructor

Head shot photo of Patrick Chan, P.E. - Senior Technical Staff - Consensus Systems Technologies (ConSysTec) - Flushing, NY, USA

Patrick Chan, P.E.
Senior Technical Staff
Consensus Systems Technologies (ConSysTec)
Flushing, NY, USA

 

Slide 6:

Target Audience

 

Slide 7:

Recommended Prerequisite(s)

 

Slide 8:

Curriculum Path (SEP)

A flowchart showing the recommended curriculum path leading to this module. Please see the Extended Text Description below.

(Extended Text Description: A flowchart showing the recommended curriculum path leading to this module. The first box is module T101: Introduction to ITS Standards Testing. The next module in the curriculum path is T201: How to Write a Test Plan. The third recommended module is T202: Overview of Test Design Specifications, Test Cases, and Test Procedures. The fourth module is C101: Introduction to Communications Protocols and Their Uses in ITS Applications. The fifth module is A321a: Understanding User Needs for Traffic Management Systems Based on TMDD v03 Standard. The sixth module is A321b: Specifying Requirements for Traffic Management Systems Based on TMDD v03 Standard. The final module in the flow chart is this module, T321: Applying Your Test Plan to the TMDD Standard.)

 

Slide 9:

Learning Objectives

  1. Describe within the context of a testing life cycle the role of a test plan and the testing to be undertaken.
  2. Recognize the purpose, structure, and content of a well-written test plan for a TMDD-based system interface.
  3. Describe the application of a good test plan to a TMDD-based system being procured using a sample TMDD test plan.

 

Slide 10:

Learning Objectives (cont.)

  1. Identify the process to write a test plan in the context of the requirements of TMDD that have been selected by the user.
  2. Analyze how to ensure conformance with the TMDD v3.03 Standard.
  3. Describe test documentation for TMDD: Test Plan, Test Design Specification, Test Case Specifications, Test Procedure Specifications and Test Reports.

 

Slide 11:

Learning Objective #1 - Describe within the context of a testing life cycle the role of a test plan and the testing to be undertaken

 

Slide 12:

Learning Objective #1

Purpose of Testing

Why Test:

Why Test - Technically:

 

Slide 13:

Learning Objective #1

System Life Cycle

This is a figure depicting the life cycle of a system and the relationships between each process (or step) of a system life cycle. Please see the Extended Text Description below.

(Extended Text Description: This is a figure depicting the life cycle of a system and the relationships between each process (or step) of a system life cycle. The figure is laid like the letter "V", thus it is called the "VEE" diagram. Time progresses as we move from the left side of the "VEE" to the right side of the "VEE". Starting from the upper left hand corner of the "VEE" and moving right and down, the processes are Regional Architecture(s), Feasibility Study / Concept Exploration, Concept of Operations, System Requirements, High-Level Design, and Detailed Design. These processes on the left side of the "VEE" is part of the Decomposition and Definition step. At the bottom of the "VEE" is the Software / Hardware Development Field Installation Implementation process, which is called the Development Process step. Moving up the right side of the "VEE", the processes are the Unit/Device Testing, Subsystem Verification, System Verification and Deployment, System Validation, Operations and Maintenance, Changes and Upgrades, and finally Retirement/Replacement. These processes on the right side of the "VEE" is called the Integration and Recomposition step. For the completion of each process, starting with the Concept of Operations to the completion of the System Verification and Deployment process, a document is produced or some type of formal approval is expected before continuing onto the next process. Verification or validation is expected between the processes on the left side of the "VEE" and the right side "VEE", and are indicated by dotted lines with arrows on the end between them. There is a dotted line between the Concept of Operations on the left and the System Validation on the right, labeled System Validation Plan. This indicates that testing of the Concept of Operations is performed in the System Validation Plan during the System Validation process. The next dotted line is between the Systems Requirements on the left and System Verification & Deployment on the right, and the line is labeled System Verification Plan, or in parentheses, System Acceptance. The next dotted line is between the High-Level Plan and the Subsystem Verification and it is labeled Subsystem Verification Plan, or in parentheses, Subsystem Acceptance. The last dotted line is between the Detailed Design and the Unit/Device Testing, and it is labeled Unit/Device Test Plan. The discussion for this slide focuses on the left side of the "VEE" diagram, so the left side is circled in red.)

 

Slide 14:

Learning Objective #1

System Life Cycle

This is the same figure as in Slide 13, depicting the life cycle of a system and the relationships between each process (or step) of a system life cycle. Please see the Extended Text Description below.

(Extended Text Description: This is the same figure as in Slide 13, depicting the life cycle of a system and the relationships between each process (or step) of a system life cycle, so see Slide 13 for a description.  However, the discussion for this slide focuses on the right side of the "VEE" diagram, so the right side is circled in red, with the label Testing Phase.)

 

Slide 15:

Learning Objective #1

Testing Process

IEEE 829:

 

Slide 16:

Learning Objective #1

Review of Testing

This is a figure showing a snapshot of a portion of the VEE diagram. Please see the Extended Text Description below.

(Extended Text Description: This is a figure showing a snapshot of a portion of the "VEE" diagram, showing the Concept of Operations process on the left side of the "VEE" and the System Validation process on the right side of the "VEE" diagram, with a dotted line labeled System Validation Plan between the two processes.)

Validation

 

Slide 17:

Learning Objective #1

Review of Testing (Cont.)

Verification

This is a figure showing a snapshot of a portion of the VEE diagram. Please see the Extended Text Description below.

(Extended Text Description: This is a figure showing a snapshot of a portion of the "VEE" diagram, showing the Detailed Design process on the left side of the "VEE" and the Unit/Device Testing process on the right side of the "VEE" diagram, with a dotted line labeled Unit/Device Test Plan between the two processes.)

 

Slide 18:

Learning Objective #1

Review of Testing (Cont.)

Verification

This is a figure showing a snapshot of a portion of the VEE diagram. Please see the Extended Text Description below.

(Extended Text Description: This is a figure showing a snapshot of a portion of the "VEE" diagram, showing the process System Requirements on the left side of the "VEE" and the System Verification & Deployment process on the right side of the "VEE" diagram, with a dotted line labeled System Verification Plan, with System Acceptance in parentheses, between the two processes. The figure also shows the High-Level Design on the left side of the "VEE" and the Subsystem Verification process on the right side of the "VEE" diagram, with a dotted line labeled Subsystem Verification Plan, with Subsystem Acceptance in parentheses, between the two processes.)

 

Slide 19:

Activity. A placeholder graphic with an image of hand over a computer keyboard to show that an activity is taking place.

 

Slide 20:

Learning Objective #1

Which of the following is NOT a reason to perform testing?

Answer Choices

  1. Develop Concept of Operations
  2. Verify requirements are fulfilled
  3. Validate the user needs are satisfied
  4. Assess a system upgrade versus the existing system

 

Slide 21:

Learning Objective #1

Review of Answers

A small graphical green and yellow check mark representing correct.a) Develop Concept of Operations
Correct, ConOps belongs in the definition phase of the system life cycle.

A small graphical red and yellow X representing incorrect.b) Verify requirements are fulfilled
Incorrect, this is a reason for testing.

A small graphical red and yellow X representing incorrect.c) Validate the user needs are satisfied
Incorrect, this is a reason for testing.

A small graphical red and yellow X representing incorrect.d) Assess a system upgrade against the existing system
Incorrect, this is a reason for testing.

 

Slide 22:

Summary of Learning Objective #1

Describe within the context of a testing life cycle the role of a test plan and the testing to be undertaken

 

Slide 23:

Learning Objective #2 - Recognize the Purpose, Structure, and Content of a Well-Written Test Plan for a TMDD-based System Interface

 

Slide 24:

Learning Objective #2

What is a Test Plan?

IEEE 829 Defines a Test Plan as:

Test Plans are not defined in the TMDD standard

 

Slide 25:

Learning Objective #2

Test Plans

A Test Plan is a high-level plan that defines:

 

Slide 26:

Learning Objective #2

Types of Test Plans

 

Slide 27:

Learning Objective #2

Approach to Test Plans

 

Slide 28:

Learning Objective #2

Approach to Test Plans (cont.)

 

Slide 29:

Learning Objective #2

Test Environment

A figure with three graphics. Please see the Extended Text Description below.

(Extended Text Description: A figure with three graphics. One graphic depicts a management center labeled System Under Test (SUT), a second graphic depicts a different management center labeled External Center, and third graphic depicts a computer, labeled Test Software. Between the three graphics is a cloud labeled Communications. There is a line with arrows on each end between each management center, to depict information exchanges between management centers and the communications cloud. There is also a dotted line between the Test Software and the communications cloud to indicate that the Test Software can "read" the information exchanges in the communications cloud.)

 

Slide 30:

Learning Objective #2

Test Plan Deliverables

 

Slide 31:

Learning Objective #2

Example Framework for Test Documentation

A figure showing a diagram similar to an organization chart. Please see the Extended Text Description below.

(Extended Text Description: A figure showing a diagram similar to an organization chart. On top is a box labeled Test Plan, with a smaller box inside labeled Document for Project. From this box is a line pointing to another box below it labeled Test Design Specification, with a smaller box inside labeled For TMDD Interface. From this box are three lines pointing to three different boxes in a single row below it, each labeled Test Case Specification. Within each of these three boxes is a smaller box labeled (# m, nn), to indicate multiple Test Case Specifications. Below the row of Test Case Specifications is another row of three boxes, each labeled Test Procedure Specification, and within each box is a smaller box labeled (# m, nn), to indicate multiple Test Procedure Specifications. There are multiple lines pointing from each Test Case Specification to different Test Procedures Specifications.)

 

Slide 32:

Learning Objective #2

Test Plan - Staff and Resources

 

Slide 33:

Learning Objective #2

Test Plan - Schedule, Risk, Approvals

 

Slide 34:

Activity. A placeholder graphic with an image of hand over a computer keyboard to show that an activity is taking place.

 

Slide 35:

Learning Objective #2

Which of the following does NOT belong in a well-written test plan?

Answer Choices

  1. Testing Environment
  2. Testing Plan Staff Requirements
  3. Pass/Fail Criteria
  4. Sequence of Actions to be Performed

 

Slide 36:

Learning Objective #2

Review of Answers

A small graphical red and yellow X representing incorrect.a) Testing Environment
Incorrect, the testing environment is defined in a test plan.

A small graphical red and yellow X representing incorrect.b) Testing Plan Staff Requirements
Incorrect, staffing requirements are defined in a test plan.

A small graphical red and yellow X representing incorrect.c) Pass/Fail Criteria
Incorrect, the pass/fail criteria is part of a test plan.

A small graphical green and yellow check mark representing correct.d) Sequence of Actions to be Performed
Correct, the sequence of actions to be performed are part of the Test Procedures Specifications.

 

Slide 37:

Summary of Learning Objective #2

Recognize the purpose, structure, and content of a well-written test plan for a TMDD-based system interface

 

Slide 38:

Learning Objective #3 - Describe the application of a good test plan to a TMDD-based system being procured using a sample TMDD test plan

 

Slide 39:

Learning Objective #3

Traffic Management Data Dictionary (TMDD)

What is TMDD?

A figure with three boxes showing the interfaces between the External Center (EC), which is box one, the Owner Center (OC) or Traffic Management Center (TMC), which is box two, and Field Devices, which is box three. Please see the Extended Text Description below.

(Extended Text Description: A figure with three boxes showing the interfaces between the External Center (EC), which is box one, the Owner Center (OC) or Traffic Management Center (TMC), which is box two, and Field Devices, which is box three. The External Center and Owner Center (OC) or Traffic Management Center (TMC) are in blue boxes, to indicate centers, while the Field Devices box is yellow, to indicate field devices. There is a line between the two center boxes and is labeled Center-to-Center Messages, and a line between the Owner Center (OC) or Traffic Management Center (TMC) box and the Field Devices box and is labeled Center-to-Field. A graphic of a person labeled EC Operator is shown with a line to the External Center (EC) box and a graphic of a person labeled OC or TMC Operator is shown with a line to the Owner Center (OC) or Traffic Management Center (TMC) box.)

 

Slide 40:

Learning Objective #3

Content of the TMDD

Recall Structure of the Standard

 

Slide 41:

Learning Objective #3

Content of the TMDD (cont.)

 

Slide 42:

Learning Objective #3

Test Plan for a TMDD-based System

What are we testing?

 

Slide 43:

Learning Objective #3

Testing a TMDD-based System (cont.)

What is being tested?

 

Slide 44:

Learning Objective #3

Testing a TMDD-based System (cont.)

T321 module does not directly address:

 

Slide 45:

Learning Objective #3

Example Test Plan for a TMDD-based System

Introduction and Test Items

 

Slide 46:

Learning Objective #3

Example Test Plan for a TMDD-based System

 

Slide 47:

Learning Objective #3

Example Test Plan for a TMDD-based System

Needs To Requirements Matrix (NRTM)

A table showing a completed Needs to Requirements Matrix (NRTM). Please see the Extended Text Description below.

(Extended Text Description: A table showing a completed Needs to Requirements Matrix (NRTM). The table contents are shown below:

UN ID User Need   Requirement ID Requirement Conformance Support Other Requirements
2.3.2 Need to Provide Information on Organizations, Centers, and Contacts Optional Yes/No  
    Dialogs
  3.3.2.1 Send Organization Information Upon Request M Yes The owner center shall respond within ___ (100 ms - 1 hour; Default = 1 minute) after receiving the request.
  3.3.2.2 Publish Organization Information Subscription:O Yes/No/NA The owner center shall begin sending the updated response message within ___ (100 ms - 24 hours: Default = 15 minutes) after the information is updated in the owner center.
  3.3.2.3 Subscribe to Organization Information Subscription:O Yes/No/NA  
Request Message
  3.3.2.4 Contents of the Organization Information Request M Yes  
  3.3.2.4.1 Required Organization Information Request Content M Yes  
  3.3.2.4.2.1 Authentication - Organization Information (AuthOrg) O Yes/No  
  3.3.2.4.2.1.1 Operator Identifier - Organization Information AuthOrg:O Yes/No/NA  
  3.3.2.4.2.2 Owner Organization Identifier O Yes/No  
  3.3.2.4.2.3 Owner Center Identifier O Yes/No  
Response Message
  3.3.2.5 Contents of the Organization and Centers Information M Yes  
  3.3.2.5.1 Required Organization Information Content M Yes  
  3.3.2.5.2.1 Organization Name O Yes/No  
  3.3.2.5.2.2 Organization Location O Yes/No  
  3.3.2.5.2.3 Organization Function Description O Yes/No  
  3.3.2.5.2.4 Organization Contact Information O Yes/No  

Please note that in the graphical version of the table, the following items are circled in the "Support" column for this example, starting from top to bottom: Yes, Yes, No, No, Yes, Yes, No, No, Yes, Yes, Yes, Yes, Yes, Yes, Yes.)

 

Slide 48:

Learning Objective #3

Example Test Plan for a TMDD-based System

 

Slide 49:

Learning Objective #3

Example Test Plan for a TMDD-based System

 

Slide 50:

Learning Objective #3

Example Test Plan for a TMDD-based System

 

Slide 51:

Learning Objective #3

Example Test Plan for a TMDD-based System

 

Slide 52:

Learning Objective #3

Example Test Plan for a TMDD-based System

 

Slide 53:

Learning Objective #3

Example Test Plan for a TMDD-based System

 

Slide 54:

Learning Objective #3

Example Test Plan for a TMDD-based System

 

Slide 55:

Learning Objective #3

Example Test Plan for a TMDD-based System

 

Slide 56:

Activity. A placeholder graphic with an image of hand over a computer keyboard to show that an activity is taking place.

 

Slide 57:

Learning Objective #3

Which of the following is NOT in the TMDD Standard v3.03?

Answer Choices

  1. Needs to Requirements Traceability Matrix
  2. Requirements Traceability Matrix
  3. Requirements to Test Case Traceability Matrix
  4. A single design to fulfill each requirement

 

Slide 58:

Learning Objective #3

Review of Answers

A small graphical red and yellow X representing incorrect.a) Needs to Requirements Traceability Matrix
Incorrect, a NRTM is included in the Standard.

A small graphical red and yellow X representing incorrect.b) Requirements Traceability Matrix
Incorrect, an RTM is included in the Standard.

A small graphical green and yellow check mark representing correct.c) Requirements to Test Case Traceability Matrix
Correct, this Matrix is not included in the Standard.

A small graphical red and yellow X representing incorrect.d) A single design to fulfill each requirement
Incorrect, a single design is defined for each requirement in the Standard.

 

Slide 59:

Summary of Learning Objective #3

Describe the application of a good test plan to a TMDD-based system being procured using a sample TMDD test plan

 

Slide 60:

Learning Objective #4 - Identify the process to write a test plan in the context of the requirements of TMDD that have been selected by the user

 

Slide 61:

Learning Objective #4

Process to Writing TMDD-based Test Plans

NRTM

This figure is the exact same figure in Slide 47. Please see the Extended Text Description below.

(Extended Text Description: This figure is the exact same figure in Slide 47, which is the table showing a completed Needs to Requirements Matrix (NRTM). Please see Slide 47 for detailed text description.)

 

Slide 62:

Learning Objective #4

Process to Writing TMDD-based Test Plans (cont.)

RTM

 

Slide 63:

Learning Objective #4

Process to Writing TMDD-based Test Plans (cont.)

RTM

This figure is a table showing a Requirements to Traceability Matrix. Please see the Extended Text Description below.

(Extended Text Description: This figure is a table showing a Requirements to Traceability Matrix. The table headings are Req. ID (Vol. I), Requirement, Dialog, DC Type, Definition Class Name, DC ID (Vol. II), and Data Concept Instance Name. The focus of this slide is only on the first 3 columns, so the remaining columns are shaded. The complete table is shown below:

Req ID (Vol. I) Requirement Dialog DC Type Definition Class Name DC ID (Vol. II) Data Concept Instance Name
3.3.5.5.1.1 Send DMS Inventory Information Upon Request 2.4.1 dialog dlDMSInventoryRequest 3.1.6.1 dlDMSInventoryRequest
3.3.5.5.1.2 Publish DMS Inventory Information 2.4.2 dialog dlDMSInventoryUpdate 3.1.24.1 dlDMSInventoryUpdate
3.3.5.5.1.3 Subscribe to DMS Inventory Information 2.4.3 dialog dlDeviceInformationSubscription 3.1.5.3 dlDeviceInformationSubscription
3.3.5.5.1.4 Contents of the DMS Inventory Request   message deviceInformationRequestMsg 3.2.5.4 deviceInformationRequestMsg
3.3.5.5.1.5 Contents of the DMS Inventory Information   message dMSInventoryMsg 3.2.6.4 dMSInventoryMsg
3.3.5.5.1.5.1 Required DMS Inventory Content   data-frame deviceInventoryHeader 3.3.5.8 device-inventory-header
3.3.5.5.1.5.1 Required DMS Inventory Content   data-element dmsSignType 3.6.3.25 dms-sign-type
3.3.5.5.1.5.2.1 Sign Technology   data-element dmsSignTechnology 3.6.2.21 signTechnology

)

 

Slide 64:

Learning Objective #4

Process to Writing TMDD-based Test Plans (cont.)

RTM

This figure is a table showing the same Requirements to Traceability Matrix in Slide 63. Please see the Extended Text Description below.

(Extended Text Description: This figure is a table showing the same Requirements to Traceability Matrix in Slide 63. The table headings are Req. ID (Vol. I), Requirement, Dialog, DC Type, Definition Class Name, DC ID (Vol. II), and Data Concept Instance Name. The focus of this slide is only on the last 4 columns, so the first 3 columns are shaded. Please see Slide 63 for the complete table data.)

 

Slide 65:

Learning Objective #4

Process to Writing TMDD-based Test Plans (cont.)

RTM

This figure is a table showing the same Requirements to Traceability Matrix in Slide 63. Please see the Extended Text Description below.

(Extended Text Description: This figure is a table showing the same Requirements to Traceability Matrix in Slide 63. The table headings are Req. ID (Vol. I), Requirement, Dialog, DC Type, Definition Class Name, DC ID (Vol. II), and Data Concept Instance Name. The focus of this slide is only on the first 3 rows, so the last 5 rows are shaded. Please see Slide 63 for the complete table data.)

 

Slide 66:

Learning Objective #4

Process to Writing TMDD-based Test Plans (cont.)

RTM

This figure is a table showing the same Requirements to Traceability Matrix in Slide 63. Please see the Extended Text Description below.

(Extended Text Description: This figure is a table showing the same Requirements to Traceability Matrix in Slide 63. The table headings are Req. ID (Vol. I), Requirement, Dialog, DC Type, Definition Class Name, DC ID (Vol. II), and Data Concept Instance Name. The focus of this slide is only on the last 5 rows, so the first 3 rows are shaded. Please see Slide 63 for the complete table data.)

 

Slide 67:

Learning Objective #4

Process to Writing TMDD-based Test Plans (cont.)

Design

3.1.6.1.2 ASN.1 REPRESENTATION

dlDMSInventoryRequest ITS-INTERFACE-DIALOGUE ::= {

DESCRIPTIVE-NAME "ExternalCenter<-DlDMSInventoryRequest->OwnerCenter"

ASN-NAME "DlDMSInventoryRequest"

ASN-OBJECT-IDENTIFIER { tmddDialogs 16 }

URL "R-R.gif"

DEFINITION "A request-response dialog that allows an external center to request an owner center to provide an inventory of the owner center's dynamic message signs."

DESCRIPTIVE-NAME-CONTEXT {"Manage Traffic"}

ARCHITECTURE-REFERENCE {"device data"}

ARCHITECTURE-NAME {"U.S. National ITS Architecture"}

ARCHITECTURE-VERSION {"7.0"}

DATA-CONCEPT-TYPE interface-dialogue

STANDARD "TMDD" REFERENCED-MESSAGES {

{ tmddMessages 20 }, -- deviceInformationRequestMsg (Input Message)

{ tmddMessages 25 }, -- dMSInventoryMsg (Output Message)

{ tmddMessages 10 } --errorReportMsg (Fault Message) }

 

Slide 68:

Learning Objective #4

Process to Writing TMDD-based Test Plans (cont.)

Design

The figure is a Unified Modeling Language (UML) sequence diagram representing the dlDMSInventoryRequest dialog. Please see the Extended Text Description below.

(Extended Text Description: The figure is a Unified Modeling Language (UML) sequence diagram representing the dlDMSInventoryRequest dialog. A box in the upper left hand corner labeled External Center indicates that the left side is the External Center and a box in the upper right hand corner labeled Owner Center indicates that the right side is the Owner Center. Time is represented by moving down the diagram. Under the boxes, is a line is from the left side pointing to the right side, labeled deviceInformationRequestMsg, indicating a deviceInformationRequestMsg is being transmitted from the External Center to the Owner Center. Below that first line is another line from the right side pointing to the left side labeled dMSInventoryMsg, indicating that at a later time, the dMSInventoryMsg is transmitted back from the Owner Center to the External Center in response to the deviceInformationRequestMsg. A second set of lines shows the sequence of messages upon error. This second set of lines begin with a line from the left side pointing to the right side, labeled deviceInformationRequestMsg, indicating a deviceInformationRequestMsg is being transmitted from the External Center to the Owner Center. Below that first line is another line from the right side pointing to the left side labeled errorReportMsg, indicating that at a later time, the errorReportMsg is transmitted back from the Owner Center to the External Center in response to the deviceInformationRequestMsg.)

 

Slide 69:

Learning Objective #4

Process to Writing TMDD-based Test Plans (cont.)

Requirements to Test Case Traceability Matrix

 

Slide 70:

Learning Objective #4

Process to Writing TMDD-based Test Plans (cont.)

Requirements to Test Case Traceability Matrix

Requirement Test Case
ID Title ID Title
3.3.2.1 Send Organization Information Upon Request
    TCS-1.2.1 Verify Organization Information with No Errors
    TCS-1.2.2 Verify Organization Information with Errors
3.3.2.4 Contents of the Organization Information
    TCS-1.2.1 Verify Organization Information with No Errors
    TCS-1.2.2 Verify Organization Information with Errors

 

Slide 71:

Activity. A placeholder graphic with an image of hand over a computer keyboard to show that an activity is taking place.

 

Slide 72:

Learning Objective #4

Which of the following is part of the Requirements to Test Case Traceability Matrix?

Answer Choices

  1. User Needs
  2. Requirements
  3. Design
  4. Test Plans

 

Slide 73:

Learning Objective #4

Review of Answers

A small graphical red and yellow X representing incorrect.a) User Needs
Incorrect, user needs only appear in a NRTM.

A small graphical green and yellow check mark representing correct.b) Requirements
Correct, requirements are part of the matrix.

A small graphical red and yellow X representing incorrect.c) Design
Incorrect, design only appears in an RTM.

A small graphical red and yellow X representing incorrect.d) Test Plans
Incorrect, Test Cases are part of the RTCTM.

 

Slide 74:

Summary of Learning Objective #4

Identify the process to write a test plan in the context of the requirements of TMDD that have been selected by the user

 

Slide 75:

Learning Objective #5 - Analyze how to ensure conformance with the TMDD v3.03 Standard

 

Slide 76:

Learning Objective #5

Conformance for a TMDD-based System

 

Slide 77:

Learning Objective #5

Conformance for a TMDD-based System

 

Slide 78:

Learning Objective #5

Conformance for a TMDD-based System

 

Slide 79:

Learning Objective #5

Conformance for a TMDD-based System

 

Slide 80:

Learning Objective #5

Conformance for a TMDD-based System

 

Slide 81:

Learning Objective #5

Conformance for a TMDD-based System

 

Slide 82:

Learning Objective #5

Conformance for a TMDD-based System

 

Slide 83:

Learning Objective #5

Conformance for a TMDD-based System

 

Slide 84:

Learning Objective #5

Conformance for a TMDD-based System

When adding extensions:

 

Slide 85:

Activity. A placeholder graphic with an image of hand over a computer keyboard to show that an activity is taking place.

 

Slide 86:

Learning Objective #5

Which of the following is permitted by the TMDD Standard?

Answer Choices

  1. Create a new message to fulfill a new requirement
  2. Change the meaning of an existing data element
  3. Create a new data element using an existing data element name
  4. Modify an existing dialog

 

Slide 87:

Learning Objective #5

Review of Answers

A small graphical green and yellow check mark representing correct.a) Create a new message to fulfill a new requirement
Correct, creating a new message to fulfill a new requirement is allowed.

A small graphical red and yellow X representing incorrect.b) Change the meaning of an existing data element
Incorrect, changing the meaning of an existing data element is not permitted.

A small graphical red and yellow X representing incorrect.c) Create a new data element using an existing data element name
Incorrect, reusing the name of an existing data concept for a new data concept is not permitted.

A small graphical red and yellow X representing incorrect.d) Modify an existing dialog
Incorrect, modifying an existing dialog is not permitted.

 

Slide 88:

Summary of Learning Objective #5

Analyze how to ensure conformance with the TMDD v3.03 Standard

 

Slide 89:

Learning Objective #6 - Describe test documentation for TMDD: Test Plan, Test Design Specification, Test Case Specifications, and Test Reports

 

Slide 90:

Learning Objective #6

Test Documentation for a TMDD-based System

 

Slide 91:

Learning Objective #6

Test Documentation for a TMDD-based System (cont.)

"V" Element TMDD Document TMDD-based Test Document
Concept of Operations Needs To Requirements Matrix Basis for Test Plan
System Requirements Requirements Traceability Matrix Basis for Test Design Specifications
High-Level & Detailed Design Dialogs, messages, data frames, and data elements Basis for Test Case Specifications and Test Procedure Specifications
Implementation Not Applicable Basis for Test Execution and Resulting Test Reports

 

Slide 92:

Learning Objective #6

Test Documentation for a TMDD-based Syst em

This figure is a diagram showing the relationship between the different test documents. Please see the Extended Text Description below.

(Extended Text Description: This figure is a diagram showing the relationship between the different test documents. The first row of boxes represents a Test Plan, with a large box labeled Master Test Plan (organized by test phase), and within that box are 4 smaller boxes, labeled Unit Test, Integration Test, System Acceptance Test, and Periodic Maintenance Test. The next row represents Test Design Specifications and contains four boxes. There is a line leading from the first box in the first row to the first box in the second row, a line from the second box in the first row to the second box in the second row, etc... The first box is the second row is labeled Test Design Unit Test, the second box is Test Design Integration Test, the third box is Test Design System Acceptance, and the fourth box is labeled Test Design Periodic Maintenance. The third row of boxes represents Test Case Specifications and consists of a large box, with five smaller boxes within it. The smaller boxes are labeled Test Case 001, Test Case 002, Test Case 003, Test Case 004, and Test Case N. There are random lines from the four smaller boxes in the second row to the different smaller boxes in the third row. The fourth row represents Test Procedure Specifications and contains of a large box, with two smaller boxes within it. The first small box is labeled Test Procedure 001, and the second small box is labeled Test Procedure 002. There are lines from Test Case 001, Test Case 002, and Test Case 003 to Test Procedure 001, and lines from Test Case 004 and Test Case N to Test Procedure 002. The next row represents Test Execution and is an oval labeled Test Plan Execution (Process). The last two rows represent Test Reports. The first row of the Test Reports has two boxes, one labeled Test Logs and the other labeled Test Incident Reports. There is a line from Test Plan Execution (Process) to Test Logs and Test Incident Reports. The last row is a box labeled Test Plan Execution Summary Report, and there is a line from Test Logs and Test Incident Reports to this box.)

 

Slide 93:

Learning Objective #6

Test Documentation for a TMDD-based System (cont.)

 

Slide 94:

Learning Objective #6

Test Design Specifications

 

Slide 95:

Learning Objective #6

Example Test Design Specification for a TMDD-based System

Example Test Design Specification for a TMDD-based Syste. Please see the Extended Text Description below.

(Extended Text Description: This table shows an Example Test Design Specification for a TMDD-based System. For the purposes of this slide, the following two rows are highlighted: ID/Title and Approach Refinement. The complete table data is shown below:

Test Design Specification
ID: TD-TMDD-015 Title: Need to Share DMS Status and Control
Approach Refinement
  • Automated test scripts will be used
  • Communications configuration tables
Features to be Tested Test Identification
ID Title ID Title
3.3.5.5.1.1 Send DMS Inventory Information Upon Request
    TC-TMDD-020 Need to Share DMS Inventory (With No Errors)
    TC-TMDD-021 Need to Share DMS Inventory (With Errors)
3.3.5.5.1.4 Contents of the DMS Inventory Request
    TC-TMDD-020 Need to Share DMS Inventory (With No Errors)
    TC-TMDD-021 Need to Share DMS Inventory (With Errors)
3.3.5.5.1.5 Contents of the DMS Inventory Information
    TC-TMDD-020 Need to Share DMS Inventory (With No Errors)
    TC-TMDD-021 Need to Share DMS Inventory (With Errors)
Feature Pass-Fail Criteria This test design is passed if: 1) the dialogs represented in TC-TMDD-020 and TC-TMDD-021 complete round trip communications per test procedures TPS-TMDD-021 and TP-TMDD-002; and 2) the data content of dialog responses are verified correct against the project XML schema.

)

 

Slide 96:

Learning Objective #6

Example Test Design Specification for a TMDD-based System

Example Test Design Specification for a TMDD-based System. Please see the Extended Text Description below.

(Extended Text Description: This slide contains the same table shown in Slide 95, only different rows and cells are highlighted. In this slide, the three rows related to ID 3.3.5.5.1.1 and the cell to the right of Feature Pass-Fail Criteria are highlighted. Please see Slide 95 for the complete table contents.)

 

Slide 97:

Learning Objective #6

Test Case Specification

 

Slide 98:

Learning Objective #6

Test Case Specification

Test Case Specification. Please see the Extended Text Description below.

(Extended Text Description: This table is entitled Test Case Specification. For the purposes of this slide, the following two rows are highlighted: ID/Title and Test Case Objectives. The complete table data is shown below:

Test Case Specification
ID: TC-TMDD-020 Title: Need to Share DMS Inventory
Test Case Objectives To verify the ability for an owner center and an external center to exchange the inventory and configuration of the dynamic message signs operated by the owner center.
Test Items
  • REQ 3.3.5.5.1.1 - Send DMS Inventory Information Upon Request
  • REQ 3.3.5.5.1.4 - Contents of the DMS Inventory Request
  • REQ 3.3.5.5.1.5 - Contents of the DMS Inventory Information
Input Specifications TCI-TMDD-020-1 - Need to Share DMS Inventory Inputs
Output Specifications TCO-TMDD-020-1 - Need to Share DMS Inventory Outputs
Environmental Needs No additional needs outside of those specified in the test plan
Special Procedure Requirements None
Intercase Dependencies Perform test case TC-TMDD-019, Need to Share Updated DMS Inventory to set up a subscription.

)

 

Slide 99:

Learning Objective #6

Test Case Specification

Test Case Specification. Please see the Extended Text Description below.

(Extended Text Description: This slide contains the same table shown in Slide 98, only different rows are highlighted. In this slide, the three rows related to Test Items, Input Specifications, and Output Specifications are highlighted. Please see Slide 98 for the complete table contents.)

 

Slide 100:

Learning Objective #6

Test Case Specification

Test Case Specification. Please see the Extended Text Description below.

(Extended Text Description: This slide contains the same table shown in Slide 98, only different rows are highlighted. In this slide, the three rows related to Environmental Needs, Special Procedure Requirements, and Intercase Dependencies are highlighted. Please see Slide 98 for the complete table contents.)

 

Slide 101:

Learning Objective #6

Example Test Case Input Specification for a TMDD-based System

Example Test Case Input Specification for a TMDD-based System. Please see the Extended Text Description below.

(Extended Text Description: This table shows an Example Test Case Input Specification for a TMDD-based System. For the purposes of this slide, the following two column data are highlighted: FR ID and DC Type. The complete table data is shown below:

Test Case Input Specification
ID: TCI-TMDD-020-1 Title: Need to Share DMS Inventory Inputs
FR ID DC Type DC Instance Name DC ID Value
Dialog (For Reference Only)
3.3.5.5.1.1 dialog dlDMSInventoryRequest 3.1.6.1 -
Request Message
3.3.5.1.1.1 message deviceInformationRequestMsg 3.2.5.4 -
3.3.5.1.1.1.1 data-frame organization-information 3.3.16.3 -
  data-element organization-id 3.4.16.8 Center5
3.3.5.1.1.1.1 data-element device-type 3.4.5.15 Enumerated. dynamic-message-sign (3)
3.3.5.1.1.1.1 data-element device-information-type 3.4.5.7 Enumerated. device-inventory (1)
3.3.5.5.1.4 message deviceInformationRequestMsg 3.2.5.4  

)

 

Slide 102:

Learning Objective #6

Example Test Case Input Specification for a TMDD-based System

Example Test Case Input Specification for a TMDD-based System. Please see the Extended Text Description below.

(Extended Text Description: This slide contains the same table shown in Slide 101, only different columns are highlighted. In this slide, the three columns related to DC Instance Name, DC ID, and Value are highlighted. Please see Slide 101 for the complete table contents.)

 

Slide 103:

Learning Objective #6

Example Test Case Specification for a TMDD-based System

Test Case Output Specification
ID: TCO-TMDD-020-1 Title: Need to Share DMS Inventory Inputs
FR ID DC Type DC Instance Name DC ID Value Domain
Dialog (For Reference Only)
3.3.5.5.1.1 dialog dlDMSInventoryRequest 3.1.6.1 -
Response Message
3.3.5.1.2.1 data-frame deviceInventoryHeader 3.3.5.8 -
3.3.5.1.2.1.1 data-frame organization-information 3.3.16.3 -
3.3.5.1.2.1.1 data-element device-id 3.4.16.8 AgencyA-DMS-006
3.3.5.1.2.1.1 data-frame device-location 3.6.9.4 -
3.3.5.1.2.1.1 data-element device-name 3.4.16.9 DMSI-495NB-MM128.3
3.3.5.5.1.5 message dMSInventoryMsg 3.2.6.4 -
3.3.5.5.1.5.1 data-frame device-inventory-header 3.3.5.8 -
3.3.5.5.1.5.1 data-frame dms-sign-type 3.6.3.35 Enumerated. Should be: vmsLine (5)

 

Slide 104:

Learning Objective #6

Test Procedure Specification

 

Slide 105:

Learning Objective #6

Example Test Procedure Specification for a TMDD-based System

Example Test Procedure Specification for a TMDD-based System. Please see the Extended Text Description below.

(Extended Text Description: This table shows an Example Test Procedure Specification for a TMDD-based System. For the purposes of this slide, the following four rows are highlighted: ID/Title, Scope, Special Requirements and the row below Preconditions. The complete table data is shown below:

Test Procedure
ID: TPS-TMDD-021 Title: Need to Share DMS Inventory Procedures
Scope This test procedure verifies that the dlDMSInventoryRequest dialog of an Owner Center system interface is implemented properly. It tests when a deviceInformationRequestMsg is sent to an owner center, that the owner center responds with an dMSInventoryMsg response message.
Special Requirements None
Preconditions
1. Verify that the XML Request Message is valid against Project XML Schema
2. Verify that the WSDL for the Dialog to be tested is correct
Step Test Procedure Results References
1 CONFIGURE: Determine the identifier, location, name, and type of the dynamic message sign (per the Owner Center's database) being requested from the Owner Center. RECORD that information as, respectively: dms_id, dms_location, dms_name, dms_type    
2 SETUP: Check the deviceInformationRequestMsg inputs so:
>organization-id = "Center5"
>device-type = "dynamic-message-sign (3)"
>device-information-type = "device-inventory (1)"
  TCI-TMDD-020-1
3 SETUP: Start HTTP Client    
4 Load XML deviceInformationRequestMsg    
5 Send XML deviceInformationRequestMsg to Owner Center Pass / Fail TMDD Vol. II (3.1.6.1)
6 Receive XML dMSInventoryMsg from Owner Center Pass / Fail TMDD Vol. II (3.1.6.1)
7 Log XML dMSInventoryMsg from Owner Center to a log file.    

)

 

Slide 106:

Learning Objective #6

Example Test Procedure Specification for a TMDD-based System

Example Test Procedure Specification for a TMDD-based System. Please see the Extended Text Description below.

(Extended Text Description: This slide contains the same table shown in Slide 105, only different rows are highlighted. In this slide, the seven rows under Step are highlighted. Please see Slide 105 for the complete table contents.)

 

Slide 107:

Activity. A placeholder graphic with an image of hand over a computer keyboard to show that an activity is taking place.

 

Slide 108:

Learning Objective #6

Example TMDD Dialog. Please see the Extended Text Description below.

(Extended Text Description: This slide contains an Example TMDD Dialog with the following text:

Example TMDD Dialog

3.1.37.2 dlVideoSwitchStatusUpdate

3.1.37.2.1 PRE CONDITIONS

An owner center shall provide updates to an external center upon acceptance of a dlDevicelnformationSubscription dialog.

3.1.37.2.2 DIALOG REFERENCE

See Clause 2.4.3 Generic Publication Update Dialog

3.1.37.2.3 ASN.1 REPRESENTATION

dlVideoSwitchStatusUpdate ITS-INTERFACE-DIALOGUE {

DESCRIPTIVE-NAME "OwnerCenter<-DlVideoSwitchStatusUpdate->ExternalCenter"

ASN-NAME "DlVideoSwitchStatusUpdate"

ASN-OBJECT-IDENTIFIER { tmddDialogs 122 }

URL "Pub.gif"

DEFINITION "A publication dialog that allows an owner center to provide status updates to an external center on the owner center's video switches."

DESCRIPTIVE-NAME-CONTEXT {"Manage Traffic"}

ARCHITECTURE-REFERENCE { "emergency traffic control information",
"device status",
"field equipment status" }

ARCHITECTURE-NAME {"U.S. National ITS Architecture"}

ARCHITECTURE-VERSION {"7.0"} DATA-CONCEPT-TYPE interface-dialogue

STANDARD "TMDD"

REFERENCED-MESSAGES {
{ tmddMessages 85 }, -- videoSwitchStatusMsg (Input Message)
{ c2cMessages c2cMessageReceipt(1) }, --c2cMessageReceipt (Output Message)
{ tmddMessages 10 } -- errorReportMsg (Fault Message)}

Additional descriptive notes: Please note that on the example graphical slide, there are two red ovals encircling the first five lines of text starting with 3.1.37.2 and the bottom four lines of text starting with REFERENCED-MESSAGES.)

 

Slide 109:

Learning Objective #6

Which of the following is not an appropriate test step for the previous dialog?

Answer Choices

  1. The Owner Center sends the videoSwitchStatusMsg to the External Center
  2. Pre-condition to execute the dlDevicelnformationSubscription dialog
  3. The External Center sends a c2cMessageReceipt message to the Owner Center
  4. The External Center sends a devicelnformationRequestMsg to the Owner Center

 

Slide 110:

Learning Objective #6

Review of answers

A small graphical red and yellow X representing incorrect.a) The Owner Center sends the videoSwitchStatusMsg to the External Center
Incorrect, videoSwitchStatusMsg is the input message for the dialog

A small graphical red and yellow X representing incorrect.b) Precondition to execute the dlDeviceInformationSubscription dialog
Incorrect, dlDeviceInformationSubscription is a pre-condition for the dialog

A small graphical red and yellow X representing incorrect.c) The External Center sends a c2cMessageReceipt message to the Owner Center
Incorrect, c2cMessageReceipt is the output message for this dialog

A small graphical green and yellow check mark representing correct.d) The External Center sends a devicelnformationRequestMsg to the Owner Center
Correct, the External Center sends a c2cMessageReceipt to the Owner Center

 

Slide 111:

Learning Objective #6

Test Log

 

Slide 112:

Learning Objective #6

Test Incident Report

 

Slide 113:

Learning Objective #6

Test Summary Report

 

Slide 114:

Learning Objective #6

Reference Implementation

 

Slide 115:

Learning Objective #6

Reference Implementation (cont.)

 

Slide 116:

Learning Objective #6

Reference Implementation (cont.)

 

Slide 117:

Learning Objective #6

Reference Implementation (cont.)

 

Slide 118:

Learning Objective #6

Reference Implementation (cont.)

 

Slide 119:

Learning Objective #6

Reference Implementation (cont.)

 

Slide 120:

Learning Objective #6

Reference Implementation (cont.)

 

Slide 121:

Learning Objective #6

Other Test Tools

XML Schema Validator

 

Slide 122:

Learning Objective #6

Summary of Learning Objective #6

Describe test documentation for TMDD: Test Plan, Test Design Specification, Test Case Specifications, and Test Reports

 

Slide 123:

What We Have Learned

  1. We test a TMDD-based system interface to verify it fulfills the system requirements and to validate it satisfies the user needs.
  2. The test plan for a TMDD-based system interface defines what portion of the system interface is to be tested.
  3. A completed NRTM and RTM are key elements of the TMDD standard that should be used to develop the test plan.
  4. A Requirementsto Test CaseTraceability Matrix should be created to ensure all requirements are tested at least once.

 

Slide 124:

What We Have Learned

  1. The TMDD Standard supports interoperability by defining a single design to fulfill each requirement.
  2. Extensions are allowed by the TMDD Standard but are discouraged.
  3. The Reference lmplementation is a tool to aid in performing testing of center-to-center interfaces.

 

Slide 125:

Resources

 

Slide 126:

Questions? A placeholder graphic image with word Questions? at the top, and an image of a lit light bulb on the lower right side.