Module 18 - T313
T313: Applying Your Test Plan to Environmental Sensor Stations (ESS) Based on NTCIP 1204 v04 ESS Standard
HTML of the Student Supplement
(Note: This document has been converted from the Student Supplement to 508-compliant HTML. The formatting has been adjusted for 508 compliance, but all the original text content is included, plus additional text descriptions for the images, photos and/or diagrams have been provided below.)
T313: Applying Your Test Plan to the Environmental Sensor Stations based on the NTCIP 1204 ESS Standard v04
Table of Contents
1. Module Description
An environmental sensor station (ESS) consists of a remote microprocessor coupled with any number of sensors that monitor the surrounding environment, which may monitor weather, pavement, water levels, and/or air quality conditions. An ESS may also be used to control related equipment, such as pavement treatment systems and/or cameras.
The focus of this updated module is to assist user agencies in creating test documentation specific to their ESS needs based on the NTCIP 1204 Standard v04. The test documentation will include a test plan and test design specification that links to the standardized test cases and test procedures that are already available in NTCIP 1204 v04 documentation and explain how this testing documentation traces back to the requirements and design elements of the standard. The module will also provide examples of how to perform tests. Prior to taking this course, the student is expected to be knowledgeable of the NTCIP 1204 Standard v04 and testing methodologies.
This module will be placed in the context of the systems engineering process as well in the acquisition curriculum path. The complete series of ITS Standards Training Modules for the acquisition of an ESS is as follows: I101, A101, A102, A201, A313a, A313b, T101, T201, T202, T204, and T313. This module is the final module in the ESS acquisition series.
At the conclusion of this course, participants will be able to:
1. Describe within the context of the testing lifecycle the role of test plans and the testing to be undertaken
2. Identify key elements of NTCIP 1204 v04 relevant to the test plan
3. Describe the application of a good test plan to an ESS system being procured
4. Describe the testing of an ESS using standard procedures
3.1. Sample of Completed PRL
Figures 1-3 show the first few pages of a completed PRL as might apply to the Sample Test Plan below.
Figure 1: First page of a sample PRL
Table 6 Protocol Requirements List
(Extended Text Description: Figure 1: This figure shows the first page of a sample PRL that has been filled out. The support column is filled out as follows:
The full text of the table is shown below:
Figure 2: Second page of a sample PRL
(Extended Text Description: Figure 2: This figure shows the second page of a sample PRL that has been filled out. The support column is filled out as follows:
The full text of the table is shown below:
Figure 3: Third page of a sample PRL
(Extended Text Description: Figure 3: This figure shows the third page of a sample PRL that has been filled out. The support column is filled out as follows:
The full text of the table is shown below:
3.2. Sample Test Plan
<Enter project Background information>
Test Plan Identifier
This document is one of a series of documents as a part of Project <Project>. It defines the NTCIP Test Plan (NTP) for an NTCIP conformance test of a <Developer> ESS. This is the first version of the test plan. The complete document identifier is:
This test plan has been developed to verify that the <Developer> ESS conforms to the NTCIP 1204 v04 standard per its completed Protocol Requirements List (PRL). The completed PRL is available as <Project>-<Developer>-PRL-1.
Successful completion of this test will result in <Action, such as payment, production of letter of completion, approval to move to next phase of project, etc>
This test plan covers the major features of an NTCIP ESS. This includes requirements related to:
This test plan does not provide an exhaustive test of all values or features of the NTCIP requirements; it only covers those features for which NTCIP 1204 v04 test procedures exist.
<Project Procurement Specification>
NTCIP 1201:2010v03.15r Global Object Definitions
NTCIP 1204 v04<precise revision> Environmental Sensor Station Interface Protocol NTCIP 2104:2003v01.11 Ethernet Subnetwork Profile NTCIP 2202:2001 v01.05 Internet Transport Profile
NTCIP 2301:2010 v02.19s Simple Transportation Management Framework Application Profile
3.2.2. Details of the NTCIP Test
Items to be Tested
The item to be tested is the NTCIP-related operation of an <Developer> ESS. The version and revision of the equipment to be tested shall be recorded in the test results.
The NTCIP standards will provide the basis for defining the correct operation. Any conflicts between the standardized test procedures and the remainder of the NTCIP standards text shall be resolved by assuming that the text in the body of the standard takes precedence over the text in the test procedure.
Features to be Tested
The following table lists all of the tests defined by NTCIP 1204 v04 and indicates whether they will be performed. The selection of tests is based on the Requirements to Test Case Traceability Table in Annex C of NTCIP 1204 v04. The test procedures are as implemented by <Test Tool> unless otherwise indicated.
Table 1: Test Cases to Perform
Features Not to be Tested
Features that are not defined by NTCIP Standards or are not included within the standardized Test Procedures are not covered by this test plan. These features typically include, but are not limited to:
While some aspects of these features may be tested, this test plan does not focus on these types of requirements because they are not the focus of NTCIP 1204 v04. In addition, those tests not selected in the above table will not be performed.
The Tester will perform each selected test case identified under the "Features to be Tested" section of this test plan.
Inputs - Variable Values
The ESS Test Procedures include "variables" that are used as inputs to the test cases and must be assigned values prior to performing given tests. The specific values to be used for this test are provided in Appendix A.
Any problem identified with the ESS shall be corrected by the Developer. Upon completion of the modifications, the Developer shall resubmit the component for another test. Partial tests may be performed during the resolution of identified anomalies, but a complete regression test shall be performed on the final submittal so that any unexpected impacts resulting from program modifications can be detected. The regression test shall include performing all tests included in this test plan.
Item Pass/Fail Criteria
In order to pass the test, the ESS shall pass all test procedures included in this test plan without demonstrating any characteristic that fails to meet NTCIP specifications.
Suspension Criteria and Resumption Requirements
The test may be suspended, at the convenience of test personnel, between the performances of any two test procedures. The test shall always resume at the start of a selected test procedure.
If any modifications are made to the ESS, a complete regression test shall be required in order to pass this test plan.
The Tester will ensure that the following documents are developed and entered into the configuration management system upon their completion of the final test:
All test documentation will be made available to the involved parties in a widely recognized computer file format such as Microsoft Word or Adobe Acrobat. In addition, the files from the test software shall be provided in their native file format as defined by the test software.
3.2.3. Test Management
The testing tasks are summarized in Table 2.
Table 2: Testing Tasks
All Test Cases covered by this test plan require the device under test to be connected to a test application as depicted in Figure 4.
Figure 4: Test Equipment
(Extended Text Description: Author's relevant description: Figure 4: This figure depicts the main testing environment figure from NTCIP 8007 where a test application is connected to a device under test via a communications cloud that is also connected to a data analyzer.)
The test application will be <Test Software>.
The test will be performed at <Test Facility Name> in <Test City>. All tests shall be over an <Link Technology>.
All tests shall be performed using an SNMP/UDP/IP communications stack. All tests shall be performed using the following settings unless otherwise defined in the specific test procedure.
Read Community Name: <read name>
Write Community Name: <write name>
Timeout Value: <timeout>
Responsibilities and Authority
The Agency shall be responsible for:
The Tester shall be responsible for:
The Developer shall be responsible for:
Staffing and Training Needs
The following staffing is expected for this test plan:
Agency - 1
Tester - 1
Developer - 1
The Tester must be familiar with how to use the test software and with the NTCIP standards.
Schedule, Estimates, and Cost
The Test Plan will be completed by <date> and delivered to the Developer for approval. Testing setup will begin approximately <date>. Testing will finish as soon as possible after that date with an expected completion no later than <date>.
Risks and Contingencies
The performance of the test suite is expected to take <number of days> days if there are no or few problems found. If the sign fails to pass the test, the anomalies will be reported to <Developer> and another test date will be scheduled.
The following terms shall apply within the scope of this test plan.
ESS - Environmental Sensor Station, including the sensors, controller (sometimes called a remote processing unit), cabinet, and other associated field equipment.
Developer - The organization providing the equipment to be tested.
Tester - The organization that performs the testing according to the test procedures and interprets and records the results.
4. Reference to Other Standards
NTCIP 1204 v04 - National Transportation Communications for ITS Protocol: Environmental Sensor Stations Interface Protocol.
To include additional descriptions/acronyms used primarily in the module. Listed out in alphabetical order.
5. Study Questions
To include the quiz/poll questions and answer choices as presented in the PowerPoint slide to allow students to either follow along with the recording or refer to the quiz at a later date in the supplement.
1. Which of the following most accurately describes a benefit of having standardized NTCIP test documentation included in NTCIP 1204 v04?
2. Which statement most closely describes the documentation that a project should prepare before conducting NTCIP 1204 v04 testing?
3. Which of the below is not included in a test plan?
4. Which of the below is not a type of step used in NTCIP 1204 v04 testing?
6. Icon Guide
The following icons are used throughout the module to visually indicate the corresponding learning concept listed out below, and/or to highlight a specific point in the training material.
1) Background information: General knowledge that is available elsewhere and is outside the module being presented. This will be used primarily in the beginning of the slide set when reviewing information readers are expected to already know.
2) Tools/Applications: An industry-specific item a person would use to accomplish a specific task, and application of that tool to fit the need.
3) Remember: Used when referencing something already discussed in the module that is necessary to recount.
4) Refer to Student Supplement: Items or information that are further explained/detailed in the Student Supplement.
5) Example: Can be real-world (case study), hypothetical, a sample of a table, etc.
6) Checklist: Used to indicate a process that is being laid out sequentially.