EXECUTIVE SUMMARY
Background
Reducing traffic-related fatalities and improving emergency response capabilities are two primary goals of the U.S. Department of Transportation's (USDOT) Intelligent Transportation Systems Joint Program Office (ITS JPO), ITS Public Safety Program. To help achieve these goals, the ITS Public Safety Program is committed to:
- Improving incident detection and notification.
- Reducing emergency response times.
- Improving information flows between emergency response agencies (real-time wireless communications links, integration of systems).
To demonstrate how the integration of Computer-Aided Dispatch (CAD) and Traffic Management Center (TMC) systems can improve incident response capabilities and how institutional barriers can be overcome, the USDOT ITS JPO sponsored two field operational tests (FOT) through the ITS Public Safety Program that integrated CAD-TMC systems in Utah and Washington State, respectively.1 As stated in the Request for Proposals (RFP) for the CAD-TMC Integration FOT evaluation:
Transportation, law enforcement, fire, and emergency medical personnel are discovering significant improvements in public safety operations can be made when information is shared across organizations and jurisdictions. Equipment and personnel can be more efficiently deployed, incidents can be cleared faster, and incident scenes can be made safer for the responders and the traveling public.
To date there has been little effort to integrate highway traffic management with public safety systems. Nor have systems supporting public safety operations been developed in the context of a regional ITS architecture or ITS standards. Most existing CAD systems are proprietary and not equipped to easily share information with systems with dissimilar interfaces. Further complicating integration are various data, message formats, and standards used by public safety agencies and transportation agencies. Nevertheless, CAD and ATMS systems can be integrated and data can be shared, provided that a number of related institutional and technical challenges are addressed. New procedures and methods of response that capitalize on the availability of the shared information must also be developed.2
It is important to understand the baseline conditions in Utah before discussing the FOT or the evaluation results. The Utah Department of Transportation (UDOT) and Utah Highway Patrol (UHP) had a long-established relationship for sharing details of incidents occurring on the freeway system. UHP has provided a CAD listing of incidents since the opening of its joint center with UDOT in 1999. The Incident Response program that began in 1994 was moved to this joint center and the operators are dispatched by the UHP. The TMC monitors both the UHP CAD log and the radio frequencies used by UHP troopers and the Incident Management Team (IMT) specialists. The IMT program was expanded in 2000 to Regions 1 and 3 (the regions immediately north and south of the Salt Lake City region) in anticipation of the Winter Olympics. These specialists have direct mobile to mobile communications with the maintenance personnel in their regions.
Due to the existing procedures among the project participants, it is a recognized challenge for the CAD-TMC integration FOT to show substantial improvement in accuracy and timeliness of incident reporting and response.
The CAD-TMC Integrated System
Utah's integrated CAD-TMC system was intended to include the following elements and perform the associated functions:
- Create a common message set, structured in a uniform and open format, to enable the exchange of information between multiple agencies with unique requirements, policies, and operating environments. Two interagency-shared data messages (ISDM) are planned: the inter-agency service requests (ISR) and the interagency Advanced Traffic Management System (ATMS) message (IAM). The ISR specifically requests services rendered by public safety agencies and secondary responder services. ISRs may be between CAD systems and/or between CAD systems and ATMS to specifically request public safety and secondary responder services. The IAM relates to traffic condition advisories and traffic control requests between CAD systems and the ATMS.
- Support the ISRs via data specification sets (DSS) that incorporate the standard data elements found in all CAD Systems. The DSS will specify an Extendable Markup Language (XML) application to Import and Export (I/X) the data sets. The DSS will also specify the data standards for each element, as per the Institute of Electrical and Electronics Engineering (IEEE) standards, including IEEE 1512-2000, 1512.1, and 1512.2, as available and applicable. The ISR-DSS specifications will be in the public domain.
- Select a commonly used operating system and language (e.g., Windows 2000 and Visual Basic) to develop legacy system interfaces (LSI) between existing UHP and UDOT systems to enable information exchange. The LSI will be a stand-alone server program in the public domain designed for nationwide application at Traffic Management Centers (TMC) for the ISR and IAM messages between different vendor CAD systems and between CAD systems and ATMS.
- Develop LSIs between the State systems and county and municipal government systems (Valley Emergency Communications Center [VECC], Salt Lake City [SLC]).
- Integrate the new Utah Transit Authority (UTA) CAD system currently under development.
- Continue UDOT ITS Division-developed unique browser-based Event Tracking System (ETS) to manage and update planned events (i.e., roadway construction), and in real-time for subsequent dissemination to the traveling public. The ETS is being deployed statewide, and will be used by local city, county, and State agencies. Information from the ETS will be updated and integrated into the CommuterLink traffic management system, including 511, using XML.
System Performance Test Results
The system performance study was designed to:
- Describe the environment in which the FOT will operate that could affect the applicability of the CAD-TMC concept to other sites and the interpretation of the system impacts data. This will help other potential deployment users to better understand the applicability of the CAD-TMC concept to their sites.
- Identify key performance measures that should be met by similar deployments to achieve the system impacts observed by the FOT deployment. This will help other deployment users identify and focus on the performance goals needed to achieve similar results. Also, document the design basis for these performance measures to help other deployment users adjust these measures to better suit their local conditions.
- Calculate and document the key performance measures for the system as it was deployed. This will help identify limitations in the deployed system that might affect the observed system impacts. Also, identify and document other performance measures that are gathered by the deployment team (e.g., during component and integration testing). While this data is not as critical to the evaluation as the key measures, the data should be available from the deployment team to reduce the cost associated with reporting the data.
- Identify other factors that affect the deployed system's performance. After the system is deployed, users may identify other factors that could make the system more useful and knowledge that could benefit others in developing similar systems.
In addition to these activities related to evaluating the performance of the deployed system, the system performance study was intended to:
- Evaluate the degree to which ITS standards such as IEEE 1512 and National Transportation Communications for ITS Protocol (NTCIP) were incorporated into the deployed system.
- Address the approach used to share data between map databases from different vendors and GIS standards that were applied.
The system performance study was evaluated through:
- Interviews with project management and technical staff.
- Observations of technical staff using the integrated system at TMCs.
- Review of data obtained from the integrated system.
The system performance test results are summarized in table 1.
| Evaluation Objective | Hypothesis | Test Results |
|---|---|---|
| Objective #1: Document the system component performance. | The system meets functional specifications. | Achieved |
| The CAD and TMC systems will be able to link data on an incident. | Achieved | |
| Using the system improved incident response procedures. | To a significant extent, achieved through
prior projects. Project specific impact not measurable. |
|
| Objective #2: Automate the seamless transfer of information between traffic management workstations and police, fire, and EMS CAD systems from different vendors. | The system meets functional specifications. | Achieved. |
| The FOTs will decrease the reliance on manual methods for exchanging information. | Preliminary result - achieved. | |
| The FOTs will increase the extent and reliability of information exchanges. | Preliminary result - achieved. | |
| Objective #3: Extend the level of integration to include secondary responders such as utilities, towing and recovery, public works, and highway maintenance personnel. | Improved integration of secondary responders will reduce incident recovery time by getting required recovery personnel to the incident site as quickly as possible to begin recovery operations. | Secondary responders (ambulance, utilities, etc.) were not included in the project. |
Objective #1: Document the System Component Performance
The Evaluation Team relied on a combination of observations and interviews to determine whether or not the system component performance meets functional specifications. Seeing the system work and finding out if the system meets operator expectations are the best indications of successfully meeting system performance needs.
After the integrated system was implemented, a demonstration of the capability was held at the TMC with positive results. A mock incident was sent from the UHP to the TMC, with the TMC having the ability to review each detail of the incident. The TMC staff was able to input updates to the incident information without needing to telephone the information to the UHP. The demonstration clearly illustrated that the technology works properly and has expanded the potential for improved sharing of future incident details.
Objective #2: Automate the Seamless Transfer of Information between Traffic Management Workstations and Police, Fire, and EMS CAD Systems from Different Vendors
From observations and interviews, it was demonstrated that the integrated system reduces the reliance on manual methods for exchanging information. Incidents reported by partner agencies are transmitted to the integrated system and easily imported into the UDOT incident management system. Sharing information on incidents reported by other agencies, particularly from the Valley Emergency Communications Center (VECC), has significantly reduced UDOT operator reliance on listening to scanners to "discover" incidents of interest.
Objective #3: Extend the Level of Integration to Include Secondary Responders such as Utilities, Towing and Recovery, Public Works, and Highway Maintenance Personnel
Secondary responders have not yet been included in the FOT, and this component of the evaluation was not conducted.
System Impact Test Results Summary
The system impact study was designed to:
- Determine if the CAD-TMC integration improves the efficiency and productivity of incident response.
- Determine if the CAD-TMC integration improves mobility and reduces delays during incidents.
- Determine if CAD-TMC integration enhances incident-specific traffic management plans.
- Determine if the CAD-TMC integration will reduce exposure of response personnel and secondary crashes during incident response activities
- Determine if CAD-TMC integration will improve incident management information available to travelers.
The system impact study was evaluated through:
- Interviews with project management and technical staff.
- Observations of technical staff using the integrated system at TMCs.
- Review of data obtained from the integrated system.
Evaluation findings related to the seamless transfer of information between the traffic management workstations and police, fire, and EMS CAD systems from different vendors were qualitative, as follows:
- From observations, communication among response agencies was enhanced by CAD-TMC integration. Project meetings enhanced face-to-face communication. Phone calls are focused on clarifying specific information rather than trying to receive all of the information on an incident.
- From observations, efficiency in documenting incident management improved.
- From interviews, scene clearance time improved. Better traveler information allows the public the opportunity to bypass the incident which leads to less congestion and better response sooner (response units getting to the scene via a clear route). This conclusion by responding agencies could not be verified.
- There were some apparent inconsistencies between the codes included in the "before" data collected (April - June 2004) and the "after" data collected (April - June 2005). The reasons for the inconsistencies are not known, but could range from a problem in translation to broader data issues. The questions that followed from these inconsistencies, however, led to the team rejecting most of the quantitative analysis that was done on the before and after data sets.
- An additional issue encountered with the before data was that the "end time" field was recorded on the hour or half hour or was not completed, making the use of this data for quantitative analysis problematic.
- It should be noted, however, that a significant benefit of the FOT was a significant improvement in the quantity and quality of data collected. The system is generating standardized identification codes that all agencies understand and is also generating accurate incident "start time" and "end time" data.
The system impact test results are summarized in table 2.
| Evaluation Objective | Hypothesis | Test Results |
|---|---|---|
| Objective #1: Productivity –To determine if the CAD-TMC integration improves the efficiency and productivity of incident response. | CAD-TMC integration enhances communications among responders. | Achieved - Key issue to be addressed is that of refining information exchange to meet agency specific requirements. |
| CAD-TMC integration improves efficiency of on-scene operations. | Not measured during the evaluation. | |
| CAD-TMC integration enhances efficiency in documenting incident management. | Achieved. | |
| CAD-TMC integration reduces incident clearance times. | Not measured during the evaluation. | |
| Objective #2: Mobility – To determine if the CAD-TMC integration improves mobility and reduces delays during incidents. | CAD-TMC integration enhances mobility during incident management (IM) activities. | No impact measured during the evaluation. |
| Objective #3: Capacity/ Throughput –To determine if CAD-TMC integration enhanced incident-specific traffic management plans. | CAD-TMC integration enhances incident-specific traffic management plans. | Not measured during the evaluation. |
| Objective #4: Safety - CAD-TMC integration will reduce exposure of response personnel and secondary crashes during incident response activities. | CAD-TMC increases safety for response personnel. | Not measured during the evaluation. |
| CAD-TMC increases safety to the traveling public. | Not measured during the evaluation. | |
| Objective #5: Traveler Information - To determine if CAD-TMC integration will improve incident management information available to travelers. | CAD-TMC integration enhances customer satisfaction and mobility during incident management activities by improving traveler information. | Qualitative assessment: Improved ability to post incident information for public access via 511, Web site. |
| UTA Objective: To determine if the integration of the UTA CAD system improves UTA's ability to respond to incidents. | The CAD-TMC integration will enable UTA to more effectively implement reroute decisions in response to an incident. | CAD-TMC integration provided real-time
information on unplanned incidents and complemented existing UTA incident
management procedures. Additional benefit from system is information provided on planned incidents, such as road closures and/or construction activities. |
Benefits Summary
Enhanced field operations were associated with locating and responding to incidents. To a significant extent, this benefit was previously realized by Utah. UDOT and UHP had previously co-located staff at TMCs, and CAD terminals were placed in TMCs to enable data sharing. The most significant benefit realized by the project was the ability to engage in direct data exchange between legacy systems rather than having an operator observe two or more terminals. This real-time exchange of data adds to the benefits previously obtained through inter-agency cooperation and represents an additional enhancement of field operations and fills what had been a gap in the existing incident management and response program already in place in Utah.
Geo-location for placing incidents and marginal improvement in scene clearance. Observed benefits included the use of Geo-location in providing a mechanism to place incidents without operator intervention, and from interviews, a qualitative assessment that scene clearance time seemed to improve marginally. Better traveler information allows the public the opportunity to bypass the incident which leads to less congestion and better response sooner (response units getting to the scene via a clear route). This logic seems sound; however, data was not available to support these conclusions.
Enhanced communications among responders; enhanced on-scene activities. The evaluation was not able to completely assess this benefit. The system is newly deployed and while operational is still undergoing refinement. This benefit would be more accurately assessed when the system has matured and has been in use for a period of several years instead of several months.
Enhanced efficiency in documenting the incidents. In the first 2 months of operation, the number of incidents documented by the integrated system increased by about 800 percent, as noted in section 4.2.1. The number of incidents for which the TMC maintained data increased significantly after the CAD-TMC integration. The main difference observed between the before and after data discussed above was that UDOT seemed to maintain much more complete incident records after the deployment, both in terms of the number of incidents recorded and the details recorded about each incident. It is believed that this increase is due in large part to the fact that CAD data was more readily available to TMC operators after the CAD-TMC deployment. This is supported, in part, by the large number of incidents in the after data for which Dispatch Services/9-1-1 were listed as the reporting agency.
Improved data quality. The electronic data collection, particularly in recording the incident start and stop times, has significantly improved overall data quality. An additional example of this is reflected in a decrease in the error rate for the coding of incidents by type.
Improved interagency working relationships. Utah had already achieved substantial progress in this area, and the project represented a continuation of this benefit. Utah's success in this area is represented by the inter-agency discussions on the amount and type of data that should be exchanged between the systems-the inter-agency cooperation that enabled this data exchange established the venue for addressing this type of system refinement based on initial deployment experience.
Enhanced communication with the traveling public and media. This benefit would be more properly addressed at system maturity. While anecdotal evidence obtained during after project interviews indicates that enhanced communication is occurring, assessing this metric based on several years of implementation experience will provide a more accurate measure the benefit of enhanced communication to the traveling public and the media. From observations, efficiency in documenting incident management improved. This was presented in section 4.1, and was also an objective of the system impact study. Input for some fields was automated so UDOT operators did not have to enter this data.
Conclusions
Utah is fortunate that it had a well-established Incident Management program in place prior to this field test. A joint process for handling incidents had been developed and refined over several years and included access to 9-1-1/ CAD information for all types of incidents. Many of the benefits of an integrated TMC-CAD system were realized well before the field test got underway.
The FOT has proven worthwhile for the agencies to continue their quest to develop a true real- time data exchange system. As improvements are completed, operators from both agencies will recognize the benefits. To date, the agencies have already benefited from improved data collection, both in quantity and quality.
The real value of this FOT can be applied in Region 4 within Utah, and in other states that do not have the interoperability and strong institutional relationships that are already in place in the Salt Lake Valley region. This is especially true for areas where multiple agencies from state and local government agencies may respond to incidents on freeways, such as home rule states,3 where interoperable CAD would be a huge benefit in trying to provide real-time traffic information. This would apply both to other regions within Utah and to other states. Delays in obtaining information in these outlying areas far exceed the delays that occur in the Salt Lake City area and sometimes significant events are not reported to UDOT at all. The strong institutional relationships already established in Utah, both between state agencies and state and local government agencies, can serve as a model to other regions on how to achieve interoperability.
Recommendations
A number of recommendations were developed as a result of the FOT. These recommendations are offered to other states or jurisdictions considering similar deployments, and are intended as a guide to help identify issues that could impact system deployment, in particular, cost, schedule, and system performance. Also included are transit-specific lessons learned, with recommendations derived from UTA's participation in the project.
General Recommendations
#1: Involve IT staff early-on in the project planning process. Interviewees mentioned the importance of involving agency information technology staff early in the development of the integrated system. This is important so the IT organization provides technical input to the system to assure that the computing and communication environment fit within each agency and can be effectively maintained.
#2: Understand the importance of close working relations from the start. All of those interviewed by the Evaluation Team mentioned the importance of the close working relationship among the agencies involved in this FOT. The close working relationship was strengthened by the work these agencies did in preparation for and during the 2002 Winter Olympic Games. Although not every region can strengthen relationships among agencies by hosting the Olympic Games, agencies should consider how to build these relationships in advance implementing an integrated system.
#3: Provide dedicated staff working on integration, or staff with emphasis on integration. Interviewees mentioned that it was often difficult to spend enough time on the integrated system. Decisions and work items sometimes took longer than those involved would have preferred. Even though every agency supported the integrated system, staff had normal responsibilities with integration duties added on. It would be ideal if staff involved had a priority on the integrated system tasks.
#4: Build in short development cycles to reduce staff turnover issues. Interviewees mentioned that some agencies had critical staff turnover during the implementation of the integrated system. Staff turnover can be disruptive to implementation schedules and budgets as new people have to come up to speed on the system. If the system is planned to have incremental implementations (see section 5.4, Technical Challenges), then the development cycles for each incremental implementation can be short to minimize the likelihood that staff will turnover during a given development cycle. Staff turnover between cycles is not as disruptive as turnover during a development cycle.
#5: Understand the importance of considering role of business practices in the integrated system. As discussed earlier in this document, it is important that the integrated system not require a change in the operator's or dispatcher's work process. However, if other aspects of an agency's business practice would improve the integrated system, it should be considered. For example, VECC agencies were concerned about providing certain information to the integrated system. UDOT is planning to develop an MOU with the VECC agencies that will specify how the information will be used. This may allow a change in those agencies' business practices that will lead to more information shared in the integrated system.
#6: Understand the importance of coordination meetings. Interviewees mentioned the importance of ongoing, periodic coordination meetings with the partner agencies. These meetings kept communication open and emphasis on the integrated project.
#7: Coordinate deployment schedule with vendor schedule for system modifications and upgrades. As mentioned in section 5, CAD systems are generally off-the-shelf products. Vendors have a fixed release schedule. It is important to coordinate project schedules with the vendors' release schedules.
#8: Define what data is exchanged and when. In the Utah system, the IEEE 1512 standard was selected for incident management messages and codes. However, not all vendors supported those codes. It is important for agencies to prepare for differences in codes and determine how to handle these differences.
#9: Decide what incidents will be shared among agencies and what information will be exchanged when an incident is shared. The experience in Utah is leading the participating agencies to automatically send incidents of interest and allow the receiving systems to filter those incidents to display the ones that are likely to be of most interest to the operators.
#10: Understand the importance of incremental implementation. In the Utah system, agencies learned a lot in the initial implementation of the integrated system. The agencies are using that knowledge to plan improvements to the integrated system. For agencies planning an integrated system, it is recommended that they plan an initial implementation and at least one subsequent, incremental improvement. Any group of agencies is almost certain to learn how they would prefer to have the system operate. The project and related contracts should be arranged to allow the agencies to implement what they learn in the initial implementation.
#11: Understand the importance of redundant communication path. As discussed in section 5, a back-up communication pathway is important. Agencies should plan to include redundant communications in an integrated system.
#12: Minimize or avoid duplicate entry. Because not all needed information is transferred from VECC to the integrated system, UDOT operators have to enter data in their system that was already entered by VECC dispatchers in their system. Ideally, any given piece of information would only be input once by any operator in the integrated system. This is an important concept to plan for in any integrated system.
Transit-Specific Recommendations
Transit #1: Expect a great deal of complexity in interfacing with the various network protocols and security infrastructures for multiple public sector agencies, in particular, given the sensitive nature of much of the subject matter for the messages. Not everything UTA thought it understood at the outset turned out to be correct, both technically and institutionally. There is no effective way to learn these things other than by working through them with the other agencies, and it is useful to understand that extra time and effort will be needed.
Transit #2: A technical example was the need to make various unexpected changes in UTA's messaging interface to accommodate the specific configurations of the messaging system interfaces developed later by other agencies. UTA did not anticipate the amount of time that would be needed for such adjustments to the configuration of its software.
Transit #3: An institutional example was the unexpected difficulty for dispatchers in being able to quickly interpret public safety agency incident messages, due to the various codes and jargon used.
Transit #4: For agencies that need to work with a vendor for the necessary enhancements to their respective CAD systems, it will be useful to establish strong working relationships and effective contractual mechanisms for ongoing technical support. It would be difficult to anticipate the specifics of all required vendor support for incorporation into system specifications. This leads to vendor support being needed for requirements that were not necessarily incorporated into UTA's original specifications. Since UTA developed and enhanced its software using in-house resources, it did not need to work with a vendor and did not experience this directly. However, several of the other agencies did need to work with their respective CAD software vendors to implement the changes, and this was UTA's observation on the effect.
Transit #5: Incident information generated by public safety agencies needed to be filtered and processed before being presented, for effective use by transit dispatchers. In their raw form, it was found that only some of these incident messages would affect traffic. In addition, the message description contained a range of information not needed by transit operations and in a format that was difficult to decipher. The filtering and processing could be performed either by a designated staff person, or by another agency such as UDOT. The purpose of this filtering and pre-processing for UTA would ideally be to (1) limit messages to those that could affect traffic in main corridors of the UTA service area; (2) provide a plain language description of the potential traffic impact location; and (3) distinguish between messages about new incidents and updates on existing incidents.
1 The ITS JPO served as the Contract Technical Representative. The Federal Highway Administration (under ITS JPO jurisdiction) served as the Contract Technical Manager.
2 USDOT, ITS JPO-sponsored RFP, "National Evaluation of the Computer-Aided Dispatch - Traffic Management Center Integration Field Operational Test Request for Proposals," March 7, 2003, page 1.
3 The term "home rule states" refers to a certain type of governmental organization within states. The following definition of home rule is incorporated from the National League of Cities Web site: <http://www.nlc.org/about_cities/cities_101/153.cfm>: "Home rule is a delegation of power from the state to its sub-units of governments (including counties, municipalities, towns or townships, or villages). That power is limited to specific fields, and subject to constant judicial interpretation. Home rule creates local autonomy and limits the degree of state interference in local affairs."