Leveraging Big Data to Improve Traffic Incident Management (2019) / Chapter Skim
Currently Skimming:
Pages 132-180
The Chapter Skim interface presents what we've algorithmically identified as the most significant single chunk of text within every page in the chapter.
Select key terms on the right to highlight them within pages of the chapter.
From page 132... ...
132 A P P E N D I X A Data Source Assessment Tables Appendix A presents the detailed data assessment tables for 31 data sources. The criteria used to assess each data source are shown and described in Table 5-1 in Chapter 5 of this report.
|
From page 133... ...
Data Source Assessment Tables 133 • A.6 AGGREGATED DATASETS o RITIS data assessment (Table A-23) o NPMRDS (Table A-24)
|
From page 134... ...
134 Leveraging Big Data to Improve Traffic Incident Management A.1 State Traffic Records Data Sources Table A-1. Crash data.
|
From page 135... ...
Data Source Assessment Tables 135 Table A-2 Vehicle data. Assessment Criteria Assessment Description of Data An inventory of data that enables the titling and registration of each vehicle under a state's jurisdiction to ensure that a descriptive record is maintained and made accessible for each vehicle and vehicle owner operating on public roadways.
|
From page 136... ...
136 Leveraging Big Data to Improve Traffic Incident Management Table A-3. Driver data.
|
From page 137... ...
Data Source Assessment Tables 137 Table A-4. Roadway data.
|
From page 138... ...
138 Leveraging Big Data to Improve Traffic Incident Management Assessment Criteria Assessment Data Openness Limited data openness to full openness, as some agencies do not publish this type of data to the public, whereas others maintain portals where the data can be easily searched, downloaded, and sometimes even visualized. Data Challenges Data quality, delivery, timeliness, and accuracy vary widely across agencies.
|
From page 139... ...
Data Source Assessment Tables 139 Table A-5. Citation and adjudication data.
|
From page 140... ...
140 Leveraging Big Data to Improve Traffic Incident Management Table A-6. Injury surveillance data.
|
From page 141... ...
Data Source Assessment Tables 141 Assessment Criteria Assessment Data Size, Storage, and Management Component databases -- gigabytes. EMS providers, hospitals, state department of health, state databases, NEMSIS.
|
From page 142... ...
142 Leveraging Big Data to Improve Traffic Incident Management A.2 TRANSPORTATION DATA SOURCES Table A-7. Traffic sensor data.
|
From page 143... ...
Data Source Assessment Tables 143 Assessment Criteria Assessment Data Challenges Institutional. Tied to the ability of the institution to be able to provide and manage access to raw traffic sensor data as well as its ability to ensure high traffic sensor data quality by monitoring sensor drift, performing recalibration on a regular basis, and maintaining precise sensor location information.
|
From page 144... ...
144 Leveraging Big Data to Improve Traffic Incident Management Table A-8 Traffic digital video data. Assessment Criteria Assessment Description of Data Digital video is a representation of moving visual images in the form of encoded digital data.
|
From page 145... ...
Data Source Assessment Tables 145 Assessment Criteria Assessment Data Accessibility Accessibility varies widely among traffic video sources. Video is typically shared using a streaming method, which is commonly used to share video with media outlets and to some degree with the public via 511 and motorist-information websites using low resolution/quality video streaming.
|
From page 146... ...
146 Leveraging Big Data to Improve Traffic Incident Management Assessment Criteria Assessment Data Challenges In most cases, TMC video or images are not stored or archived. When stored, video data is only stored and maintained for a brief period; then it is purged to make room for newer video.
|
From page 147... ...
Data Source Assessment Tables 147 Table A-9. Safety service patrol and incident response program data.
|
From page 148... ...
148 Leveraging Big Data to Improve Traffic Incident Management Assessment Criteria Assessment Data Challenges Most service patrol data are still collected using paper forms that are later entered into a database or spreadsheet or by a TMC operator in radio communication with responders. More modern ways of collecting service patrol data are becoming more prevalent.
|
From page 149... ...
Data Source Assessment Tables 149 Table A-10. 511 system data.
|
From page 150... ...
150 Leveraging Big Data to Improve Traffic Incident Management Table A-11. Road weather data.
|
From page 151... ...
Data Source Assessment Tables 151 Assessment Criteria Assessment Data Size, Storage, and Management Gigabytes to terabytes, depending on coverage and time window. RWIS data typically is stored in relational databases and archived in flat files.
|
From page 152... ...
152 Leveraging Big Data to Improve Traffic Incident Management Table A-12. Toll data.
|
From page 153... ...
Data Source Assessment Tables 153 A.3 Public Safety Data Table A-13. Law enforcement, fire and rescue, and EMS CAD system data.
|
From page 154... ...
154 Leveraging Big Data to Improve Traffic Incident Management Table A-14. Emergency communication center (ECC)
|
From page 155... ...
Data Source Assessment Tables 155 Assessment Criteria Assessment Data Challenges Some prominent standards from national organizations exist and are being implemented, but there is no national standard or regulatory authority. Consequently, among the 6,000+ PSAPs nationwide, only a few have implemented standards that enable operational or data analytics assessments.
|
From page 156... ...
156 Leveraging Big Data to Improve Traffic Incident Management Table A-15. Public safety digital video data.
|
From page 157... ...
Data Source Assessment Tables 157 Assessment Criteria Assessment Data Challenges Dependency on wireless connection can be a technical obstacle. Institutional, technical, and legal – In most cases, video is stored or archived by law, but retention laws have not kept pace with video technology and greatly limit archiving.
|
From page 158... ...
158 Leveraging Big Data to Improve Traffic Incident Management Table A-16. Towing and recovery data.
|
From page 159... ...
Data Source Assessment Tables 159 A.4 Crowdsourced/Social Media Data Table A-17. Waze data.
|
From page 160... ...
160 Leveraging Big Data to Improve Traffic Incident Management Table A-18. Twitter data.
|
From page 161... ...
Data Source Assessment Tables 161 Assessment Criteria Assessment Data Challenges Two of the main challenges of using Twitter data are the large quantity of tweets generated every minute and the free text structure of its content (except for hashtags)
|
From page 162... ...
162 Leveraging Big Data to Improve Traffic Incident Management A.5 Advanced Vehicle Systems Data Table A-19. Automated vehicle location (AVL)
|
From page 163... ...
Data Source Assessment Tables 163 Table A-20. Event data recorder data.
|
From page 164... ...
164 Leveraging Big Data to Improve Traffic Incident Management Assessment Criteria Assessment Data Challenges Due to current technology, costs and data privacy issues associated with EDR data collection, and storage, EDR data cannot be collected and aggregated. Typically, EDR data must be downloaded one vehicle at a time after receiving the consent of the vehicle owner or a court order.
|
From page 165... ...
Data Source Assessment Tables 165 Table A-21. Vehicle telematics systems data.
|
From page 166... ...
166 Leveraging Big Data to Improve Traffic Incident Management Assessment Criteria Assessment Data Accessibility Each automaker and insurer uses its own proprietary telemetry or usage-based insurance (UBI) programs to access and store telematics data.
|
From page 167... ...
Data Source Assessment Tables 167 Table A-22. Automated and connected vehicle, traveler, and infrastructure data.
|
From page 168... ...
168 Leveraging Big Data to Improve Traffic Incident Management Assessment Criteria Assessment How the Data Are Collected Data are collected via dozens of sensors that collect telematics, driver behavior, and environmental data. Sensors such as forward and side radar sensors, sonar, GPS, LiDAR, cameras, and monitoring systems generate AV and CV data.
|
From page 169... ...
Data Source Assessment Tables 169 A.6 Aggregated Datasets Table A-23. RITIS data assessment.
|
From page 170... ...
170 Leveraging Big Data to Improve Traffic Incident Management Assessment Criteria Assessment Data Challenges Although RITIS provides analysis tools and visualizations, its data-sharing limitations do not allow its users to fully exploit the data it collects. It is unclear if the data that RITIS stores is stored in individual databases or if it is stored in a single data repository where all its datasets can be explored at once.
|
From page 171... ...
Data Source Assessment Tables 171 Table A-24. National Performance Measures Research Data Set (NPMRDS)
|
From page 172... ...
172 Leveraging Big Data to Improve Traffic Incident Management Table A-25. Meteorological Assimilation Data Ingest System (MADIS)
|
From page 173... ...
Data Source Assessment Tables 173 Assessment Criteria Assessment Data Costs Free. Data Openness Limited data openness due to some restricted content and need for NetCDF format knowledge.
|
From page 174... ...
174 Leveraging Big Data to Improve Traffic Incident Management Table A-26. Third-party web service weather data.
|
From page 175... ...
Data Source Assessment Tables 175 Table A-27 National Fire Incident Reporting System (NFIRS) Data Assessment Criteria Assessment Description of Data The National Fire Incident Reporting System (NFIRS)
|
From page 176... ...
176 Leveraging Big Data to Improve Traffic Incident Management Assessment Criteria Assessment Data Challenges The USFA does not have a quality assurance system in place to check for codes that are not in the current data dictionary. Thus, the NFIRS PDR database contains invalid codes and may exhibit data inconsistencies that violate published documentation.3 Data is collected on a voluntary basis, so some areas may not have sufficient data.
|
From page 177... ...
Data Source Assessment Tables 177 Table A-28. National EMS Information System (NEMSIS)
|
From page 178... ...
178 Leveraging Big Data to Improve Traffic Incident Management Table A-29. Motor Carrier Management Information System (MCMIS)
|
From page 179... ...
Data Source Assessment Tables 179 Table A-30. HERE data.
|
From page 180... ...
180 Leveraging Big Data to Improve Traffic Incident Management Table A-31. INRIX data.
|
Key Terms
This material may be derived from roughly machine-read images, and so is provided only to facilitate research.
More
information on Chapter Skim is available.