Framework for Managing Data from Emerging Transportation Technologies to Support Decision-Making (2020)

Below is the uncorrected machine-read text of this chapter, intended to provide our own search engines and external engines with highly rich, chapter-representative searchable text of each book. Because it is UNCORRECTED material, please consider the following text as a useful but insufficient proxy for the authoritative book pages.

74 Appendix A – Online Survey An online survey was developed and distributed to managers of a wide range of emerging transportation technology projects at state and local transportation agencies to gather baseline information about how they manage and use the associated data. The online survey is provided herein. Welcome to the survey for the NCHRP Project 08-116: “Framework for Managing Data from Emerging Transportation Technologies to Support Decision-Making” Thank you for agreeing to take part in this important survey! The survey should take approximately 30- 45 minutes to complete. Please be assured that all the answers you provide in this survey will be confidential. Your answers will be combined with those of other respondents and summarized in a report to further protect your anonymity. The NCHRP team intends to share the summary report with all respondents and continue plans to keep respondents engaged in the project—including extending invitations to respondents to participate in follow-up interviews and workshops. The NCHRP project team also plans to share reports with participants to help guide their emerging transportation technology projects. If your agency is deploying multiple emerging transportation technologies, please complete the survey separately for each technology. Please feel free to work collaboratively with colleagues or partners to complete the survey or to forward on to the most appropriate person. PART I: BACKGROUND AND GENERAL INFORMATION 1. Please provide some information about yourself and the agency you represent. □ Name: _ □ Title: □ Agency: □ Email contact: □ Phone contact: 2. What is your role in your agency’s emerging transportation technology project? □ Chief Data Officer (CDO) □ Project Manager □ Planner □ Software Engineer □ Systems Engineer □ Evaluator □ Other: _ 3. What type of emerging technology is your agency deploying? □ Connected Vehicle technologies □ Automated Vehicle technologies

75 □ On-demand and shared mobility services □ Accessible transportation technologies □ Smart city technologies □ Data analytics system □ Other: _ 4. Please describe in detail the emerging transportation technology project that your agency is piloting or deploying. 5. In general, what is the status of your emerging transportation technology project? □ The project has not started. □ Concept development / Planning phase □ Requirements/system design phase □ Build and test phase □ Operate and maintain (O&M) phase □ The project is completed. 6. What organization/entity is primarily responsible for managing the data generated/collected by the emerging transportation technology project (select all that apply)? □ Local department of transportation (DOT) □ State DOT □ Other local agency. (Please specify below) □ Other state agency. Please specify below) □ University / academia. (Please specify below) □ Private sector. (Please specify below) □ Other (please specify below): Please specify here: _ 7. Please select which, if any, of the following national/federal pilot deployment or demonstration programs your agency’s emerging transportation technology project is part of (select all that apply)? □ Advanced Transportation and Congestion Management Technologies Deployment (ATCMTD) □ Accessible Transportation Technologies Research Initiative (ATTRI) Application Development Project □ Connected Vehicle Pilot Demonstration Site □ Integrated Corridor Management (ICM) Planning Grant □ Mobility on Demand (MOD) Sandbox □ NOCoE Signal Phase and Timing (SPaT) Challenge □ Smart City Challenge (SCC) Demonstration Program □ Surface Transportation System Funding Alternative (STSFA) Program □ USDOT Automated Vehicle Proving Ground □ USDOT Affiliated Connected Vehicle Test Bed □ None of the above □ Other national program. Please specify:

76 8. Does your agency have a website where the NCHRP project team can learn more about your project and/or access publicly available data being produced by the project? □ Yes □ No o Provide URL: _ PART II: DATA MANAGEMENT AND GOVERNANCE 9. What type(s) of data is your emerging transportation technology project expected to generate (select all that apply)? □ Traffic detector data and road conditions data (e.g., speed, volume, and occupancy data) □ Private sector crowdsourced traffic data (e.g., probe data, incident data, etc.) □ Traffic signal system data □ Toll tag or RFID transponder data □ Incident data □ Weather data □ Work zone data □ Road weather conditions data □ Parking status/availability data □ Closed-circuit television (CCTV) video data □ Connected vehicle data (e.g., Basic Safety Messages [BSMs], Traveler Information Messages [TIMs], Signal Phase and Timing [SPaT], etc.) □ Automated vehicle data □ Real-time transit location, schedule, schedule adherence, and/or ridership data □ Shared-use mobility data (e.g., carshare, bikeshare, transportation network company, etc.) □ Traveler information and routing data □ Other. Please specify: 10. How is your agency planning to use the data being collected for the emerging transportation technology project (select all that apply)? □ Support traveler information and alert systems □ Support planning activities □ Support operations of the transportation system □ Analysis of streaming data (e.g., real-time decision support, active/automated traffic management) □ Transportation system performance measurement/management □ Evaluation of the emerging transportation technology project □ Enable data sharing with other public agencies, with researchers, and academia □ None of the above □ Other: _ 11. Who are the potential/expected users of the data (select all that apply)? □ Local DOTs □ State DOTs □ Other local agencies. (Please specify below): □ Other state agencies. (Please specify below):

77 □ Metropolitan Planning Organizations (MPOs) □ Transit Agencies. (Please specify below) □ Private Sector. (Please specify below): □ Researchers/Academia. (Please specify below): □ General Public □ Other (Please specify below): □ Please specify here: _ 12. Does your agency have a Data Management Plan for this emerging transportation technology project? □ No □ Yes, and I can share it with the NCHRP project team □ Yes, but I cannot share it Please state the reason it cannot be shared: _ 13. Please upload the Data Management Plan document: 14. Does your agency have an architecture document, data flow diagram, or another document that visually depicts the flow of data within your emerging transportation technology project (e.g., ITS Architecture Information Flow Diagram)? □ No □ Yes, and I can share it with the NCHRP project team □ Yes, but I cannot share it Please state the reason it cannot be shared: _ 15. Please upload the architecture or diagram document: 16. Does your agency have leadership to address data governance issues? □ Yes □ No 17. Does your agency have an Open Data Policy? Note: Open Data refers to publicly available data structured in a way that enables the data to be fully discoverable and usable by end users. In general, open data will be consistent with the following principles: □ Universal participation – Anyone must be able to use, reuse, and redistribute the data. There should be no discrimination against fields of endeavor or against persons or groups. □ Availability and access – The data must be available as a whole in full granularity, at no more than a reasonable reproduction cost, and preferably by download over the Internet. The data must also be available in a convenient and modifiable form. □ Described – The data are described fully so that consumers of the data have sufficient information to understand their strengths, weaknesses, analytical limitations, security requirements, as well as how to process them.

78 □ Reuse and redistribution – The data must be provided under terms that permit re- use and redistribution, including the intermixing with other datasets. □ Managed Post-Release – A point of contact is designated to assist with data use and to respond to complaints about adherence to these open data requirements. □ No □ Yes, and I can share it with the NCHRP project team □ Yes, but I cannot share it Please state the reason it cannot be shared: _ 18. Please upload the Open Data Policy document: If no documentation is available, please respond to the question below 19. Please describe your Open Data Policy, including a URL if available: 20. Has your agency developed any metadata documentation (e.g., metadata schema, database schema, data dictionaries) to ensure that the consumers of the data have sufficient information to understand their quality, security requirements, and how to process them? □ Yes □ No 21. Does your agency have any processes to maintain the metadata documentation? □ Yes □ No 22. Can you share the metadata documentation with the NCHRP project team? □ Yes □ No Please state the reason it cannot be shared: _ 23. Please upload the metadata documentation: 24. Does your agency have processes in place to maintain the quality of the data? □ No □ Yes Please describe these processes: _ 25. Can you share documentation describing the data quality management? □ Yes □ No Please state the reason it cannot be shared: _ 26. Please upload the data quality processes document.

79 PART III: DATA RETENTION, PRIVACY AND SECURITY 27. Do the data collected/generated by the emerging transportation technology project contain sensitive information such as personally identifiable information (PII)? □ Yes o How does your system protect this information (e.g., de-identify, anonymize, restrict access)? □ No 28. Does your agency have a Data Privacy Plan? □ No □ Yes, and I can share it with the NCHRP project team □ Yes, but I cannot share it Please state the reason it cannot be shared: _ 29. Please upload the Data Privacy Plan document: 30. Do you have processes in place to maintain the security of sensitive data? □ No □ Yes Please describe any high-level processes that your agency takes to ensure data security: 31. Do you have any documents describing high-level security processes? □ No □ Yes, and I can share them with the NCHRP project team □ Yes, but I cannot share them Please state the reason they cannot be shared: _ 32. Please upload documents describing high-level security processes: 33. Does your agency have any data retention policies (e.g., deleting or destroying data after a certain period of time or the conclusion of either the pilot or the study)? □ No □ Yes Please describe any data retention policies: 34. Do you have any documents describing the data retention policies? □ No □ Yes, and I can share them with the NCHRP project team □ Yes, but I cannot share them Please state the reason they cannot be shared: _ _ 35. Please upload documents describing data retention policies.

80 PART IV: DATA STRUCTURE, VOLUME, AND ARCHIVE 36. Please describe the structure/format of the data (e.g., flat files, hierarchical documents, relational data): 37. Do you have data definition files representing the structure/format of the data? □ No □ Yes, and I can share them with the NCHRP project team □ Yes, but I cannot share them Please state the reason they cannot be shared: _ _ 38. Please upload the data definition files representing the structure/format of the data: 39. How often does the system generate/collect new data? □ One or more times per millisecond □ One or more times per second □ One or more times per minute □ One or more times per hour □ One or more times per day □ Other: _ _ 40. Which of the following best describes how much data is being collected/generated by the system per day? □ Several megabytes of data per day □ Several gigabytes of data per day □ Several terabytes of data per day □ Other: _ _ 41. How much of the data generated/collected by the system is being archived? □ No data are being archived □ Rolling time window of data is being archived (e.g., few minutes to one month) □ Only aggregated/modified data are being archived □ All the data generated/collected is being archived (in raw form) 42. How is your agency archiving data that is being generated/collected by the system (check all that apply)? □ Traditional file storage. □ Relational database backup. □ Hadoop-like storage on-premise. □ Cloud storage. Please specify above responses: 43. What is the rate of growth of the data archive? (e.g., 500 MB/hour, 500 GB/week) 44. Can you provide a sample of the data archived? □ Yes (If yes, a member of the research team will contact you to discuss) □ No Please explain why not:

81 45. Do you have a document describing how the data being stored/archived is organized (e.g., database schema, folder structure)? □ No □ Yes, and I can share it with the NCHRP project team □ Yes, but I cannot share it Please state the reason they cannot be shared: _ _ 46. Please upload the document describing how the data being stored/archived is organized: PART VI: DATA ANALYTICS 47. What type of analytical products does your agency generate or plan to generate (check all that apply)? □ None □ Charts □ Maps /Geospatial Analysis □ Reports □ Alerts □ Tables □ Dashboards □ Other: _ 48. Please provide a list of transportation-related performance measures that your agency is creating using the emerging transportation technology datasets. PART VII: WRAP UP 49. Have you or your agency looked at what other/similar emerging transportation technology projects are doing in terms of data storage and analysis? □ Yes. Please describe: _ □ No 50. Please provide any additional information or perspective that you would like to share with the NCHRP project team about data management from emerging transportation technologies including connected vehicles, automated vehicles, on-demand and shared mobility services, smart city technologies, accessible transportation technologies, as well as other emerging technologies.