Official US Government Icon

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure Site Icon

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

Secure Data Commons

In This Section

Secure Data Commons - ProjSpotLightWazeCovid

COVID-19 Waze Traffic Alert Dashboard

Waze COVID-19 Traffic Alert Dashboard

 

Visualizing Changes in Roadway Transportation Activity with the COVID-19 Waze Traffic Alert Dashboard

Volpe developed a COVID-19 Waze Traffic Alert Dashboard in March 2020 to track relative changes in weekly traffic jam alerts for all U.S. metropolitan areas. The SDC enabled the team to leverage existing crowdsourced traffic incident activity and rapidly developed a dashboard using existing code. The team has continued to provide weekly updates through 2022. The Waze dashboard provides a rapid indicator of traffic jams covering all U.S. metropolitan areas, increasing accessibility to state, metropolitan, and county-level time trends. This ongoing project aims to enhance the dashboards for broader use by U.S. DOT.

Sponsor: Volpe Center
Last updated July 2022

Secure Data Commons - ProjSpotLightWazePilot

Waze Pilot: Explore the Possibilities of Using Data for Safety Applications

 

Better Understand and Mitigate Crash Risk by Integrating Public and Private Data Sources

Crowdsourced mobile applications such as Waze can provide real-time and historical data about roadway conditions, when and where users are active. Analytical methods were used to test an application of Waze traffic alerts to a crash prediction model used to guide Tennessee law enforcement resource allocation. To target locations and times more accurately with a high crash propensity, the potential for Waze alerts to improve the temporal and spatial resolution of the model was assessed.  Using the Waze data, the spatial resolution of crash estimates was refined from 42 to 1 square miles, and the temporal resolution was refined from 4 to 1-hour time windows, while improving accuracy. The model’s incorporation of crowdsourced data has shown potential for similar types of data-driven safety approaches elsewhere. SDC enabled the integration of public and private data sources to support these analytical approaches. 

1. Flynn DFB, Gilmore MM, Dolan JP, Teicher P, Sudderth EA. Using Crowdsourced Data to Improve Models of Traffic Crash Propensity: Tennessee Highway Patrol Case Study. Transportation Research Record. March 2022. doi:10.1177/03611981221083305
https://journals.sagepub.com/doi/10.1177/03611981221083305

2. Flynn, D. F. B., M. M. Gilmore, and E. A. Sudderth. Estimating Traffic Crash Counts Using Crowdsourced Data: Pilot analysis of 2017 Waze data and Police Accident Reports in Maryland. November 2018. Report Number : DOT-VNTSC-BTS-19-01 https://rosap.ntl.bts.gov/view/dot/37256

Sponsor: OST-P Safety Data Initiative
Last updated July 2022

Secure Data Commons - UseCaseDataSharing

Data Sharing Between Cloud Programs

Connect SDC Cloud and DOT Research Cloud Platforms to Make Data Available to External Research Teams

SDC can provide a way for external researchers to access and conduct analytical research on another DOT Cloud Platform. SDC data sharing service provides Research Teams with seamless access through a Virtual Private Cloud  Peering solution. This enables external SDC Users to read and copy data from a Research Cloud into the SDC workstation.

Why Should Your Research Programs use SDC Services?

  • Saves on duplicative data storage costs
  • Enables cross data analysis in SDC and another research cloud where boundaries are invisible to the Researcher
Last updated March 2022

Secure Data Commons - UseCasePilotNewTech

Learn, Pilot & Assess New Technologies

Learn and Prototype New Advanced Technologies in a Sandboxed Area

Research Teams can learn new advanced analytical methods in an isolated platform. SDC provides services to enable Research Teams to learn and pilot cloud native technologies on different data types, such as live streaming video. The new advanced analytical methods and technologies facilitates new insights on their study. 

Why Should Your Research Programs use SDC Services?

  • Pilot and lean how to use advanced analytical methods 
  • Prototype and test new analytical approaches, while fostering innovation
Last updated September 2022

Secure Data Commons - UseCaseDataProducts

Enable Research Programs to Build Data Products 

Integration with SDC Enable Development of Robust Data Products

SDC services were leveraged by integrating with an existing DOT database system and providing a data export feature into DOT Reporting Visualization Services. Research Programs are enabled to focus on building powerful data products, and less on building a secure analytical platform. SDC provided services to streamline data imports and connect to enterprise visualization services to allow Research Teams to effectively build dashboards accessible to a broader organization.

Why Should Your Research Program use SDC Services?

  • Saves development time on building a secure platform
  • Leverage an existing Authority to Operate (ATO) and security controls
Last updated September 2022

Secure Data Commons - UseCaseModernize

Modernize Part of Your Research Program

Modernize Part of Your Program Image

Automate Legacy System so that Research Program Initiatives Continue

SDC services enables Research Programs to focus on their critical program initiatives by modernizing labor intensive  data quality checks and data requests.  Our services allows Research Programs to become more efficient with daily operational tasks. Research Programs are able to direct their resources on supporting quality data and data collection. SDC will tailor existing capabilities to automate data exports using trusted status functionality and leveraging cloud native services to execute data ingest quality checks.

Why Should Your Research Programs use SDC Services?

  • Automating manual labor intensive data export request assessments
  • Modernizing data integrity through cloud managed services
  • Saving on analytical software license costs
Last updated March 2022

Secure Data Commons - Use Cases

Discover Use Cases for SDC

 

 
 
 
Last updated September 2022

SDC Access Request

SDC Service Desk Site Request for access to the Secure Data Commons (SDC)

Secure Data Commons - What You Need to Know

What You Need to Know

Secure Data Commons (SDC) enables collaborative and controlled integration and analysis of research data at the moderate baseline security level.  FedRAMP security impact level, modern, includes upholding security controls for personally identifiable information (PII) and confidential business information (CBI) data. SDC offers authorized and controlled access to individual datasets and its associated metadata. Additionally, SDC supports the following data transfers: real-time (streaming), batch (daily, weekly), and ad-hoc (occasional).

Considering the SDC for your project, data, or analysis needs?

Here's what you need to know.

 

 

 

 

 

 

 
 

 

Technical Requirements

SDC researchers are expected to have foundational analytical programming experience in R, Python, SQL, and GitLab,  and familiarity with cloud services to access datasets within the SDC platform. 

Security

Each participating data provider in the SDC defines the levels of access to SDC users. Based on the agreement with the data provider, the SDC team granularly grants access to approved users of the data.

Access to SDC Web Portal

Currently the SDC is available only to USDOT-approved projects. If you would like access, or would like to propose your research to be a part of the SDC community, please email sdc-support@dot.gov.

 

For more information on Secure Data Commons, please see SDC Capabilities (pdf).

Last updated November 2022