This dataset was collected as part of the U.S. Department of Transportation (U.S. DOT) Intersection Safety Challenge (hereafter, “the Challenge”) for Stage 1B: System Assessment and Virtual Testing. Multi-sensor data was collected at a controlled test roadway intersection within the Federal Highway Administration (FHWA) Turner-Fairbank Highway Research Center (TFHRC) Smart Intersection facility in McLean, VA from October 2023 through March 2024. The data includes potential conflict-based and non-conflict-based experimental scenarios between vulnerable road users (e.g., pedestrians, bicyclists) and vehicles during both daytime and nighttime conditions. Note that no actual human vulnerable road users were put at risk of being involved in a collision during the data collection efforts. The collected data (hereafter, “the Challenge Dataset”) was intended to be used for intersection safety system algorithm training, refinement, tuning, and/or validation, but may have additional uses. The Challenge Dataset is divided into training data (unlabeled, without associated ground truth) and validation data (labeled, with associated ground truth). This particular data asset provides the training data, and is complimentary to the validation data component of the Challenge Dataset found on the ITS DataHub at: https://data.transportation.gov/j58q-ymi4. For a summary of the Stage 1B data collection effort, please see this video: https://youtu.be/csirVHFa2Cc.

All data within the Challenge Dataset (i.e., both the training data and the validation data) includes data collected at a single, signalized four-way intersection from 20 roadside sensors and traffic control devices, including eight closed-circuit television (CCTV) visual cameras, five thermal cameras, two light detection and ranging (LiDAR) sensors, and four radar sensors. Intrinsic calibration was performed for all visual and thermal cameras. Extrinsic calibration was performed for specific pairs of roadside sensors. Additionally, the traffic signal phase and timing data and vehicle and/or pedestrian calls to the traffic signal controller (if any) are also provided.

The total number of unique runs in the Challenge Dataset training data is 1,104, bringing the total size of the dataset to approximately 1 TB. A sample of 20 unique runs from the training data is provided here for download, inspection, and use. If, after inspecting this training data sample, a potential data user would like access to download the full training data, a request can be made via the form linked here: https://its.dot.gov/data/data-request.

For more details about the data collection, supplemental files, organization and dictionary, and sensor calibration, see the attached “U.S. DOT ISC Stage 1B ITS DataHub Metadata_v2.0.pdf” document. For more information on the background of the Intersection Safety Challenge Stage 1B, please visit: https://www.its.dot.gov/research-areas/intersection-safety/challenge/.