HDD HRI Driving Dataset

We present the HRI Driving Dataset (HDD), a challenging dataset to enable research on learning driver behavior in real-life environments. The dataset includes 104 hours of real human driving in the San Francisco Bay Area collected using an instrumented vehicle equipped with different sensors.    The videos below provide examples of goal-oriented driving behavior from the dataset. GPS coordinates together with sensor values from the CAN bus are shown on top of the front-facing camera stream.


Download the dataset

The dataset is available for non-commercial usage. You must be affiliated with a university and use your university email address to make the request. Use this link to make the download request.


If you find this dataset useful in your research, please consider citing:

    author    = {Vasili Ramanishka and Yi-Ting Chen and Teruhisa Misu and Kate Saenko},
    title     = {Toward Driving Scene Understanding: A Dataset for Learning Driver Behavior and Causal Reasoning},
    booktitle = {Conference on Computer Vision and Pattern Recognition (CVPR)},
    year      = {2018}