We present the HRI Driving Dataset (HDD), a challenging dataset to enable research on learning driver behavior in real-life environments. The dataset includes 104 hours of real human driving in the San Francisco Bay Area collected using an instrumented vehicle equipped with different sensors.    The videos below provide examples of goal-oriented driving behavior from the dataset. GPS coordinates together with sensor values from the CAN bus are shown on top of the front-facing camera stream.