HAD - Honda Research Institute USA

HAD HRI Advice Dataset

The HRI Advice Dataset (HAD) is driving data with natural language advices. The driving videos are gathered from HDD dataset, a large-scale naturalistic driving dataset collected in San Francisco Bay Area. HAD consists of following features:

  • 30 hours of driving video data with natural language advices
  • Videos with can-bus signal data
  • Advices consist of (1) goal-oriented advice (top-down signal) – to influence the vehicle in a avigation task and (2) stimulus-driven advice (bottom-up signal) – conveys some visual stimuli that the user expects their attention to be actively looked by the vehicle controller

Introduction

The Honda Research Institute-Advice Dataset (HAD) is driving data with natural language advices. The driving videos are gathered from HDD dataset, a large-scale naturalistic driving dataset collected in San Francisco Bay Area. HAD consists of following features:

  • 30 hours of driving video data with natural language advices
  • Videos with can-bus signal data
  • Advices consist of (1) goal-oriented advice (top-down signal) – to influence the vehicle in a avigation task and (2) stimulus-driven advice (bottom-up signal) – conveys some visual stimuli that the user expects their attention to be actively looked by the vehicle controller

Download the dataset

The dataset is available for non-commercial usage. You must be affiliated with a university and use your university email address to make the request. Use this link to make the download request.

Citation

Please cite the following paper if you find the dataset useful in your work:


@InProceedings{kim2019CVPR,
        author = {Jinkyu Kim and Teruhisa Misu and Yi-Ting Chen and Ashish Tawari and John Canny},
        title = {Grounding Human-To-Vehicle Advice for Self-Driving Vehicles},
        booktitle = {The IEEE Conference on Computer Vision and Pattern Recognition (CVPR)},
        year = {2019}
}