Higher-Order Multimodal Theory-of-Mind and Reasoning - Honda Research Institute USA

Higher-Order Multimodal Theory-of-Mind and Reasoning

Your application is being processed

Higher-Order Multimodal Theory-of-Mind and Reasoning

Job Number: P24INT-03
The project aims to research and develop algorithms based on Multimodal LLMs to achieve advancements in multimodal Theory-of-Mind and reasoning, expanding current first-order capabilities to higher orders in multi-agent scenarios. The applications include but are not limited to socially balanced services and harmonious human-AI hybrid society. The ultimate goal is to provide a new perspective in human-AI collaborative environments.
San Jose, CA

 

Key Responsibilities

 
  • Develop a machine learning algorithm for higher-order multimodal Theory-of-Mind and reasoning using Multimodal LLMs.
  • Support development of a benchmark dataset for evaluation of results.
  • Develop and evaluate metrics to verify reliability of the proposed algorithms.
  • Contribute to a portfolio of patents, academic publications, and prototypes to demonstrate research value.

 

Minimum Qualifications

 
  • Ph.D. student in computer science, electrical engineering, or related field.
  • Strong research experience in computer vision, machine learning, and embodied AI.
  • Proficiency in programming languages such as Python and deep learning frameworks such as PyTorch.

 

Bonus Qualifications

  • Experience in one or more of the following: vision-language reasoning, multimodal LLMs, machine theory-of-mind, and embodied AI.
  • Publications in top-tier conferences or journals (CVPR, ICCV, ECCV, ICML, NeurIPS, ICLR, T-PAMI, T-IP, IJCV, etc.)

 

Years of Work Experience Required  0
Desired Start Date 5/5/2025
Internship Duration 3 Months
Position Keywords Multimodal LLM, Multi-agent Interaction, Human-AI collaboration

 

 

 

​

Alternate Way to Apply

Send an e-mail to careers@honda-ri.com with the following:
- Subject line including the job number(s) you are applying for 
- Recent CV 
- A cover letter highlighting relevant background (Optional)

Please, do not contact our office to inquiry about your application status.