Research Topics
Keywords
Autonomous Driving, Robotics, Embodied Intelligence, Foundation Model, Human-in-the-loop AI, Human-Machine Systems
1. Human-Like Prediction and Decision-making for AVs
We leverage human cognition mechanism to codesign prediction and decision-making for AVs.
Interaction-aware prediction
Differentiable Integrated Prediction and Planning
2. Multi-modal LLM Enhanced Autonomous Driving and Robotics
We leverage multi-modal LLM to enhance the scene understanding and decision-making for AVs and robotics.
Knowledge augmented e2e driving with Large Language Model
LLM-enabled robotic manipulation with skill learning
3. Human-in-the-loop Artificial Intelligence
We leverage multi-modal human-guidance to improve the learning efficiency and continuous learning ability of RL agents.
Human-in-the-Loop DRL for AVs
Human-guided DRL for continual learning
4. Multi-modal Robotics with Embodied Intelligence
We develop multi-modal embedded intelligence for designing multi-modal robotics in various domains.
Autonomous F1 racing car
Autonomous flying car
Autonomous Mobile Manipulator
5. Human-Machine Collaboration for Safe, Smart, and Smooth Autonomy
We develope bi-directional augmented collaboration framework, for achieving safer and robust human-machine systems.
Human-machine collaboration for highly automated vehicles
Remote collaboration for deployment of robots in society
Facilities
Autobox
Real-time computing system.
The SCALEXIO AutoBox brings the power into vehicles as well as other industrial machinery. It can be used for real-time test drives in the development of algorithms and components on the test rig and real vehicles.
AutoBot #1
- A by-wire autonomous vehicle with multi-modal sensors onboard.
- Capable of remote human-machine collaboration for multi-task completion in real world.
H2iL
Human&hardware-in-the-loop test rig, equipped with EEG plus multi-modal sensors
EZ10
Level 5 Autonomous Mini Shuttle
(donated by Continental Automotive, Singapore Ltd)
CETRAN
Centre of Excellence for Testing & Research of AVs at NTU
The Singapore’s first Autonomous Vehicle Test Centre
