Research Topics
Keywords
Autonomous Driving, Robotics, Embodied Intelligence, World Model, VLM/VLA, Foundation Model, Human-in-the-loop AI
1. World Model and World-Action Model for Autonomous Driving and Robotics
We leverage human cognition mechanism to codesign prediction and decision-making for AVs.
Interaction-aware prediction
Differentiable Integrated Prediction and Planning
2. VLM/VLA for Smart Mobility and Robotics
We leverage multi-modal VLA/VLM to enhance the scene understanding and planning for AVs and robotics.
AutoMoT: Asynchronous VLA
UniVLT: Transportation Foundation Model
3. Human-in-the-loop Artificial Intelligence
We leverage multi-modal human-guidance to improve the learning efficiency and continuous learning ability of RL agents.
Human-in-the-Loop DRL for AVs
Human-guided DRL for continual learning
4. Multi-modal Robotics with Embodied Intelligence
We develop multi-modal embedded intelligence for designing multi-modal robotics in various domains.
Autonomous F1 racing car
Autonomous flying car
Autonomous Mobile Manipulator
5. Human-Machine Collaboration for Safe, Smart, and Smooth Autonomy
We develope bi-directional augmented collaboration framework, for achieving safer and robust human-machine systems.
Human-machine collaboration for highly automated vehicles
Remote collaboration for deployment of robots in society
Facilities
Autobox
Real-time computing system.
The SCALEXIO AutoBox brings the power into vehicles as well as other industrial machinery. It can be used for real-time test drives in the development of algorithms and components on the test rig and real vehicles.
AutoBot #1
- A by-wire autonomous vehicle with multi-modal sensors onboard.
- Capable of remote human-machine collaboration for multi-task completion in real world.
H2iL
Human&hardware-in-the-loop test rig, equipped with EEG plus multi-modal sensors
EZ10
Level 5 Autonomous Mini Shuttle
(donated by Continental Automotive, Singapore Ltd)
CETRAN
Centre of Excellence for Testing & Research of AVs at NTU
The Singapore’s first Autonomous Vehicle Test Centre
