Cruise.AI Under the Hood
Yu Huang
Yu.huang07@gmail.com
Sunnyvvale, California
Outline
• Scene Understanding
• Perception
• Multiple sensor fusion
• Tracking
• Occlusion
• Prediction
• Interaction/social modeling
• Mixture of experts gating
• Decision Making
• Criterion & Challenges
• Decision & Plan
• Uncertainty & Interaction
• Imitation & Reinforcement Learning
• Latency handling
• Simulation
• Real2Sim
• 3-D geometric modeling
• Rare data generation
• Lidar point cloud simulation
• Ecosystem
• Continuous learning
• AV development cycle
• High quality data extraction
• Visualization tool
• Huge data to leverage for ML models
• Scalability of fleet management
• HD map building at scale
Scene Understanding
Cruise AI under the Hood
Cruise AI under the Hood
Cruise AI under the Hood
Cruise AI under the Hood
Cruise AI under the Hood
Cruise AI under the Hood
Cruise AI under the Hood
Cruise AI under the Hood
Cruise AI under the Hood
Cruise AI under the Hood
Cruise AI under the Hood
Cruise AI under the Hood
Cruise AI under the Hood
Cruise AI under the Hood
Cruise AI under the Hood
Cruise AI under the Hood
Decision Making
Cruise AI under the Hood
Cruise AI under the Hood
Cruise AI under the Hood
Cruise AI under the Hood
Cruise AI under the Hood
Cruise AI under the Hood
Cruise AI under the Hood
Cruise AI under the Hood
Cruise AI under the Hood
Cruise AI under the Hood
Cruise AI under the Hood
Cruise AI under the Hood
Cruise AI under the Hood
Cruise AI under the Hood
Cruise AI under the Hood
Cruise AI under the Hood
Cruise AI under the Hood
Simulation
Cruise AI under the Hood
Cruise AI under the Hood
Cruise AI under the Hood
Cruise AI under the Hood
Cruise AI under the Hood
Ecosystem Development
Cruise AI under the Hood
Cruise AI under the Hood
Cruise AI under the Hood
Cruise AI under the Hood
Cruise AI under the Hood
Cruise AI under the Hood
Cruise AI under the Hood
Cruise AI under the Hood
Cruise AI under the Hood
Cruise AI under the Hood
Cruise AI under the Hood
Cruise AI under the Hood
Cruise AI under the Hood
Cruise AI under the Hood
Cruise AI under the Hood
Cruise AI under the Hood
Cruise AI under the Hood

More Related Content

PDF
How to Build a Data Closed-loop Platform for Autonomous Driving?
PDF
2018/12/28 LiDARで取得した道路上点群に対するsemantic segmentation
PPTX
AI Hardware Landscape 2021
PDF
Techniques and Challenges in Autonomous Driving
PDF
Building HD maps with dashcams
PPTX
確率ロボティクス第二回
PDF
交差点の交通流におけるシミュレーション環境 を用いた深層強化学習に関する研究
PDF
Cartographer を用いた 3D SLAM
How to Build a Data Closed-loop Platform for Autonomous Driving?
2018/12/28 LiDARで取得した道路上点群に対するsemantic segmentation
AI Hardware Landscape 2021
Techniques and Challenges in Autonomous Driving
Building HD maps with dashcams
確率ロボティクス第二回
交差点の交通流におけるシミュレーション環境 を用いた深層強化学習に関する研究
Cartographer を用いた 3D SLAM

What's hot (20)

PPTX
確率ロボティクス第三回
PPTX
第2回nips読み会・関西資料『unsupervised learning for physical interaction through video ...
PDF
四脚ロボットによる つくばチャレンジへの取り組み
PPTX
[DL輪読会]DIVERSE TRAJECTORY FORECASTING WITH DETERMINANTAL POINT PROCESSES
PPTX
GN-Net: The Gauss-Newton Loss for Deep Direct SLAMの解説
PDF
GPU - Basic Working
PDF
論文紹介 LexToMap: lexical-based topological mapping
PDF
ロボティクスにおける SLAM 手法と実用化例
PDF
Introduction to 3D Computer Vision and Differentiable Rendering
PDF
[DL輪読会]画像を使ったSim2Realの現況
PDF
【DL輪読会】Implicit Behavioral Cloning
PDF
Visual SLAM: Why Bundle Adjust?の解説(第4回3D勉強会@関東)
PDF
論文紹介 Semantic Mapping for Mobile Robotics Tasks: A Survey
PDF
FPGA Hardware Accelerator for Machine Learning
PDF
Cartographer と Autoware を用いた自律走行
PDF
未来画像予測モデルと時間重み付けを導入した価値関数に基づく強化学習
PDF
オープンソース SLAM の分類
PPTX
次元圧縮周りでの気付き&1細胞発現データにおける次元圧縮の利用例@第3回wacode
PPTX
Graph Neural Network - Introduction
PPTX
バンディット問題について
確率ロボティクス第三回
第2回nips読み会・関西資料『unsupervised learning for physical interaction through video ...
四脚ロボットによる つくばチャレンジへの取り組み
[DL輪読会]DIVERSE TRAJECTORY FORECASTING WITH DETERMINANTAL POINT PROCESSES
GN-Net: The Gauss-Newton Loss for Deep Direct SLAMの解説
GPU - Basic Working
論文紹介 LexToMap: lexical-based topological mapping
ロボティクスにおける SLAM 手法と実用化例
Introduction to 3D Computer Vision and Differentiable Rendering
[DL輪読会]画像を使ったSim2Realの現況
【DL輪読会】Implicit Behavioral Cloning
Visual SLAM: Why Bundle Adjust?の解説(第4回3D勉強会@関東)
論文紹介 Semantic Mapping for Mobile Robotics Tasks: A Survey
FPGA Hardware Accelerator for Machine Learning
Cartographer と Autoware を用いた自律走行
未来画像予測モデルと時間重み付けを導入した価値関数に基づく強化学習
オープンソース SLAM の分類
次元圧縮周りでの気付き&1細胞発現データにおける次元圧縮の利用例@第3回wacode
Graph Neural Network - Introduction
バンディット問題について
Ad

Similar to Cruise AI under the Hood (20)

PDF
Fcv core sawhney
PDF
Towards Lensfield
PDF
HiPEAC 2019 Workshop - Real-Time Modelling Visual Scenes with Biological Insp...
PDF
CNI 2016 Fall Meeting - Serverless and Stateless Gaming Applications
PPTX
DemetTalk
PDF
ICS1020CV_2022.pdf
PDF
Hawaii Pacific GIS Conference 2012: LiDAR for Intrastructure and Terrian Mapp...
PDF
A web platform and a methodology to promote a collaborative development of co...
PDF
Detecting Anomalous Behavior with Surveillance​ Analytics​
PPTX
DT Company Overview January 2013
PDF
Traditional Machine Learning and Deep Learning on OpenPOWER/POWER systems
PPTX
Edge computing from cloud to computing power.pptx
PPS
PPTX
The Website Resiliency Imperative
PDF
Geo-referenced human-activity-data; access, processing and knowledge extraction
PDF
Deep Credit Risk Ranking with LSTM with Kyle Grove
PPTX
Automatic Asset Recognition #COMIT2017
PDF
Elevation mapping using stereo vision enabled heterogeneous multi-agent robot...
PPTX
Km in the cloud
Fcv core sawhney
Towards Lensfield
HiPEAC 2019 Workshop - Real-Time Modelling Visual Scenes with Biological Insp...
CNI 2016 Fall Meeting - Serverless and Stateless Gaming Applications
DemetTalk
ICS1020CV_2022.pdf
Hawaii Pacific GIS Conference 2012: LiDAR for Intrastructure and Terrian Mapp...
A web platform and a methodology to promote a collaborative development of co...
Detecting Anomalous Behavior with Surveillance​ Analytics​
DT Company Overview January 2013
Traditional Machine Learning and Deep Learning on OpenPOWER/POWER systems
Edge computing from cloud to computing power.pptx
The Website Resiliency Imperative
Geo-referenced human-activity-data; access, processing and knowledge extraction
Deep Credit Risk Ranking with LSTM with Kyle Grove
Automatic Asset Recognition #COMIT2017
Elevation mapping using stereo vision enabled heterogeneous multi-agent robot...
Km in the cloud
Ad

More from Yu Huang (20)

PDF
Embodied AI: Ushering in the Next Era of Intelligent Systems
PDF
GOSIM_China_2024_Embodied AI Data VLA World Model
PDF
Levels of AI Agents: from Rules to Large Language Models
PDF
Application of Foundation Model for Autonomous Driving
PDF
The New Perception Framework in Autonomous Driving: An Introduction of BEV N...
PDF
Data Closed Loop in Simulation Test of Autonomous Driving
PDF
BEV Joint Detection and Segmentation
PDF
BEV Object Detection and Prediction
PDF
Fisheye based Perception for Autonomous Driving VI
PDF
Fisheye/Omnidirectional View in Autonomous Driving V
PDF
Fisheye/Omnidirectional View in Autonomous Driving IV
PDF
Prediction,Planninng & Control at Baidu
PDF
LiDAR in the Adverse Weather: Dust, Snow, Rain and Fog (2)
PDF
Scenario-Based Development & Testing for Autonomous Driving
PDF
Annotation tools for ADAS & Autonomous Driving
PDF
Simulation for autonomous driving at uber atg
PDF
Multi sensor calibration by deep learning
PDF
Prediction and planning for self driving at waymo
PDF
Jointly mapping, localization, perception, prediction and planning
PDF
Data pipeline and data lake for autonomous driving
Embodied AI: Ushering in the Next Era of Intelligent Systems
GOSIM_China_2024_Embodied AI Data VLA World Model
Levels of AI Agents: from Rules to Large Language Models
Application of Foundation Model for Autonomous Driving
The New Perception Framework in Autonomous Driving: An Introduction of BEV N...
Data Closed Loop in Simulation Test of Autonomous Driving
BEV Joint Detection and Segmentation
BEV Object Detection and Prediction
Fisheye based Perception for Autonomous Driving VI
Fisheye/Omnidirectional View in Autonomous Driving V
Fisheye/Omnidirectional View in Autonomous Driving IV
Prediction,Planninng & Control at Baidu
LiDAR in the Adverse Weather: Dust, Snow, Rain and Fog (2)
Scenario-Based Development & Testing for Autonomous Driving
Annotation tools for ADAS & Autonomous Driving
Simulation for autonomous driving at uber atg
Multi sensor calibration by deep learning
Prediction and planning for self driving at waymo
Jointly mapping, localization, perception, prediction and planning
Data pipeline and data lake for autonomous driving

Recently uploaded (20)

PDF
MACCAFERRY GUIA GAVIONES TERRAPLENES EN ESPAÑOL
PDF
IAE-V2500 Engine Airbus Family A319/320
PPTX
Real Estate Management PART 1.pptxFFFFFFFFFFFFF
PPTX
DATA STRCUTURE LABORATORY -BCSL305(PRG1)
PDF
LS-6-Digital-Literacy (1) K12 CURRICULUM .pdf
PPTX
Solar energy pdf of gitam songa hemant k
PPTX
SE unit 1.pptx aaahshdhajdviwhsiehebeiwheiebeiev
PDF
VTU IOT LAB MANUAL (BCS701) Computer science and Engineering
PDF
Artificial Intelligence_ Basics .Artificial Intelligence_ Basics .
PPTX
SC Robotics Team Safety Training Presentation
PPTX
22ME926Introduction to Business Intelligence and Analytics, Advanced Integrat...
PPTX
MODULE 02 - CLOUD COMPUTING-Virtual Machines and Virtualization of Clusters a...
PPTX
1. Effective HSEW Induction Training - EMCO 2024, O&M.pptx
PPTX
Module1.pptxrjkeieuekwkwoowkemehehehrjrjrj
PPTX
chapter 1.pptx dotnet technology introduction
PPT
Module_1_Lecture_1_Introduction_To_Automation_In_Production_Systems2023.ppt
PPTX
Unit IILATHEACCESSORSANDATTACHMENTS.pptx
PPTX
IOP Unit 1.pptx for btech 1st year students
PPTX
Research Writing, Mechanical Engineering
PDF
Introduction to Machine Learning -Basic concepts,Models and Description
MACCAFERRY GUIA GAVIONES TERRAPLENES EN ESPAÑOL
IAE-V2500 Engine Airbus Family A319/320
Real Estate Management PART 1.pptxFFFFFFFFFFFFF
DATA STRCUTURE LABORATORY -BCSL305(PRG1)
LS-6-Digital-Literacy (1) K12 CURRICULUM .pdf
Solar energy pdf of gitam songa hemant k
SE unit 1.pptx aaahshdhajdviwhsiehebeiwheiebeiev
VTU IOT LAB MANUAL (BCS701) Computer science and Engineering
Artificial Intelligence_ Basics .Artificial Intelligence_ Basics .
SC Robotics Team Safety Training Presentation
22ME926Introduction to Business Intelligence and Analytics, Advanced Integrat...
MODULE 02 - CLOUD COMPUTING-Virtual Machines and Virtualization of Clusters a...
1. Effective HSEW Induction Training - EMCO 2024, O&M.pptx
Module1.pptxrjkeieuekwkwoowkemehehehrjrjrj
chapter 1.pptx dotnet technology introduction
Module_1_Lecture_1_Introduction_To_Automation_In_Production_Systems2023.ppt
Unit IILATHEACCESSORSANDATTACHMENTS.pptx
IOP Unit 1.pptx for btech 1st year students
Research Writing, Mechanical Engineering
Introduction to Machine Learning -Basic concepts,Models and Description

Cruise AI under the Hood

  • 1. Cruise.AI Under the Hood Yu Huang [email protected] Sunnyvvale, California
  • 2. Outline • Scene Understanding • Perception • Multiple sensor fusion • Tracking • Occlusion • Prediction • Interaction/social modeling • Mixture of experts gating • Decision Making • Criterion & Challenges • Decision & Plan • Uncertainty & Interaction • Imitation & Reinforcement Learning • Latency handling • Simulation • Real2Sim • 3-D geometric modeling • Rare data generation • Lidar point cloud simulation • Ecosystem • Continuous learning • AV development cycle • High quality data extraction • Visualization tool • Huge data to leverage for ML models • Scalability of fleet management • HD map building at scale