BOSCH TECHNICAL TRAININGS SUPPORTED BY
AUGMENTED REALITY
AWE USA, 29. MAY. 2019
PHIL LAFOND
Automotive Service Solutions | AA-AS - LaFond | 2019-05-29
© Bosch Automotive Service Solutions GmbH 2018. All rights reserved, also regarding any disposal, exploitation, reproduction, editing, distribution, as well as in the event of applications for industrial property rights.
2
Your speaker
Phil LaFond
North America Technical Lead – Augmented Reality
Bosch Automotive Service Solutions Inc.
Experience:
Automobile Technician
Precision Tune Auto Care Franchisee
Advanced Automobile Electronics Trainer
Welcome
Training with AR
Automotive Service Solutions | AA-AS - LaFond | 2019-05-29
© Bosch Automotive Service Solutions GmbH 2018. All rights reserved, also regarding any disposal, exploitation, reproduction, editing, distribution, as well as in the event of applications for industrial property rights.
3
Hybrid system
Hybrid system
Range extender
EV cars
Training with AR
Automotive Service Solutions | AA-AS - LaFond | 2019-05-29
© Bosch Automotive Service Solutions GmbH 2018. All rights reserved, also regarding any disposal, exploitation, reproduction, editing, distribution, as well as in the event of applications for industrial property rights.
4
Radar and camera systems
Training with AR
Automotive Service Solutions | AA-AS - LaFond | 2019-05-29
© Bosch Automotive Service Solutions GmbH 2018. All rights reserved, also regarding any disposal, exploitation, reproduction, editing, distribution, as well as in the event of applications for industrial property rights.
5
Network
Front-view camera
ECU
Belt retracting
arrangement left
Airbag ECU
Electric fuel
pump
Belt retracting
arrangement
right
Gear shift selector
lever ECU
Automatic
transmission ECU
ABS/ESP ECU
Lane-change
Assist ECU
All-wheel drive
ECU
Adaptive
damping ECU
Active suspension
ECU
Seat ECU Driver
Seat ECU Co-
passenger
Trailer ECU
Tire inflation
pressure check
ECU
Multi-function
switch
Reversing
camera ECU
Air conditioning
system ECU
Passenger
compartment mirror
Sliding roof
control unit
Central electronics 2, REM
Telecommunicati
ons-ECU
Audio
amplifier**
Radio-
Infotainment
unit*
Parking-assist
Tailgate lift
TV Tuner
DVD changer
Instrument
cluster
Structure-borne
noise ECU
MOST
Steering Assist
ECU
PT-CAN 2
K-CAN
Ethernet D-CAN
K-CAN 2
**K-CAN 2-linkage depending on equipping
version
Special vehicle
ECU ***
ACC Control unit
*MOST-and Ethernet-linkage depending on equipping
version
LIN
Engine
Control unit
Central electronics 1, FEM with Gateway
OBD-Port
Central electronics 1, FEM with Gateway
FlexRay
Training with AR
Automotive Service Solutions | AA-AS - LaFond | 2019-05-29
© Bosch Automotive Service Solutions GmbH 2018. All rights reserved, also regarding any disposal, exploitation, reproduction, editing, distribution, as well as in the event of applications for industrial property rights.
6
Workshops
Training with AR
Automotive Service Solutions | AA-AS - LaFond | 2019-05-29
© Bosch Automotive Service Solutions GmbH 2018. All rights reserved, also regarding any disposal, exploitation, reproduction, editing, distribution, as well as in the event of applications for industrial property rights.
7
Training Center
2017 = 1833 trainings – 14.287 trainees
Training with AR
Automotive Service Solutions | AA-AS - LaFond | 2019-05-29
© Bosch Automotive Service Solutions GmbH 2018. All rights reserved, also regarding any disposal, exploitation, reproduction, editing, distribution, as well as in the event of applications for industrial property rights.
8
Training 4.0
Training 4.0 Solution
Automotive Service Solutions | AA-AS - LaFond | 2019-05-29
© Bosch Automotive Service Solutions GmbH 2018. All rights reserved, also regarding any disposal, exploitation, reproduction, editing, distribution, as well as in the event of applications for industrial property rights.
9
Overview
„ Why:
„ New complex vehicle technologies,
‒ e.g. electric vehicles, heavy duty vehicles, Advanced Driver Assistance
Systems (ADAS) and autonomous driving
„ require new methods to meet the information needs of the
workshop operator.
„ AR added to conventional training techniques
‒ provides all the knowledge needed
„ What:
„ New Training 4.0 solution with Bosch CAP
„ CAP Video: https://www.youtube.com/watch?v=gefW8EC-ZCc
„ New training methods integrating Augmented Reality, workshop employees trained for complex systems.
„ The training can be performed on physical or virtual vehicles / components
Automotive Service Solutions | AA-AS - LaFond | 2019-05-29
© Bosch Automotive Service Solutions GmbH 2018. All rights reserved, also regarding any disposal, exploitation, reproduction, editing, distribution, as well as in the event of applications for industrial property rights.
10
„ How:
„ "Trainer Mode"
‒ trainer controls the training devices of the trainees
‒ decides what use cases they see on their devices
‒ trainer actions are transferred to trainee’s user equipment
‒ viewing angle remains individual for each participant
‒ All participants of the group actively follow the explanations of the
trainer and experience the training situation together
„ "Trainee Mode”
‒ trainer switches to the trainee’s device
‒ give direct hints and tips for topic
Training 4.0 Solution
Overview
Automotive Service Solutions | AA-AS - LaFond | 2019-05-29
© Bosch Automotive Service Solutions GmbH 2018. All rights reserved, also regarding any disposal, exploitation, reproduction, editing, distribution, as well as in the event of applications for industrial property rights.
11
T1
T Trainees
HoloLens
«Moderator»
HoloLens
«Attendee»
Training 4.0 Solution - HoloLens or Tablet 1/2
“Trainer controlled”
T2
M Trainer
DTC
DTC
DTC
Control
Control
Physical or augmented
vehicle(s) / object(s)
- on-site or remote locations
M
Automotive Service Solutions | AA-AS - LaFond | 2019-05-29
© Bosch Automotive Service Solutions GmbH 2018. All rights reserved, also regarding any disposal, exploitation, reproduction, editing, distribution, as well as in the event of applications for industrial property rights.
12
T1
T2
T Trainees
HoloLens
Standalone
HoloLens
Standalone
Training 4.0 Solution - HoloLens or Tablet 2/2
“Free exploration by trainee”
T3
M
M Trainer
1 or multiple
physical or
augmented
DTC
DTC
DTC
“Private”
Session
CAP Training 4.0 Solution
Automotive Service Solutions | AA-AS - LaFond | 2019-05-29
© Bosch Automotive Service Solutions GmbH 2018. All rights reserved, also regarding any disposal, exploitation, reproduction, editing, distribution, as well as in the event of applications for industrial property rights.
13
AR Platform high-level overview
Publish
Contextua
lize
Workflow
CAP AR Authoring
Tools
Authors
Viewer (Apps)
Server – Online / Cached - local
Authentication Layer
Data Package N
Data Package 1
Deployment Server
CAP Runtime Server
CAP AR Clients
For iOS, Android, Win, HL
Tablet, Smartphone, HoloLens,
Automotive Service Solutions | AA-AS - LaFond | 2019-05-29
© Bosch Automotive Service Solutions GmbH 2018. All rights reserved, also regarding any disposal, exploitation, reproduction, editing, distribution, as well as in the event of applications for industrial property rights.
Deployment Server
Authoring Delivery CAP training client
AR Content
Provider
AR Content
Training Content
Provider
Training Content
MetaData
Authoring Server (Authoring CMS)
AR PubEng
SI Pub Eng. AR Contentlinked
Training Content
AR Content +
Training
Modules
AR ContentTraining
Content
XML Editor AR 3D Editor AR Tracking
Editor
AR mapping
linked
linked
fetch
fetch
publish
14
Icons
Training
Information
Architecture of AR platform
3D CAD
Target
Image
CAD
Reference
2D
3D
A
u
t
h
e
n
t
i
c
a
t
i
o
n
CAP AR - Training Solution
Core Features (authentication, etc.)
Session control
Automotive Service Solutions | AA-AS - LaFond | 2019-05-29
© Bosch Automotive Service Solutions GmbH 2018. All rights reserved, also regarding any disposal, exploitation, reproduction, editing, distribution, as well as in the event of applications for industrial property rights.
15
Building blocks
Consultancy SW Licenses Authoring Services and Training Integration and Implementation
Services
• Requirements definition
• Solutions scale and setup
definition
• License package for
authoring system, runtime
system and clients
• Content creation
• Publication / Encapsulation
services
• Solution integration (e.g. in
larger environment)
• What do customers need ?
• Best solution approach ?
• Rollout plan ?
• Corresponding maintenance
and support contract
• Authoring training to enable
customer
• Authoring support to
continuously help customer
authors
• Feature implementation (e.g.
custom features)
Training 4.0 Solution
Applicable for:
- Sales training
- Technician Training
- Production Training
Automotive Service Solutions | AA-AS - LaFond | 2019-05-29
© Bosch Automotive Service Solutions GmbH 2018. All rights reserved, also regarding any disposal, exploitation, reproduction, editing, distribution, as well as in the event of applications for industrial property rights.
16
Overview – Benefits
„ Modern training methods in the workshop environment to train more complex systems
„ Building knowledge is associated with high costs and time, therefore knowledge retention is important à Higher knowledge retention
„ As a supplement to classic training for more complex system which e.g. need to be disassembled
„ Interactive learning method
„ Disassembled view à non-destructive via AR
„ Reduce cut models à no engine/parts need to be destroyed à save money
„ Information at the right time at the right place
„ Increase quality of training
„ Reduce cost by limiting traveling
„ Reduced effort to create training modules using CAP Augmented Reality Platform for authoring and publishing
„ CAP AR client available for iOS, Android, Windows and HoloLens
„ authored content (single source) can be viewed across devices and operating systems
Training 4.0 Solution
Automotive Service Solutions | AA-AS/SVW-Wagner | 2018-10-18
© Bosch Automotive Service Solutions GmbH 2018. All rights reserved, also regarding any disposal, exploitation, reproduction, editing, distribution, as well as in the event of applications for industrial property rights.
17
THANK
YOU
WHAT DRIVES YOU, DRIVES US!

Phil LaFond (Bosch Automotive Service Solutions Inc.): Bosch Technical Training Supported by AR

  • 1.
    BOSCH TECHNICAL TRAININGSSUPPORTED BY AUGMENTED REALITY AWE USA, 29. MAY. 2019 PHIL LAFOND
  • 2.
    Automotive Service Solutions| AA-AS - LaFond | 2019-05-29 © Bosch Automotive Service Solutions GmbH 2018. All rights reserved, also regarding any disposal, exploitation, reproduction, editing, distribution, as well as in the event of applications for industrial property rights. 2 Your speaker Phil LaFond North America Technical Lead – Augmented Reality Bosch Automotive Service Solutions Inc. Experience: Automobile Technician Precision Tune Auto Care Franchisee Advanced Automobile Electronics Trainer Welcome
  • 3.
    Training with AR AutomotiveService Solutions | AA-AS - LaFond | 2019-05-29 © Bosch Automotive Service Solutions GmbH 2018. All rights reserved, also regarding any disposal, exploitation, reproduction, editing, distribution, as well as in the event of applications for industrial property rights. 3 Hybrid system Hybrid system Range extender EV cars
  • 4.
    Training with AR AutomotiveService Solutions | AA-AS - LaFond | 2019-05-29 © Bosch Automotive Service Solutions GmbH 2018. All rights reserved, also regarding any disposal, exploitation, reproduction, editing, distribution, as well as in the event of applications for industrial property rights. 4 Radar and camera systems
  • 5.
    Training with AR AutomotiveService Solutions | AA-AS - LaFond | 2019-05-29 © Bosch Automotive Service Solutions GmbH 2018. All rights reserved, also regarding any disposal, exploitation, reproduction, editing, distribution, as well as in the event of applications for industrial property rights. 5 Network Front-view camera ECU Belt retracting arrangement left Airbag ECU Electric fuel pump Belt retracting arrangement right Gear shift selector lever ECU Automatic transmission ECU ABS/ESP ECU Lane-change Assist ECU All-wheel drive ECU Adaptive damping ECU Active suspension ECU Seat ECU Driver Seat ECU Co- passenger Trailer ECU Tire inflation pressure check ECU Multi-function switch Reversing camera ECU Air conditioning system ECU Passenger compartment mirror Sliding roof control unit Central electronics 2, REM Telecommunicati ons-ECU Audio amplifier** Radio- Infotainment unit* Parking-assist Tailgate lift TV Tuner DVD changer Instrument cluster Structure-borne noise ECU MOST Steering Assist ECU PT-CAN 2 K-CAN Ethernet D-CAN K-CAN 2 **K-CAN 2-linkage depending on equipping version Special vehicle ECU *** ACC Control unit *MOST-and Ethernet-linkage depending on equipping version LIN Engine Control unit Central electronics 1, FEM with Gateway OBD-Port Central electronics 1, FEM with Gateway FlexRay
  • 6.
    Training with AR AutomotiveService Solutions | AA-AS - LaFond | 2019-05-29 © Bosch Automotive Service Solutions GmbH 2018. All rights reserved, also regarding any disposal, exploitation, reproduction, editing, distribution, as well as in the event of applications for industrial property rights. 6 Workshops
  • 7.
    Training with AR AutomotiveService Solutions | AA-AS - LaFond | 2019-05-29 © Bosch Automotive Service Solutions GmbH 2018. All rights reserved, also regarding any disposal, exploitation, reproduction, editing, distribution, as well as in the event of applications for industrial property rights. 7 Training Center 2017 = 1833 trainings – 14.287 trainees
  • 8.
    Training with AR AutomotiveService Solutions | AA-AS - LaFond | 2019-05-29 © Bosch Automotive Service Solutions GmbH 2018. All rights reserved, also regarding any disposal, exploitation, reproduction, editing, distribution, as well as in the event of applications for industrial property rights. 8 Training 4.0
  • 9.
    Training 4.0 Solution AutomotiveService Solutions | AA-AS - LaFond | 2019-05-29 © Bosch Automotive Service Solutions GmbH 2018. All rights reserved, also regarding any disposal, exploitation, reproduction, editing, distribution, as well as in the event of applications for industrial property rights. 9 Overview „ Why: „ New complex vehicle technologies, ‒ e.g. electric vehicles, heavy duty vehicles, Advanced Driver Assistance Systems (ADAS) and autonomous driving „ require new methods to meet the information needs of the workshop operator. „ AR added to conventional training techniques ‒ provides all the knowledge needed „ What: „ New Training 4.0 solution with Bosch CAP „ CAP Video: https://www.youtube.com/watch?v=gefW8EC-ZCc „ New training methods integrating Augmented Reality, workshop employees trained for complex systems. „ The training can be performed on physical or virtual vehicles / components
  • 10.
    Automotive Service Solutions| AA-AS - LaFond | 2019-05-29 © Bosch Automotive Service Solutions GmbH 2018. All rights reserved, also regarding any disposal, exploitation, reproduction, editing, distribution, as well as in the event of applications for industrial property rights. 10 „ How: „ "Trainer Mode" ‒ trainer controls the training devices of the trainees ‒ decides what use cases they see on their devices ‒ trainer actions are transferred to trainee’s user equipment ‒ viewing angle remains individual for each participant ‒ All participants of the group actively follow the explanations of the trainer and experience the training situation together „ "Trainee Mode” ‒ trainer switches to the trainee’s device ‒ give direct hints and tips for topic Training 4.0 Solution Overview
  • 11.
    Automotive Service Solutions| AA-AS - LaFond | 2019-05-29 © Bosch Automotive Service Solutions GmbH 2018. All rights reserved, also regarding any disposal, exploitation, reproduction, editing, distribution, as well as in the event of applications for industrial property rights. 11 T1 T Trainees HoloLens «Moderator» HoloLens «Attendee» Training 4.0 Solution - HoloLens or Tablet 1/2 “Trainer controlled” T2 M Trainer DTC DTC DTC Control Control Physical or augmented vehicle(s) / object(s) - on-site or remote locations M
  • 12.
    Automotive Service Solutions| AA-AS - LaFond | 2019-05-29 © Bosch Automotive Service Solutions GmbH 2018. All rights reserved, also regarding any disposal, exploitation, reproduction, editing, distribution, as well as in the event of applications for industrial property rights. 12 T1 T2 T Trainees HoloLens Standalone HoloLens Standalone Training 4.0 Solution - HoloLens or Tablet 2/2 “Free exploration by trainee” T3 M M Trainer 1 or multiple physical or augmented DTC DTC DTC “Private” Session
  • 13.
    CAP Training 4.0Solution Automotive Service Solutions | AA-AS - LaFond | 2019-05-29 © Bosch Automotive Service Solutions GmbH 2018. All rights reserved, also regarding any disposal, exploitation, reproduction, editing, distribution, as well as in the event of applications for industrial property rights. 13 AR Platform high-level overview Publish Contextua lize Workflow CAP AR Authoring Tools Authors Viewer (Apps) Server – Online / Cached - local Authentication Layer Data Package N Data Package 1 Deployment Server CAP Runtime Server CAP AR Clients For iOS, Android, Win, HL Tablet, Smartphone, HoloLens,
  • 14.
    Automotive Service Solutions| AA-AS - LaFond | 2019-05-29 © Bosch Automotive Service Solutions GmbH 2018. All rights reserved, also regarding any disposal, exploitation, reproduction, editing, distribution, as well as in the event of applications for industrial property rights. Deployment Server Authoring Delivery CAP training client AR Content Provider AR Content Training Content Provider Training Content MetaData Authoring Server (Authoring CMS) AR PubEng SI Pub Eng. AR Contentlinked Training Content AR Content + Training Modules AR ContentTraining Content XML Editor AR 3D Editor AR Tracking Editor AR mapping linked linked fetch fetch publish 14 Icons Training Information Architecture of AR platform 3D CAD Target Image CAD Reference 2D 3D A u t h e n t i c a t i o n CAP AR - Training Solution Core Features (authentication, etc.) Session control
  • 15.
    Automotive Service Solutions| AA-AS - LaFond | 2019-05-29 © Bosch Automotive Service Solutions GmbH 2018. All rights reserved, also regarding any disposal, exploitation, reproduction, editing, distribution, as well as in the event of applications for industrial property rights. 15 Building blocks Consultancy SW Licenses Authoring Services and Training Integration and Implementation Services • Requirements definition • Solutions scale and setup definition • License package for authoring system, runtime system and clients • Content creation • Publication / Encapsulation services • Solution integration (e.g. in larger environment) • What do customers need ? • Best solution approach ? • Rollout plan ? • Corresponding maintenance and support contract • Authoring training to enable customer • Authoring support to continuously help customer authors • Feature implementation (e.g. custom features) Training 4.0 Solution Applicable for: - Sales training - Technician Training - Production Training
  • 16.
    Automotive Service Solutions| AA-AS - LaFond | 2019-05-29 © Bosch Automotive Service Solutions GmbH 2018. All rights reserved, also regarding any disposal, exploitation, reproduction, editing, distribution, as well as in the event of applications for industrial property rights. 16 Overview – Benefits „ Modern training methods in the workshop environment to train more complex systems „ Building knowledge is associated with high costs and time, therefore knowledge retention is important à Higher knowledge retention „ As a supplement to classic training for more complex system which e.g. need to be disassembled „ Interactive learning method „ Disassembled view à non-destructive via AR „ Reduce cut models à no engine/parts need to be destroyed à save money „ Information at the right time at the right place „ Increase quality of training „ Reduce cost by limiting traveling „ Reduced effort to create training modules using CAP Augmented Reality Platform for authoring and publishing „ CAP AR client available for iOS, Android, Windows and HoloLens „ authored content (single source) can be viewed across devices and operating systems Training 4.0 Solution
  • 17.
    Automotive Service Solutions| AA-AS/SVW-Wagner | 2018-10-18 © Bosch Automotive Service Solutions GmbH 2018. All rights reserved, also regarding any disposal, exploitation, reproduction, editing, distribution, as well as in the event of applications for industrial property rights. 17 THANK YOU WHAT DRIVES YOU, DRIVES US!