Transforming HealthCare with Technology
Digital Health
Revolution
• Mobile Health / eHealth
• Wearable Sensors
• Patient Centered
• Leverages Internet:
social, quantitative, collaborative
Medical Applications
of Virtual Reality &
Augmented Reality
Technology
Digital HealthRevolution
Although entertainment,
social connection and gaming
will drive the initial adoption of
VR technology, the deepest
and most significant market
for VR will be in clinical care
and in improving health and
wellness.
Medical Applications of Virtual Reality Technology
Now is the time for VR & AR
VR technology is now affordable,
scalable and accessible
Facebook - Oculus
Samsung - GearVR Sony – PlayStation VR
Microsoft - HoloLens
HTC - Vive Google - DayDream
AR MR XR Technology
11.3
16.9
27.3
41.5
56.2
68.0
Year2 Year3 Year4 Year5 Year6
Year1
Initial adoption will be driven through
game console, PC gaming and
mobile phone bundling.
Within 3 years, VR will likely be
adopted by 30 million users.
Within 6 years, VR will likely be adopted by 70 million users
Within 6 years, VR will likely be $35B Market
The Medical
VR / AR
Market
Segment is
projected to be
$5.1 B in 2025
Treating Post
Traumatic
Stress
With Virtual
Reality
2008 Sichuan
Earthquake
Treating Post
Traumatic
Stress
With Virtual
Reality
2017 Mexico City
Earthquake
Academic research has indicated that Virtual Reality can effectively treat a
wide variety of clinical problems – ranging from addictions, to stroke, to PTSD
Phobias / PTSD Stress Management /
Relaxation
Surgical Training /
Planning
Physical
Rehabilitation
Pain & Difficult
Procedure
Management
Exercise Cognitive
Rehabilitation
Optical
Rehabilitation Addictions Neuropsychological
Assessments
Cognitive Training
Wellness Sports Medicine Disability Solutions Speech Therapy
Autism Spectrum
Disorder
Mood Disorders Patient Education Preventive Health ADHD Senior Care
270 Medical VR/AR Companies
20 Clinical Sectors
Over 30 years of academic
research and over 3000 studies
demonstrate that VR can
improve behaviors,
attitudes, and health
Until now, the technology was
expensive, bulky, and difficult touse.
T
oday,we have the advancements to
bring VR to scale inhealthcare.
Why Now?
• Prevention and Wellness
• ObjectiveAssessments
• Functional Training
• Improved Interventions
• FacilitateAdherence
• Distributed Care Delivery
VR and AR technology will significantly impact Medical Care
• Clinical Skill Training
• Surgical Skill Training
• Interpersonal Skill Training
• Use of Equipment and Tools
• Team Training - eg: Emergency
Department, Surgical Team
• Emergency Response Training
and Rehearsal
• Facilitate Empathy
Medical Training
Team Training
Virtual Patients for Clinical Skill Training
Surgical Procedure Training
Knee
arthroscopy
simulator
Surgical Training
Medical Device Training
Disaster Preparation
Multi-Department Training and Rehearsal
Situation Awareness
Stress Inoculation
Staff Training – Team Training
Rehearsal for Unusual Situations
AR - Data Fusion, Situation Awareness
Clinical Training
Empathy for the Patient Experience
Patient Education & Informed Consent
Anatomy and Physiology Training
• Response to the acute shortage of human
cadavers
• Allows for repetitive training and self-study
• More detailed examination of micro-
features of organs, tissue etc.
• Integration of text, video and other media
to further enhance learning
Preoperative Planning & Image Guided Surgery
• Medical Image Review
• Neuropsychological
Assessments
• Activities of Daily Living
Assessments
• Physical Medicine – OT / PT
• Behavioral Medicine –
psychology, psychiatry
DIAGNOSTIC ASSESSMENTS
Standardized Environments for Neurocognitive Evaluation
New Approaches for Cognitive Assessment
Standardized Environments for Neurocognitive Evaluation
New Approaches for Cognitive Assessment
New Approaches for Cognitive Assessment
Standardized Environments for Neurocognitive Evaluation
Migrates traditional paper
and subjective evaluations
to a more sophisticated
level.
Provides robust
assessments that can
challenge cognitive skills in
a more natural,
standardized, objective
and reproducible manner.
BioMarkers - Cognitive and Emotional State
Collecting and analyzing emotional and physical
responses in VR
Improved cognitive function assessment at
the primary care level – using AR and
smartphone sensors
10 minutetest
Diagnostic accuracy of94%
FDAClassII MedicalDevice
Continuous data of everydayfunctions
250 features assessed at300Hz
3D trajectoryneuromotorparameters
Virtual environments are currently used clinically
Here are a few examples -
• Stroke and Traumatic Brain Injury
• Physical / Occupational Therapy
• Acute and Chronic Pain Mitigation
• Post-Traumatic Stress Disorder
• Generalized Anxiety Disorder
• Social Anxiety Disorder
• Depression
• Mild Cognitive Impairment
• Autism Spectrum Disorder
• ADHD
Virtual environments are used clinically to treat several
important mental and behavioral health problems
 Generalized Anxiety Disorder
 Phobias
 Obsessive Compulsive Disorder
 Anger Management
 Eating Disorders
 Schizophrenia
Virtual environments are used clinically to treat several
important mental and behavioral health problems
• Improve Cognitive Function
• Promote Exercise & Weight Management
• Stress Management
• Mood and Resilience
HEALTH AND WELLNESS
• Disability Solutions
• Addressing Isolation
• Grief Counseling
Portable Telemedicine Platform
Virtual Humans For Training, Confidential Interaction,
and Telemedicine Support
Virtual Humans For Training, Confidential Interaction,
and Telemedicine Support
“Smart Avatar” with a virtual voice,
image and mannerisms via AI
Preparation and Training for Difficult Situations
Some Examples
PTSD, Phobias, and Anxiety Disorders
• Exposure-based treatments can be conducted in the safety and comfort of an office setting
• Effective tools for treating a variety of clinical problems, in particular anxiety and addictive
disorders
• Fully immersive environments, with include the use of a head mounted display, 3D sound,
tactile stimulation via shaking platform, and olfactory stimulus are used for PTSD therapy
Palliative and Hospice Care
Cognitive Assessments for ADHD
• Enhanced Continuous Performance Test (CPT) in a real-
world classroom environment
• Can introduce visual and auditory distractions during CPT
administration
• More familiar for children than traditional PC-Based CPT
• Performance and response times more closely
approximate true classroom
• Can become a skill building platform
RISK AVOIDANCE TRAINING
Refusal skill training, Situational Confidence
Virtual Hospital Tours Used To Relieve Pre-procedure Anxiety
VR for Pain Distraction
Clinical Research and Validation
Interactive virtual environments significantly
reduce pain from as much as 44% during
the most painful procedures
(ex: burn wound treatment)
Diverts patient attention away from perceiving
and feeling pain; (selective attention theory)
Decreases pain-related brain-activity
Reduces need for anesthesia, opioid medication
No pharmacological side effects
Digital Health Platforms deliver interventions to patients, and
parse data for enhanced analysis
VR & AR - A Key Part of a CombinationTherapy
Digital HealthPlatform
Patient-facing software
designed to enhance
medication efficacy
Medication with
clinical benefit
eFormulation-
pharmaceutical
product with
enhanced efficacy
=
+
A Fully Integrated, Closed Loop Solution for Mental Health and Wellness -
Enabled on a Mobile,Digital Health Platform
Miniaturized, programmable,
low power electronic
architecturew/extensive therapy
delivery options
The Neuroscience of How VR Promotes Behavior Change
The Neuroscience of How VR Promotes
Behavior Change
VR can promote behavior change by
taking advantage of the way our brain’s
learning and reward systems function
VR systems can:
Activate neuroplastic change via reward
systems
Shorten the reward feedback loop –
show progress
Leverage mirror neuron systems
NeuroscienceRationale
It is necessary to activate the associated brain system
to enable neuroplasticity
Repetition is required
It is critical to engage the
brain's reward systems
Ability to change attitudes and behavior after “being” one’s future self.
Leveraging Mirror Neurons
Your Future Self
Students interacted with 3-D avatars of future self.
Participants who interacted with future self put more than twice
as much money into retirement account.
Why Use Interactive / Immersive Systems for Health?
• Active Involvement: AR/VR systems provide
patients with immersive experiences that make
them feel more involved in their care.
• Feedback: behavior is reinforced by direct,
immediate and relevant feedback that reinforces
positive behavior.
• Engaging and Motivating: gives patients
something to control and can provide immediate
rewards. (Contingency Management)
• Social Connections: provide and enhance
social resilience. (Social Physics)
• Cost Effective: Systems extend the effect of
therapy while reducing the cost of face-to-face
contact.
Novels
Theater
Film
Games
AR/VR
Wired for Narrative Stories
Research shows that STORY:
• Provides superior retention
(memory and recall)
• Provides improved understanding
• Creates context and relevance
• Creates empathy
• Makes readers/listeners pay attention
• Enhances the creation of meaning
What Are The Constraints?
What are the gating-steps to
adoption?
Rapid evolution = fears of obsolescence
Mobile / PC-Based vs. All-in-One
Which platform will prevail?
Graphics-based vs. 360 video
Concerns over infrastructure needs
Lack of IT support
No Clear Technology Path – Too Many Options
Body of literature is expanding with encouraging results,
But remains insufficient
Available research varies by condition treated
Lack of randomized controlled trials
Population-specific studies
Obsolete platforms and equipment
Small sample sizes
Research Gaps
Perception of VR as a Gaming Platform
Full practices – no need to attract new patients
Evidence-based treatments are already available
Products need to be aligned with
healthcare system needs
What is the financial and time benefit?
Does it interfere with the clinic workflow?
Improved Assessments and Diagnostics
Addressing Isolation and Loneliness
Acute and Chronic Pain
Depression and Anxiety Disorders
Physical and NeuroRehabilitation
Design for Disabilities
Post-Discharge Follow-up
Staff Training: not just procedures, but
empathy
Virtual Environments and Senior Care
• Current technologies and concepts are founded on more than 30 years of research and development
• Recent changes in cost and access make digital health technology affordable
• Digital health technology is currently used for prevention, evaluation, treatment and chronic disease
management
• After years of validation and use by early adopters – validated systems are poised to move to the
mainstream
• On the horizon: enhanced, ubiquitous, informative and integrated
Digital Health Technology For Medicine

virtualrealityandhealthcare.pptx

  • 1.
  • 2.
    Digital Health Revolution • MobileHealth / eHealth • Wearable Sensors • Patient Centered • Leverages Internet: social, quantitative, collaborative
  • 3.
    Medical Applications of VirtualReality & Augmented Reality Technology Digital HealthRevolution
  • 4.
    Although entertainment, social connectionand gaming will drive the initial adoption of VR technology, the deepest and most significant market for VR will be in clinical care and in improving health and wellness. Medical Applications of Virtual Reality Technology
  • 5.
    Now is thetime for VR & AR VR technology is now affordable, scalable and accessible Facebook - Oculus Samsung - GearVR Sony – PlayStation VR Microsoft - HoloLens HTC - Vive Google - DayDream
  • 6.
    AR MR XRTechnology
  • 8.
    11.3 16.9 27.3 41.5 56.2 68.0 Year2 Year3 Year4Year5 Year6 Year1 Initial adoption will be driven through game console, PC gaming and mobile phone bundling. Within 3 years, VR will likely be adopted by 30 million users. Within 6 years, VR will likely be adopted by 70 million users
  • 9.
    Within 6 years,VR will likely be $35B Market The Medical VR / AR Market Segment is projected to be $5.1 B in 2025
  • 10.
  • 11.
  • 12.
    Academic research hasindicated that Virtual Reality can effectively treat a wide variety of clinical problems – ranging from addictions, to stroke, to PTSD
  • 13.
    Phobias / PTSDStress Management / Relaxation Surgical Training / Planning Physical Rehabilitation Pain & Difficult Procedure Management Exercise Cognitive Rehabilitation Optical Rehabilitation Addictions Neuropsychological Assessments Cognitive Training Wellness Sports Medicine Disability Solutions Speech Therapy Autism Spectrum Disorder Mood Disorders Patient Education Preventive Health ADHD Senior Care 270 Medical VR/AR Companies 20 Clinical Sectors
  • 14.
    Over 30 yearsof academic research and over 3000 studies demonstrate that VR can improve behaviors, attitudes, and health Until now, the technology was expensive, bulky, and difficult touse. T oday,we have the advancements to bring VR to scale inhealthcare. Why Now?
  • 15.
    • Prevention andWellness • ObjectiveAssessments • Functional Training • Improved Interventions • FacilitateAdherence • Distributed Care Delivery VR and AR technology will significantly impact Medical Care
  • 16.
    • Clinical SkillTraining • Surgical Skill Training • Interpersonal Skill Training • Use of Equipment and Tools • Team Training - eg: Emergency Department, Surgical Team • Emergency Response Training and Rehearsal • Facilitate Empathy Medical Training
  • 17.
  • 18.
    Virtual Patients forClinical Skill Training
  • 19.
  • 20.
  • 21.
  • 22.
    Disaster Preparation Multi-Department Trainingand Rehearsal Situation Awareness Stress Inoculation Staff Training – Team Training Rehearsal for Unusual Situations AR - Data Fusion, Situation Awareness
  • 23.
    Clinical Training Empathy forthe Patient Experience
  • 24.
    Patient Education &Informed Consent
  • 25.
    Anatomy and PhysiologyTraining • Response to the acute shortage of human cadavers • Allows for repetitive training and self-study • More detailed examination of micro- features of organs, tissue etc. • Integration of text, video and other media to further enhance learning
  • 26.
    Preoperative Planning &Image Guided Surgery
  • 27.
    • Medical ImageReview • Neuropsychological Assessments • Activities of Daily Living Assessments • Physical Medicine – OT / PT • Behavioral Medicine – psychology, psychiatry DIAGNOSTIC ASSESSMENTS
  • 28.
    Standardized Environments forNeurocognitive Evaluation New Approaches for Cognitive Assessment
  • 29.
    Standardized Environments forNeurocognitive Evaluation New Approaches for Cognitive Assessment
  • 30.
    New Approaches forCognitive Assessment Standardized Environments for Neurocognitive Evaluation Migrates traditional paper and subjective evaluations to a more sophisticated level. Provides robust assessments that can challenge cognitive skills in a more natural, standardized, objective and reproducible manner.
  • 31.
    BioMarkers - Cognitiveand Emotional State Collecting and analyzing emotional and physical responses in VR
  • 32.
    Improved cognitive functionassessment at the primary care level – using AR and smartphone sensors 10 minutetest Diagnostic accuracy of94% FDAClassII MedicalDevice Continuous data of everydayfunctions 250 features assessed at300Hz 3D trajectoryneuromotorparameters
  • 33.
    Virtual environments arecurrently used clinically Here are a few examples - • Stroke and Traumatic Brain Injury • Physical / Occupational Therapy • Acute and Chronic Pain Mitigation
  • 34.
    • Post-Traumatic StressDisorder • Generalized Anxiety Disorder • Social Anxiety Disorder • Depression • Mild Cognitive Impairment • Autism Spectrum Disorder • ADHD Virtual environments are used clinically to treat several important mental and behavioral health problems
  • 35.
     Generalized AnxietyDisorder  Phobias  Obsessive Compulsive Disorder  Anger Management  Eating Disorders  Schizophrenia Virtual environments are used clinically to treat several important mental and behavioral health problems
  • 37.
    • Improve CognitiveFunction • Promote Exercise & Weight Management • Stress Management • Mood and Resilience HEALTH AND WELLNESS • Disability Solutions • Addressing Isolation • Grief Counseling
  • 38.
  • 39.
    Virtual Humans ForTraining, Confidential Interaction, and Telemedicine Support
  • 40.
    Virtual Humans ForTraining, Confidential Interaction, and Telemedicine Support “Smart Avatar” with a virtual voice, image and mannerisms via AI
  • 41.
    Preparation and Trainingfor Difficult Situations
  • 42.
  • 43.
    PTSD, Phobias, andAnxiety Disorders • Exposure-based treatments can be conducted in the safety and comfort of an office setting • Effective tools for treating a variety of clinical problems, in particular anxiety and addictive disorders • Fully immersive environments, with include the use of a head mounted display, 3D sound, tactile stimulation via shaking platform, and olfactory stimulus are used for PTSD therapy
  • 44.
  • 45.
    Cognitive Assessments forADHD • Enhanced Continuous Performance Test (CPT) in a real- world classroom environment • Can introduce visual and auditory distractions during CPT administration • More familiar for children than traditional PC-Based CPT • Performance and response times more closely approximate true classroom • Can become a skill building platform
  • 46.
    RISK AVOIDANCE TRAINING Refusalskill training, Situational Confidence
  • 47.
    Virtual Hospital ToursUsed To Relieve Pre-procedure Anxiety
  • 48.
    VR for PainDistraction Clinical Research and Validation Interactive virtual environments significantly reduce pain from as much as 44% during the most painful procedures (ex: burn wound treatment) Diverts patient attention away from perceiving and feeling pain; (selective attention theory) Decreases pain-related brain-activity Reduces need for anesthesia, opioid medication No pharmacological side effects
  • 49.
    Digital Health Platformsdeliver interventions to patients, and parse data for enhanced analysis
  • 50.
    VR & AR- A Key Part of a CombinationTherapy Digital HealthPlatform Patient-facing software designed to enhance medication efficacy Medication with clinical benefit eFormulation- pharmaceutical product with enhanced efficacy = +
  • 51.
    A Fully Integrated,Closed Loop Solution for Mental Health and Wellness - Enabled on a Mobile,Digital Health Platform Miniaturized, programmable, low power electronic architecturew/extensive therapy delivery options
  • 52.
    The Neuroscience ofHow VR Promotes Behavior Change
  • 53.
    The Neuroscience ofHow VR Promotes Behavior Change VR can promote behavior change by taking advantage of the way our brain’s learning and reward systems function VR systems can: Activate neuroplastic change via reward systems Shorten the reward feedback loop – show progress Leverage mirror neuron systems
  • 54.
    NeuroscienceRationale It is necessaryto activate the associated brain system to enable neuroplasticity Repetition is required It is critical to engage the brain's reward systems
  • 55.
    Ability to changeattitudes and behavior after “being” one’s future self. Leveraging Mirror Neurons
  • 56.
    Your Future Self Studentsinteracted with 3-D avatars of future self. Participants who interacted with future self put more than twice as much money into retirement account.
  • 57.
    Why Use Interactive/ Immersive Systems for Health? • Active Involvement: AR/VR systems provide patients with immersive experiences that make them feel more involved in their care. • Feedback: behavior is reinforced by direct, immediate and relevant feedback that reinforces positive behavior. • Engaging and Motivating: gives patients something to control and can provide immediate rewards. (Contingency Management) • Social Connections: provide and enhance social resilience. (Social Physics) • Cost Effective: Systems extend the effect of therapy while reducing the cost of face-to-face contact. Novels Theater Film Games AR/VR
  • 58.
    Wired for NarrativeStories Research shows that STORY: • Provides superior retention (memory and recall) • Provides improved understanding • Creates context and relevance • Creates empathy • Makes readers/listeners pay attention • Enhances the creation of meaning
  • 59.
    What Are TheConstraints? What are the gating-steps to adoption?
  • 60.
    Rapid evolution =fears of obsolescence Mobile / PC-Based vs. All-in-One Which platform will prevail? Graphics-based vs. 360 video Concerns over infrastructure needs Lack of IT support No Clear Technology Path – Too Many Options
  • 61.
    Body of literatureis expanding with encouraging results, But remains insufficient Available research varies by condition treated Lack of randomized controlled trials Population-specific studies Obsolete platforms and equipment Small sample sizes Research Gaps
  • 62.
    Perception of VRas a Gaming Platform
  • 63.
    Full practices –no need to attract new patients Evidence-based treatments are already available Products need to be aligned with healthcare system needs What is the financial and time benefit? Does it interfere with the clinic workflow?
  • 64.
    Improved Assessments andDiagnostics Addressing Isolation and Loneliness Acute and Chronic Pain Depression and Anxiety Disorders Physical and NeuroRehabilitation Design for Disabilities Post-Discharge Follow-up Staff Training: not just procedures, but empathy Virtual Environments and Senior Care
  • 65.
    • Current technologiesand concepts are founded on more than 30 years of research and development • Recent changes in cost and access make digital health technology affordable • Digital health technology is currently used for prevention, evaluation, treatment and chronic disease management • After years of validation and use by early adopters – validated systems are poised to move to the mainstream • On the horizon: enhanced, ubiquitous, informative and integrated Digital Health Technology For Medicine