SlideShare a Scribd company logo
A STUDY ON STABLE HAPTIC RENDERING METHODS USING FPGA Student: Trung Hieu Do   Advisor: Jee-Hwan Ryu BioRobotics Lab. School of ME -  Korea University of Technology and Education
Contents Haptic Interfaces and Stability Analysis Review of the Time Domain Passivity Approach Proposed Methods Memory-based Method Multi-rate TDPA Method Experimental Setup Conclusions & Future works References
Haptic Interfaces & Stability Analysis
Overview of Haptic Interfaces Assumption: Virtual Objects are  Static & Passive Master Device Human Operator Computer-based VE Slow update rate N. Diolaiti, G. Niemeyer, F. Barbagli, J. Kenneth Salisbury, Jr, ”Stability of Haptic  Rendering: Discreatization, Quantization, Time-Delay and Coulomb Effects,”   IEEE  Transactions on Robotics , 22(2): pp. 256-268, April 2006. Human Operator Computer-based VE Slow update rate Embedded Haptic Controller Fast update rate 10-100 Hz 1-10kHz Master Device
Zero Order Hold & The Effect of Discretization Analog
Unstable Behavior of Haptic Interface
Review of the  Time Domain Passivity Approach
Time Domain Passivity Approach Passivity Observer (PO): Passivity Controller (PC): TDPA Human  Operator Master Device Computer-based VE PC PO 10-100 Hz
Ideal Behavior of TPDA Method
Block Diagram  Conventional TDPA method PO Update PO PC Clock signal Reset PO Conv. TDPA Stability Controller Update PC
Noisy Behavior of Conventional TDPA J-H. Ryu, B. Hannaford, D-S. Kwon, and J-H. Kim, “A Simulation/Experimental Study of the Noisy Behavior of the Time Domain Passivity Controller,”  IEEE Trans. on Robotics , Vol. 21, No. 4, pp. 733-741.
Noisy Behavior of Conv. TDPA
Block Diagram FPGA-based TDPA PO Update PO PC Reset PO FPGA-based TDPA Stability Controller Motion Detector Update PC Reset PO Irregular activating method Increase activating speed of PC Reduce generated energy B. Han, J-H. Ryu “An Injecting Method of Physical Damping to Haptic Interfaces Based on FPGA,”  Proceedings of the International Conference on Control, Automation and Systems   (ICCAS 2008) , Seoul, Korea, pp. 1835-1840.
Stable Behavior FPGA-based TDPA
Noisy Behavior in Stiffer VE
Memory-based method Proposed methods
Idea of Memory-based Method Memorize the pressing forces Use pressing forces as boundaries  for releasing forces VE characteristics changes  when releasing. However Pressing period is more  important for human feeling. Pressing Releasing Position
Block Diagram Memory-based Method Select Switch Data Address R/W Memory Direction Detector Memory-based method Stability Controller
Stable Behavior Memory-based Method
Slow Interaction Behavior  Memory-based method
Proposed Methods Multi-rate TDPA method
Multi-rate Haptic Computer-based VE 0.1kHz Multi-rate Haptic Controller 10kHz 10kHz sample rate Master device FPGA Human Operator Analog 0.1kHz sample rate
Multi-rate Haptic Interpolation Method M. C. Cavusoglu and F. Tendick, "Multirate Simulation for High Fidelity Haptic Interaction with Deformable Objects in Virtual Environments," in  Proceedings of the IEEE International Conference on Robotics and Automation , 2000, pp. 2458-2465. F(t)
Behavior of Multi-rate Haptic  Fm[N]
Activity of Multi-rate Haptic Interface Active period Passive period
Activity of Multi-rate Haptic Multi-rate haptic can’t guarantee Stability    TDPA method Generated energy:
Multi-rate TDPA Computer-based VE 0.1kHz Multi-rate Force estimator 10kHz Time Domain Passivity Controller 10kHz Human Operator FPGA Master device
Block Diagram of Multi-rate TDPA FPGA-based Haptic Controller Force interpolator PC-based VE Down sample Encoder reader Multi-rate TDPA Stability Controller Conv.TDPA or  event-based TDPA
Dissipitation of Generated Energy PC activated
Stability of Multi-rate TDPA
Slow Interaction of Multi-rate TDPA
Experimental Setup
Haptic System Human operator Motor driver Mechanical interface Master Device FPGA-Based Haptic Controller PC-based VE Physical  interaction Virtual  Interaction
Software Architecture Parrallel, complicated, flexible, high-speed and simultaneous tasks The necessity of FPGA technology. A DSP/MCU-based system is possible but difficult to realize. Stability  Controller PC-based VE 0.1kHz PI Current Controller 50kHz Position  counter Elapsed  timer Direction detector Encoder reader A phase B phase Position PWM output Measured force (current) FPGA-based haptic controller PWM generator FIFO data  acquisition 5 kHz TCP/IP
Conclusions & Future Works
Maximum VE Stiffness VE
Conclusions Methods Features FPGA-based TDPA Memory-based Multi-rate TDPA Performance Worst performance Better performance Best performance Range of impedance Lowest max. stiffness Higher max.stiffness Highest max.stiffness Noise behavior Noise behavior Less noise behavior Least noise behavior Distortion (VE) When activity detected  When releasing force higher than pressing force Interpolation& When activity detected Conservativeness No No Assumption of slowly change VE Update method Irregular update  fast interupt Irregular update  fast interupt Regular update Algorithm comlexity Simple Simplest Complicated Others Need high-speed RAM (Random access memory)
Future Works Apply proposed methods to moving and time varying VE. Improve performance of methods: less noise, wider range of impedace, more general cases. Implement to Teleoperation. Implement methods in lower cost devices: MCUs or DSPs.
References M. C. Cavusoglu and F. Tendick, "Multirate Simulation for High Fidelity Haptic Interaction with Deformable Objects in Virtual Environments," in  Proceedings of the IEEE International Conference on Robotics and Automation , 2000, pp. 2458-2465. B. Han, J-H. Ryu “An Injecting Method of Physical Damping to Haptic Interfaces Based on FPGA,”  Proceedings of the International Conference on Control, Automation and Systems   (ICCAS 2008) , Seoul, Korea, pp. 1835-1840. J-H. Ryu, B. Hannaford, D-S. Kwon, and J-H. Kim, “A Simulation/Experimental Study of the Noisy Behavior of the Time Domain Passivity Controller,”  IEEE Trans. on Robotics , Vol. 21, No. 4, pp. 733-741.  N. Diolaiti, G. Niemeyer, F. Barbagli, J. Kenneth Salisbury, Jr, ”Stability of Haptic Rendering: Discreatization, Quantization, Time-Delay and Coulomb Effects,”   IEEE Transactions on Robotics , 22(2): pp. 256-268, April 2006. J-H. Ryu, B. Hannaford, D-S. Kwon, and J-H. Kim, “A Simulation/Experimental Study of the Noisy Behavior of the Time Domain Passivity Controller,”  IEEE Trans. on Robotics , Vol. 21, No. 4, pp. 733-741.
Implementation on  High-Stiffness Moving Objects Master 1 Master 2 Passivate Object Virtual object
THANK YOU

More Related Content

Similar to Stable rendering methods for Haptic interaction (20)

PPT
Haptic technology
anjaliashah
 
PDF
iros02print
Song You (??)
 
PDF
Haptic Rendering Foundations Algorithms And Applications Ming C Lin
rjrhave9806
 
DOC
Haptic technology
Shiva Krishna Chandra Shekar
 
PPTX
Haptic Technology ppt
Arun Sivaraj
 
PPTX
Haptic technology
Akshay Sharma
 
PDF
A Hardware Interface for Joint Control in the AD Architecture
Víctor Pacheco
 
PPTX
Haptic Technology
Seminar Links
 
PDF
Selected Work Portfolio
David
 
PPTX
thesis presentation_liyang
Liyang Zhang
 
PPTX
wearable_HAPTIC_TECHNOLOGY_pptx.pptx
MrRRThirrunavukkaras
 
PDF
COMP 4010 Lecture6 - Virtual Reality Input Devices
Mark Billinghurst
 
PPTX
HAPTIC TECHNOLOGY.pptx
Akashhari6
 
PDF
Haptic Communications
Förderverein Technische Fakultät
 
PPTX
Virtual Reality Training for Upper Limb Prosthesis Patients
Annette Mossel
 
PPTX
Haptic technology
gandra jeeshitha
 
PDF
MEMS Extraction & Verification
intellisense
 
PPTX
Haptic Technology
Uttej Kumar Palavai
 
PPTX
HAPTIC_TECH ppt final.pptx
AbhishekPatwardhan10
 
KEY
Finger Rehabilitation Robot - Justinas Miseikis
Justas Miseikis
 
Haptic technology
anjaliashah
 
iros02print
Song You (??)
 
Haptic Rendering Foundations Algorithms And Applications Ming C Lin
rjrhave9806
 
Haptic technology
Shiva Krishna Chandra Shekar
 
Haptic Technology ppt
Arun Sivaraj
 
Haptic technology
Akshay Sharma
 
A Hardware Interface for Joint Control in the AD Architecture
Víctor Pacheco
 
Haptic Technology
Seminar Links
 
Selected Work Portfolio
David
 
thesis presentation_liyang
Liyang Zhang
 
wearable_HAPTIC_TECHNOLOGY_pptx.pptx
MrRRThirrunavukkaras
 
COMP 4010 Lecture6 - Virtual Reality Input Devices
Mark Billinghurst
 
HAPTIC TECHNOLOGY.pptx
Akashhari6
 
Haptic Communications
Förderverein Technische Fakultät
 
Virtual Reality Training for Upper Limb Prosthesis Patients
Annette Mossel
 
Haptic technology
gandra jeeshitha
 
MEMS Extraction & Verification
intellisense
 
Haptic Technology
Uttej Kumar Palavai
 
HAPTIC_TECH ppt final.pptx
AbhishekPatwardhan10
 
Finger Rehabilitation Robot - Justinas Miseikis
Justas Miseikis
 

Recently uploaded (20)

PDF
IMP NAAC-Reforms-Stakeholder-Consultation-Presentation-on-Draft-Metrics-Unive...
BHARTIWADEKAR
 
PPTX
How to Manage Promotions in Odoo 18 Sales
Celine George
 
PPTX
How to Configure Lost Reasons in Odoo 18 CRM
Celine George
 
PPT
Talk on Critical Theory, Part One, Philosophy of Social Sciences
Soraj Hongladarom
 
PPTX
How to Configure Access Rights of Manufacturing Orders in Odoo 18 Manufacturing
Celine George
 
PDF
IMP NAAC REFORMS 2024 - 10 Attributes.pdf
BHARTIWADEKAR
 
PPTX
Gall bladder, Small intestine and Large intestine.pptx
rekhapositivity
 
PPTX
Views on Education of Indian Thinkers Mahatma Gandhi.pptx
ShrutiMahanta1
 
PPTX
BANDHA (BANDAGES) PPT.pptx ayurveda shalya tantra
rakhan78619
 
PDF
Dimensions of Societal Planning in Commonism
StefanMz
 
PDF
ARAL_Orientation_Day-2-Sessions_ARAL-Readung ARAL-Mathematics ARAL-Sciencev2.pdf
JoelVilloso1
 
PDF
LAW OF CONTRACT ( 5 YEAR LLB & UNITARY LLB)- MODULE-3 - LEARN THROUGH PICTURE
APARNA T SHAIL KUMAR
 
PPTX
2025 Winter SWAYAM NPTEL & A Student.pptx
Utsav Yagnik
 
PPTX
Soil and agriculture microbiology .pptx
Keerthana Ramesh
 
PDF
BÀI TẬP BỔ TRỢ TIẾNG ANH 8 - GLOBAL SUCCESS - CẢ NĂM - NĂM 2024 (VOCABULARY, ...
Nguyen Thanh Tu Collection
 
PPTX
Growth and development and milestones, factors
BHUVANESHWARI BADIGER
 
PDF
CHILD RIGHTS AND PROTECTION QUESTION BANK
Dr Raja Mohammed T
 
PDF
CEREBRAL PALSY: NURSING MANAGEMENT .pdf
PRADEEP ABOTHU
 
PDF
CONCURSO DE POESIA “POETUFAS – PASSOS SUAVES PELO VERSO.pdf
Colégio Santa Teresinha
 
PPSX
Health Planning in india - Unit 03 - CHN 2 - GNM 3RD YEAR.ppsx
Priyanshu Anand
 
IMP NAAC-Reforms-Stakeholder-Consultation-Presentation-on-Draft-Metrics-Unive...
BHARTIWADEKAR
 
How to Manage Promotions in Odoo 18 Sales
Celine George
 
How to Configure Lost Reasons in Odoo 18 CRM
Celine George
 
Talk on Critical Theory, Part One, Philosophy of Social Sciences
Soraj Hongladarom
 
How to Configure Access Rights of Manufacturing Orders in Odoo 18 Manufacturing
Celine George
 
IMP NAAC REFORMS 2024 - 10 Attributes.pdf
BHARTIWADEKAR
 
Gall bladder, Small intestine and Large intestine.pptx
rekhapositivity
 
Views on Education of Indian Thinkers Mahatma Gandhi.pptx
ShrutiMahanta1
 
BANDHA (BANDAGES) PPT.pptx ayurveda shalya tantra
rakhan78619
 
Dimensions of Societal Planning in Commonism
StefanMz
 
ARAL_Orientation_Day-2-Sessions_ARAL-Readung ARAL-Mathematics ARAL-Sciencev2.pdf
JoelVilloso1
 
LAW OF CONTRACT ( 5 YEAR LLB & UNITARY LLB)- MODULE-3 - LEARN THROUGH PICTURE
APARNA T SHAIL KUMAR
 
2025 Winter SWAYAM NPTEL & A Student.pptx
Utsav Yagnik
 
Soil and agriculture microbiology .pptx
Keerthana Ramesh
 
BÀI TẬP BỔ TRỢ TIẾNG ANH 8 - GLOBAL SUCCESS - CẢ NĂM - NĂM 2024 (VOCABULARY, ...
Nguyen Thanh Tu Collection
 
Growth and development and milestones, factors
BHUVANESHWARI BADIGER
 
CHILD RIGHTS AND PROTECTION QUESTION BANK
Dr Raja Mohammed T
 
CEREBRAL PALSY: NURSING MANAGEMENT .pdf
PRADEEP ABOTHU
 
CONCURSO DE POESIA “POETUFAS – PASSOS SUAVES PELO VERSO.pdf
Colégio Santa Teresinha
 
Health Planning in india - Unit 03 - CHN 2 - GNM 3RD YEAR.ppsx
Priyanshu Anand
 
Ad

Stable rendering methods for Haptic interaction

  • 1. A STUDY ON STABLE HAPTIC RENDERING METHODS USING FPGA Student: Trung Hieu Do Advisor: Jee-Hwan Ryu BioRobotics Lab. School of ME - Korea University of Technology and Education
  • 2. Contents Haptic Interfaces and Stability Analysis Review of the Time Domain Passivity Approach Proposed Methods Memory-based Method Multi-rate TDPA Method Experimental Setup Conclusions & Future works References
  • 3. Haptic Interfaces & Stability Analysis
  • 4. Overview of Haptic Interfaces Assumption: Virtual Objects are Static & Passive Master Device Human Operator Computer-based VE Slow update rate N. Diolaiti, G. Niemeyer, F. Barbagli, J. Kenneth Salisbury, Jr, ”Stability of Haptic Rendering: Discreatization, Quantization, Time-Delay and Coulomb Effects,”   IEEE Transactions on Robotics , 22(2): pp. 256-268, April 2006. Human Operator Computer-based VE Slow update rate Embedded Haptic Controller Fast update rate 10-100 Hz 1-10kHz Master Device
  • 5. Zero Order Hold & The Effect of Discretization Analog
  • 6. Unstable Behavior of Haptic Interface
  • 7. Review of the Time Domain Passivity Approach
  • 8. Time Domain Passivity Approach Passivity Observer (PO): Passivity Controller (PC): TDPA Human Operator Master Device Computer-based VE PC PO 10-100 Hz
  • 9. Ideal Behavior of TPDA Method
  • 10. Block Diagram Conventional TDPA method PO Update PO PC Clock signal Reset PO Conv. TDPA Stability Controller Update PC
  • 11. Noisy Behavior of Conventional TDPA J-H. Ryu, B. Hannaford, D-S. Kwon, and J-H. Kim, “A Simulation/Experimental Study of the Noisy Behavior of the Time Domain Passivity Controller,” IEEE Trans. on Robotics , Vol. 21, No. 4, pp. 733-741.
  • 12. Noisy Behavior of Conv. TDPA
  • 13. Block Diagram FPGA-based TDPA PO Update PO PC Reset PO FPGA-based TDPA Stability Controller Motion Detector Update PC Reset PO Irregular activating method Increase activating speed of PC Reduce generated energy B. Han, J-H. Ryu “An Injecting Method of Physical Damping to Haptic Interfaces Based on FPGA,” Proceedings of the International Conference on Control, Automation and Systems (ICCAS 2008) , Seoul, Korea, pp. 1835-1840.
  • 15. Noisy Behavior in Stiffer VE
  • 17. Idea of Memory-based Method Memorize the pressing forces Use pressing forces as boundaries for releasing forces VE characteristics changes when releasing. However Pressing period is more important for human feeling. Pressing Releasing Position
  • 18. Block Diagram Memory-based Method Select Switch Data Address R/W Memory Direction Detector Memory-based method Stability Controller
  • 20. Slow Interaction Behavior Memory-based method
  • 22. Multi-rate Haptic Computer-based VE 0.1kHz Multi-rate Haptic Controller 10kHz 10kHz sample rate Master device FPGA Human Operator Analog 0.1kHz sample rate
  • 23. Multi-rate Haptic Interpolation Method M. C. Cavusoglu and F. Tendick, "Multirate Simulation for High Fidelity Haptic Interaction with Deformable Objects in Virtual Environments," in Proceedings of the IEEE International Conference on Robotics and Automation , 2000, pp. 2458-2465. F(t)
  • 24. Behavior of Multi-rate Haptic Fm[N]
  • 25. Activity of Multi-rate Haptic Interface Active period Passive period
  • 26. Activity of Multi-rate Haptic Multi-rate haptic can’t guarantee Stability  TDPA method Generated energy:
  • 27. Multi-rate TDPA Computer-based VE 0.1kHz Multi-rate Force estimator 10kHz Time Domain Passivity Controller 10kHz Human Operator FPGA Master device
  • 28. Block Diagram of Multi-rate TDPA FPGA-based Haptic Controller Force interpolator PC-based VE Down sample Encoder reader Multi-rate TDPA Stability Controller Conv.TDPA or event-based TDPA
  • 29. Dissipitation of Generated Energy PC activated
  • 31. Slow Interaction of Multi-rate TDPA
  • 33. Haptic System Human operator Motor driver Mechanical interface Master Device FPGA-Based Haptic Controller PC-based VE Physical interaction Virtual Interaction
  • 34. Software Architecture Parrallel, complicated, flexible, high-speed and simultaneous tasks The necessity of FPGA technology. A DSP/MCU-based system is possible but difficult to realize. Stability Controller PC-based VE 0.1kHz PI Current Controller 50kHz Position counter Elapsed timer Direction detector Encoder reader A phase B phase Position PWM output Measured force (current) FPGA-based haptic controller PWM generator FIFO data acquisition 5 kHz TCP/IP
  • 37. Conclusions Methods Features FPGA-based TDPA Memory-based Multi-rate TDPA Performance Worst performance Better performance Best performance Range of impedance Lowest max. stiffness Higher max.stiffness Highest max.stiffness Noise behavior Noise behavior Less noise behavior Least noise behavior Distortion (VE) When activity detected When releasing force higher than pressing force Interpolation& When activity detected Conservativeness No No Assumption of slowly change VE Update method Irregular update  fast interupt Irregular update  fast interupt Regular update Algorithm comlexity Simple Simplest Complicated Others Need high-speed RAM (Random access memory)
  • 38. Future Works Apply proposed methods to moving and time varying VE. Improve performance of methods: less noise, wider range of impedace, more general cases. Implement to Teleoperation. Implement methods in lower cost devices: MCUs or DSPs.
  • 39. References M. C. Cavusoglu and F. Tendick, "Multirate Simulation for High Fidelity Haptic Interaction with Deformable Objects in Virtual Environments," in Proceedings of the IEEE International Conference on Robotics and Automation , 2000, pp. 2458-2465. B. Han, J-H. Ryu “An Injecting Method of Physical Damping to Haptic Interfaces Based on FPGA,” Proceedings of the International Conference on Control, Automation and Systems (ICCAS 2008) , Seoul, Korea, pp. 1835-1840. J-H. Ryu, B. Hannaford, D-S. Kwon, and J-H. Kim, “A Simulation/Experimental Study of the Noisy Behavior of the Time Domain Passivity Controller,” IEEE Trans. on Robotics , Vol. 21, No. 4, pp. 733-741. N. Diolaiti, G. Niemeyer, F. Barbagli, J. Kenneth Salisbury, Jr, ”Stability of Haptic Rendering: Discreatization, Quantization, Time-Delay and Coulomb Effects,”   IEEE Transactions on Robotics , 22(2): pp. 256-268, April 2006. J-H. Ryu, B. Hannaford, D-S. Kwon, and J-H. Kim, “A Simulation/Experimental Study of the Noisy Behavior of the Time Domain Passivity Controller,” IEEE Trans. on Robotics , Vol. 21, No. 4, pp. 733-741.
  • 40. Implementation on High-Stiffness Moving Objects Master 1 Master 2 Passivate Object Virtual object

Editor's Notes

  • #5: First of all, we have a review ... What is haptic interfaces and how is it constructed? includes of 3 main parts: PC-based VE, Human operator and Master device. Usually, VE is implemented inside a computer, using GPOS or RTOS (much more expensive) and with slow update rate. Master device is the physical interface with human operator, including the mechanical part and Electrical part
  • #37: Before coming to the Conclusions, we have a look at the Max. VE Stiffness graph What is Max. Stiffness? It indicates the Range of Impedance that haptic system can passively render. According to the graph,we can see the multi-rate TDPA has the widest range of Impedance, whille Conv. TDPA has the smallest. Beside, the higher VE frequency  the higher stiffness allowed.