![21.Feb 2013 Gergely Rakoczi @ MoodleMoot Austria 2013
Pros [+]
• Novelty effect: gaze data raised
• curiosity and
• (initial) motivation for participation
• Heatmaps showed
• not only Hot areas (chat, user management pod)
• But also neglected areas (notes, presentation)
• Gaze data: “Good additional information”
• Enriched review and great basis for generating discussions !!!
• Comparison to others
• Eye tracking (basically) applicable in training of online tutors
“New way to
learn about
myself !”
“Wow, I was totally obsessed
with the chat and have missed
to follow the other pods.”](https://image.slidesharecdn.com/ed-media2016rakoczi-160817133533/85/Application-of-Eye-Tracking-Technology-as-a-Self-Evaluation-Tool-in-the-Training-Program-of-Future-Online-Tutors-17-320.jpg){kind=tracking}
![21.Feb 2013 Gergely Rakoczi @ MoodleMoot Austria 2013
Cons [-]
• Considerable overhead for setup / testing
• Moderator reported feeling more “stiff” and “tense”
• Low activity in forum debates about gaze data results
more moderation from teacher required
• Small sample size (N=6), not suitable for more or larger
groups
Conclusion:
“Good experience, will continue for small groups, but
not if number of course participants increase …”](https://image.slidesharecdn.com/ed-media2016rakoczi-160817133533/85/Application-of-Eye-Tracking-Technology-as-a-Self-Evaluation-Tool-in-the-Training-Program-of-Future-Online-Tutors-18-320.jpg){kind=tracking}
Application of Eye Tracking Technology as a Self-Evaluation Tool in the Training Program of Future Online Tutors
- 1. Application of Eye Tracking Technology as a Self-Evaluation Tool in the Training Program of Future Online Tutors Dr. techn. Gergely Rakoczi Teaching Support Center Vienna University of Technology [email protected]
- 2. June 28th 2016 Gergely Rakoczi @ EdMedia 2016 Overview 1. Introduction – goals, purpose … 2. The Study – setting, technology, students … 3. Results – conclusions, pros and cons, … http://static2.thrivesmart.com/uploaded_images/business_images/0003/4105/Eyes_slide_show.jpg
- 3. June 28th 2016 Gergely Rakoczi @ EdMedia 2016 1. Introduction – goals, purpose …
- 4. June 28th 2016 Gergely Rakoczi @ EdMedia 2016 Online Tutors Currently: • Increasing need for using interactive communication tools • Everyday tutoring tasks affected • Many forms of communication and moderation processes involved https://getonlinetutor.files.wordpress.com/2011/03/tutor-1.jpg … not just e-mail! Chats, forums, Skype and web conference sessions, moderators in live “events”, blogging, social media management …!
- 5. June 28th 2016 Gergely Rakoczi @ EdMedia 2016 Training Programs • Training Programs (should) include • Soft skill training • Competency-based tasks • Different qualification profiles • Immersive training methods • … Existing programs are good! https://www.google.at/search?q=training+program&site=imghp&source=lnms&tbm=isch&sa =X&ved=0ahUKEwjruOWS0bbNAhUCWiwKHbrlDAAQ_AUICCgB&biw=1920&bih=1063 Our Focus: How is feedback given … ? • Trainer’s observation (might be subjective and limited) • „boring“ text documents • (group) discussions • (few provide) screen recordings
- 6. June 28th 2016 Gergely Rakoczi @ EdMedia 2016 Our goal … Sometimes provided feedback is not individual, „boring“, not quantitative … So, as a technical University: • Enrich training by technology • Enable to re-live the tutoring experience • Provide quantitative data for comparison • Use a new, cool and interesting method for self-evaluation … with Eye Tracking Technology!
- 7. June 28th 2016 Gergely Rakoczi @ EdMedia 2016 Looking for related work … Hardly any related work … most similar work by (Yalcinalp et al, 2013) Eye tracked students using web- conferencing in distance education Focus on visual distribution and usability improvements Yalcinalp S., Turkoglu, H. & Ersoy, H. (2013). A Case Study: Task Analysis for Using a Video Conferencing System of Graduate Students Through Eye Tracking Methodology. In Proceedings of IAC-ETeL 2013: International Academic Conference on Education, Teaching and E-learning (pp.411-419). Prague: MAC Prague consulting Ltd. http://www.burrard-lucas.com/image/botswana/normal/meerkat_family.jpg
- 8. June 28th 2016 Gergely Rakoczi @ EdMedia 2016 2. The Study – setting, technology, students …
- 9. June 28th 2016 Gergely Rakoczi @ EdMedia 2016 Extending our Training Training program based on earlier concept of the author: • Application of a mixture of moderations tools: forum, chat, mail, web-conference • Step-by-step from asynchronous to synchronous tools • Step-by-step from guided to “open” scenarios • In-between reflections with essays and group discussions + Recording gaze data!
- 10. June 28th 2016 Gergely Rakoczi @ EdMedia 2016 The Study Goal: Record the students’ eye-movements during moderating a web- conference session Eye tracker: Tobii X50, no chin rest 2 infrared cameras coronal reflection Resolution: 1280x1024, 20 inch TFT Conference tool: Adobe Connect
- 11. June 28th 2016 Gergely Rakoczi @ EdMedia 2016 Analysis & Artifacts • Fixed layout • 6 voluntary moderators were eye tracked (N=6) • Defined roles to ensure authentic tutoring scenario
- 12. June 28th 2016 Gergely Rakoczi @ EdMedia 2016 After the Eye Tracking …
- 13. June 28th 2016 Gergely Rakoczi @ EdMedia 2016 After the Eye Tracking …
- 14. June 28th 2016 Gergely Rakoczi @ EdMedia 2016 3. Results – conclusions, pros and cons, …
- 15. June 28th 2016 Gergely Rakoczi @ EdMedia 2016 Video Example
- 16. 21.Feb 2013 Gergely Rakoczi @ MoodleMoot Austria 2013 Exemplary Results • Chat is number 1 • Followed by the participants pod management of users • also important at the beginning video pod • Distribution over groups very similar • Presentation more followed by moderator of group 3
- 17. 21.Feb 2013 Gergely Rakoczi @ MoodleMoot Austria 2013 Pros [+] • Novelty effect: gaze data raised • curiosity and • (initial) motivation for participation • Heatmaps showed • not only Hot areas (chat, user management pod) • But also neglected areas (notes, presentation) • Gaze data: “Good additional information” • Enriched review and great basis for generating discussions !!! • Comparison to others • Eye tracking (basically) applicable in training of online tutors “New way to learn about myself !” “Wow, I was totally obsessed with the chat and have missed to follow the other pods.”
- 18. 21.Feb 2013 Gergely Rakoczi @ MoodleMoot Austria 2013 Cons [-] • Considerable overhead for setup / testing • Moderator reported feeling more “stiff” and “tense” • Low activity in forum debates about gaze data results more moderation from teacher required • Small sample size (N=6), not suitable for more or larger groups Conclusion: “Good experience, will continue for small groups, but not if number of course participants increase …”
- 19. June 28th 2016 Gergely Rakoczi @ EdMedia 2016 Questions? Thank you for your attention! http://www.monkeygag.com/wp- content/uploads/2013/04/484533_276257415808526_1047165374_n.jpg
Editor's Notes
- #13: Collected gaze data is provided in different ways, first … Share experiences – relax and remove the tension
- #14: After that additional feedback is given in different forms within the learning environment Retrospective analysis
- #16: 4 different scenario for tutoring scenario Presentation Listen to other presentation and facilitate questions if required Conducting polls Moderating debated via chat and audio