![References
[1] W. Greller and H. Drachsler, “Translating learning into numbers: A generic framework for learning analytics,” Educational
Technology and Society, vol. 15, no. 3, pp. 42–57, 2012.
[2] D. Griffiths, H. Drachsler, M. Kickmeier-Rust, C. Steiner, T. Hoel, and W. Greller, “Is Privacy a Show-stopper for
Learning Analytics? A Review of Current Issues and Solutions,” Learning Analytics Community Exchange (LACE, Tech.
Rep. February, 2016. [Online]. Available: http://www.laceproject.eu/learning-analyticsreview/files/2016/04/LACE-review-
6privacy-show-stopper.pdf
[3] S. Slade and P. Prinsloo, “Learning analytics ethical issues and dilemmas,” American Behavioral Scientist, vol. 57, no.
10, pp. 1510–1529, 2013.
[4] N. Sclater, “Code of practice for learning analytics. A literature review of the ethical and legal issues,” JISC, Tech. Rep.,
2014.
[5] A. Pardo and G. Siemens, “Ethical and privacy principles for learning analytics,” British Journal of Educational
Technology, vol. 45, no. 3, pp. 438–450, 2014.
[6] H. Drachsler and W. Greller, “Privacy and Learning Analytics – a DELICATE issue. A Checklist for Trusted Learning
Analytics,” in 6th International Conference on Learning Analytics and Knowledge, Edinburgh, UK, 2016.
18](https://image.slidesharecdn.com/lainaction-ethicsandprivacyissuesintheclassroomlasi162-160704120632/85/Learning-Analytics-in-action-ethics-and-privacy-issues-in-the-classroom-18-320.jpg)
![References
[7] D. Griffiths, “The implications of Analytics for teaching practice in Higher Education,” JISC CETIS Analytics Series, vol.
1, no. 10, pp. 1–23, 2013.
[8] M. J. Rodríguez-Triana, A. Martínez-Monés, J. I. Asensio-Pérez, and Y. Dimitriadis, “Scripting and monitoring meet each
other: Aligning learning analytics and learning design to support teachers in orchestrating CSCL situations,” British Journal
of Educational Technology, vol. 46, no. 2, pp. 330–343, 2015.
[9] M. J. Rodríguez-Triana, A. Martínez-Monés, J. I. Asensio-Pérez, and Y. Dimitriadis, “Towards a script-aware monitoring
process of computer-supported collaborative learning scenarios,” International Journal of Technology Enhanced Learning,
vol. 5, no. 2, pp. 151–167, 2013.
[10] M. J. Rodríguez-Triana, A. Martínez-Monés, and S. Villagrá-Sobrino, “Learning analytics in small-scale teacher-led
innovations: Ethical and data privacy issues,” Journal of Learning Analytics, vol. 3, no. 1, pp. 43–65, 2016.
[11] D. Kay, N. Korn, and C. Oppenheim, “Legal, risk and ethical aspects of analytics in higher education,” JISC CETIS
Analytics Series, Tech. Rep. 6, 2012. [Online]. Available: http://publications.cetis.org.uk/wp-content/uploads/2012/11/Legal-
Riskand-Ethical-Aspects-of-Analytics-in-Higher-Education-Vol1-No6.pdf
19](https://image.slidesharecdn.com/lainaction-ethicsandprivacyissuesintheclassroomlasi162-160704120632/85/Learning-Analytics-in-action-ethics-and-privacy-issues-in-the-classroom-19-320.jpg)
Learning Analytics in action: ethics and privacy issues in the classroom
- 1. Learning Analytics in action: ethics & privacy issues in the classroom María Jesús Rodríguez-Triana, Alejandra Martínez-Monés & Sara Villagrá-Sobrino LASI'16 - Bilbao - 27/06/2016
- 2. Benefits vs Dangers (BIG) DATA LEARNING ANALYTICS 2
- 4. Code of practice for LA - Stakeholders: - Institutions - Aspects: - Responsibility - Transparency & consent - Privacy - Validity - Access - Enabling positive interventions - Minimising adverse impacts - Stewardship of data (Sclater & Bailey, 2015). Code of practice for learning analytics. Jisc. Retrieved from: http://www.jisc.ac.uk/guides/code-of-practice-for- learning-analytics 4
- 5. DELICATE checklist - Stakeholders: - Institutions, policy makers - Aspects: - Purpose - Transparency - Data ownership - User involvement - Consent - Anonymity - Privacy - External services Drachsler, H. & Greller, W. (2016). Privacy and Analytics – it’s a DELICATE issue. A Checklist to establish trusted Learning Analytics. 6th Learning Analytics and Knowledge Conference 2016, April 25-29, 2016, Edinburgh, UK. 5
- 6. What about teachers? Am I doing right? What should I do? Frameworks & Guidelines 6
- 7. Small-scale teacher-led LA - Stakeholders: - Teachers - Aspects: - Consent - Transparency - Access - Responsibility - Privacy - Validity - Stewardship - Impact Rodríguez-Triana, M.J., Martínez-Monés, A., & Villagrá-Sobrino (2016). Learning analytics in small-scale teacher-led innovations: Ethical and data privacy issues. Journal of Learning Analytics, 3(1), 43–65. 7
- 8. Approach: Aligning learning design & analytics 8 M. J. Rodríguez-Triana, A. Martínez-Monés, J. I. Asensio-Pérez, and Y. Dimitriadis, “Scripting and monitoring meet each other: Aligning learning analytics and learning design to support teachers in orchestrating CSCL situations,” British Journal of Educational Technology, vol. 46, no. 2, pp. 330–343, 2015.
- 9. Studies: higher and primary education scenarios 9
- 10. Lessons: Implications related to the LA approach - LA approaches, roles, responsibility (Griffiths, 2012): - Institutional approaches → efficiency in the wider functioning of the institution - Regulation approaches → enhanced regulation of the teaching and learning environment - Reflection approaches → help lecturers carry out their tasks more effectively - Privacy, action & impact: - Data available in the classroom for the teacher - Actions triggered by LA - Classroom orchestration impact 10
- 11. Lessons: Implications derived from the solutions - Design methodology: - Participatory design helped to overcome certain orchestration issues - "Ethics by design” - Stakeholders role: - The teacher is the one who: - defines the educational purposes of the analysis, - reflects on the available data sources, - contributes to improve the validity of the results), - is aware of the limitations of the results obtained. 11
- 12. Lessons: implications from the educational contexts - Specific ways of working - Legal aspects (minors and privacy) - Technological learning environment: - Cloud-based tools do not cover information needs required by LA - Legal and ethical problems: data ownership and virtual identity 12
- 13. Category Recommendation Consent · If information is already being tracked, inform the students (or families) about it, otherwise, ask for formal consent/agreement before data can be collected and/or analyzed. · Be explicit about what you might do with that information and, if possible, agree on these possibilities with the students. · Provide students with the option to update their digital dossiers and provide extra data but triangulate it to verify they do not “game” the system. · Data should be deleted when individuals no longer want it to be processed or when it is no longer of use for its original purpose, as is the case with any other student data. · Reflect on the consequences that opting out of the analysis will have on the participants and inform them. Transparency · Be explicit about which data is collected, how it is interpreted, why, and how it will affect the learning process. Access · Reflect on whether the students should access the data held about them, the analysis of the data, the labels attached to them, and if so, in which format this information should be provided to them. · Consider the possibility of letting students correct the data stored about them. Responsibility · You are in charge of interpreting and validating the analyses as well as deciding what to do based on the analytics. Lessons: recommendations for teachers 13
- 14. Category Recommendation Privacy · If some data must be anonymous, be sure it cannot be re-identified by contextual information available to the users. · If you use data from external sources, (e.g., Web 2.0 tools) be sure you can identify the owner correctly, and that other ethical and privacy issues are not put at risk when using those sources. Validity · The evidence obtained may be incomplete. Try to involve students (and families) in order to increase its accuracy. Stewardship · Use the data needed for the analysis, nothing more. · Be sure that you comply with the data protection laws applicable in your region or country. · The data should be preserved, secured, and shared in the same way as any other student data. Avoiding negative impact · Consider that your analysis may produce unexpected results that prompt you to intervene with the student. Which kinds of obligations will influence your actions? 14 Lessons: recommendations for teachers
- 15. Conclusions LA approach Solutions Ed. Context 15
- 16. Future work 16 Evaluation with teachers usefulness, usability & feasibility benefits & challenges Analyses of stakeholder's responsibilities students, researchers, developers Ethics & privacy
- 17. María Jesús Rodríguez-Triana [email protected] Alejandra Martínez-Monés [email protected] Sara Villagrá-Sobrino [email protected] Thank you for your participation 17
- 18. References [1] W. Greller and H. Drachsler, “Translating learning into numbers: A generic framework for learning analytics,” Educational Technology and Society, vol. 15, no. 3, pp. 42–57, 2012. [2] D. Griffiths, H. Drachsler, M. Kickmeier-Rust, C. Steiner, T. Hoel, and W. Greller, “Is Privacy a Show-stopper for Learning Analytics? A Review of Current Issues and Solutions,” Learning Analytics Community Exchange (LACE, Tech. Rep. February, 2016. [Online]. Available: http://www.laceproject.eu/learning-analyticsreview/files/2016/04/LACE-review- 6privacy-show-stopper.pdf [3] S. Slade and P. Prinsloo, “Learning analytics ethical issues and dilemmas,” American Behavioral Scientist, vol. 57, no. 10, pp. 1510–1529, 2013. [4] N. Sclater, “Code of practice for learning analytics. A literature review of the ethical and legal issues,” JISC, Tech. Rep., 2014. [5] A. Pardo and G. Siemens, “Ethical and privacy principles for learning analytics,” British Journal of Educational Technology, vol. 45, no. 3, pp. 438–450, 2014. [6] H. Drachsler and W. Greller, “Privacy and Learning Analytics – a DELICATE issue. A Checklist for Trusted Learning Analytics,” in 6th International Conference on Learning Analytics and Knowledge, Edinburgh, UK, 2016. 18
- 19. References [7] D. Griffiths, “The implications of Analytics for teaching practice in Higher Education,” JISC CETIS Analytics Series, vol. 1, no. 10, pp. 1–23, 2013. [8] M. J. Rodríguez-Triana, A. Martínez-Monés, J. I. Asensio-Pérez, and Y. Dimitriadis, “Scripting and monitoring meet each other: Aligning learning analytics and learning design to support teachers in orchestrating CSCL situations,” British Journal of Educational Technology, vol. 46, no. 2, pp. 330–343, 2015. [9] M. J. Rodríguez-Triana, A. Martínez-Monés, J. I. Asensio-Pérez, and Y. Dimitriadis, “Towards a script-aware monitoring process of computer-supported collaborative learning scenarios,” International Journal of Technology Enhanced Learning, vol. 5, no. 2, pp. 151–167, 2013. [10] M. J. Rodríguez-Triana, A. Martínez-Monés, and S. Villagrá-Sobrino, “Learning analytics in small-scale teacher-led innovations: Ethical and data privacy issues,” Journal of Learning Analytics, vol. 3, no. 1, pp. 43–65, 2016. [11] D. Kay, N. Korn, and C. Oppenheim, “Legal, risk and ethical aspects of analytics in higher education,” JISC CETIS Analytics Series, Tech. Rep. 6, 2012. [Online]. Available: http://publications.cetis.org.uk/wp-content/uploads/2012/11/Legal- Riskand-Ethical-Aspects-of-Analytics-in-Higher-Education-Vol1-No6.pdf 19