Modelling collaborative problem-solving competence with transparent learning analytics: Is video data enough?

Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

In this study, we describe the results of our research to model collaborative problem-solving (CPS) competence based on analytics generated from video data. We have collected ~500 mins video data from 15 groups of 3 students working to solve design problems collaboratively. Initially, with the help of OpenPose, we automatically generated frequency metrics such as the number of the face-in-the-screen; and distance metrics such as the distance between bodies. Based on these metrics, we built decision trees to predict students' listening, watching, making, and speaking behaviours as well as predicting the students' CPS competence. Our results provide useful decision rules mined from analytics of video data which can be used to inform teacher dashboards. Although, the accuracy and recall values of the models built are inferior to previous machine learning work that utilizes multimodal data, the transparent nature of the decision trees provides opportunities for explainable analytics for teachers and learners. This can lead to more agency of teachers and learners, therefore can lead to easier adoption. We conclude the paper with a discussion on the value and limitations of our approach.

Original languageEnglish
Title of host publicationLAK 2020 Conference Proceedings - Celebrating 10 years of LAK : Shaping the Future of the Field - 10th International Conference on Learning Analytics and Knowledge
Number of pages6
PublisherACM Association for Computing Machinery
Publication date23 Mar 2020
Pages270-275
ISBN (Electronic)9781450377126
DOIs
Publication statusPublished - 23 Mar 2020
Externally publishedYes
Event10th International Conference on Learning Analytics and Knowledge: Shaping the Future of the Field, LAK 2020 - Frankfurt, Germany
Duration: 23 Mar 202027 Mar 2020

Conference

Conference10th International Conference on Learning Analytics and Knowledge: Shaping the Future of the Field, LAK 2020
LandGermany
ByFrankfurt
Periode23/03/202027/03/2020
SeriesACM International Conference Proceeding Series

    Research areas

  • Collaborative problem-solving, Decision trees, Multimodal learning analytics, Physical learning analytics, Video analytics

ID: 256266108