From signals to knowledge. A conceptual model for multimodal learning analytics

Multimodality in learning analytics and learning science is under the spotlight. The landscape of sensors and wearable trackers that can be used for learning support is evolving rapidly, as well as data collection and analysis methods. Multimodal data can now be collected and processed in real time...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Journal of computer assisted learning Jg. 34; H. 4; S. 338 - 349
Hauptverfasser: Di Mitri, Daniele, Schneider, Jan, Specht, Marcus, Drachsler, Hendrik
Format: Journal Article
Sprache:Englisch
Veröffentlicht: Oxford Wiley-Blackwell 01.08.2018
Wiley Subscription Services, Inc
Schlagworte:
Artificial intelligence
Data acquisition
Data Analysis
Data Collection
Datenanalyse
Educational Research
Empirische Forschung
Experimentelle Untersuchung
Experiments
Feedback
Feedback (Response)
Klassifikation
Learning
Learning Analytics
Learning Modalities
Learning Processes
Learning Theories
Lernprozess
Lerntheorie
Lernverhalten
Literature Reviews
Machine learning
Man Machine Systems
Mathematical analysis
Measurement Equipment
Methode
Modell
multimodal data
multimodality
Observability (systems)
Observation
Sensors
social signal processing
Taxonomy
Übersicht
ISSN:0266-4909, 1365-2729
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:Multimodality in learning analytics and learning science is under the spotlight. The landscape of sensors and wearable trackers that can be used for learning support is evolving rapidly, as well as data collection and analysis methods. Multimodal data can now be collected and processed in real time at an unprecedented scale. With sensors, it is possible to capture observable events of the learning process such as learner's behaviour and the learning context. The learning process, however, consists also of latent attributes, such as the learner's cognitions or emotions. These attributes are unobservable to sensors and need to be elicited by human?driven interpretations. We conducted a literature survey of experiments using multimodal data to frame the young research field of multimodal learning analytics. The survey explored the multimodal data used in related studies (the input space) and the learning theories selected (the hypothesis space). The survey led to the formulation of the Multimodal Learning Analytics Model whose main objectives are of (O1) mapping the use of multimodal data to enhance the feedback in a learning context; (O2) showing how to combine machine learning with multimodal data; and (O3) aligning the terminology used in the field of machine learning and learning science. (DIPF/Orig.)
Bibliographie:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ISSN:0266-4909
1365-2729
DOI:10.1111/jcal.12288