Evaluating simulated teaching audio for teacher trainees using RAG and local LLMs
Uloženo v:
| Název: | Evaluating simulated teaching audio for teacher trainees using RAG and local LLMs |
|---|---|
| Autoři: | Ke Fang, Ci Tang, Jing Wang |
| Zdroj: | Sci Rep Scientific Reports, Vol 15, Iss 1, Pp 1-11 (2025) |
| Informace o vydavateli: | Springer Science and Business Media LLC, 2025. |
| Rok vydání: | 2025 |
| Témata: | Teacher student training, Science, RAG framework, Medicine, Simulated teaching, LLMs, Open-source tools, Article |
| Popis: | In the training of teacher students, simulated teaching is a key method for enhancing teaching skills. However, traditional evaluations of simulated teaching typically rely on direct teacher involvement and guidance, increasing teachers’ workload and limiting the opportunities for teacher students to practice independently. This paper introduces a Retrieval-Augmented Generation (RAG) framework constructed using various open-source tools (such as FastChat for model inference and Whisper for speech-to-text) combined with a local large language model (LLM) for audio analysis of simulated teaching. We then selected three leading 7B-parameter open-source Chinese LLMs from the ModelScope community to analyze their generalizability and adaptability in simulated teaching voice evaluation tasks. The results show that the internlm2 model more effectively analyzes teacher students’ teaching audio, providing key educational feedback. Finally, we conducted a system analysis of the simulated teaching of 10 participants in a teaching ability competition and invited three experts to score manually, verifying the system’s application potential. This research demonstrates a potential approach to improving educational evaluation methods using advanced language technology. |
| Druh dokumentu: | Article Other literature type |
| Jazyk: | English |
| ISSN: | 2045-2322 |
| DOI: | 10.1038/s41598-025-87898-5 |
| Přístupová URL adresa: | https://doaj.org/article/c31f4dc8ddb74c748ee0943370ffef1b |
| Rights: | CC BY NC ND |
| Přístupové číslo: | edsair.doi.dedup.....24fbfbec395a37e057ce4d09c4e1f9e4 |
| Databáze: | OpenAIRE |
Full Text 
Full Text Finder 
Nájsť tento článok vo Web of Science | Abstrakt: | In the training of teacher students, simulated teaching is a key method for enhancing teaching skills. However, traditional evaluations of simulated teaching typically rely on direct teacher involvement and guidance, increasing teachers’ workload and limiting the opportunities for teacher students to practice independently. This paper introduces a Retrieval-Augmented Generation (RAG) framework constructed using various open-source tools (such as FastChat for model inference and Whisper for speech-to-text) combined with a local large language model (LLM) for audio analysis of simulated teaching. We then selected three leading 7B-parameter open-source Chinese LLMs from the ModelScope community to analyze their generalizability and adaptability in simulated teaching voice evaluation tasks. The results show that the internlm2 model more effectively analyzes teacher students’ teaching audio, providing key educational feedback. Finally, we conducted a system analysis of the simulated teaching of 10 participants in a teaching ability competition and invited three experts to score manually, verifying the system’s application potential. This research demonstrates a potential approach to improving educational evaluation methods using advanced language technology. |
|---|---|
| ISSN: | 20452322 |
| DOI: | 10.1038/s41598-025-87898-5 |