Zobrazit v EDS

Cognitive Computing with Large Language Models for Student Assessment Feedback

Uloženo v:
Podrobná bibliografie
Název: Cognitive Computing with Large Language Models for Student Assessment Feedback
Autoři: Noorhan Abbas, Eric Atwell
Zdroj: Big Data and Cognitive Computing ; Volume 9 ; Issue 5 ; Pages: 112
Informace o vydavateli: Multidisciplinary Digital Publishing Institute
Rok vydání: 2025
Sbírka: MDPI Open Access Publishing
Témata: data science assessments, Mistral-7B, CodeLlama-7B, automatic assessment feedback, Python code analysis
Popis: Effective student feedback is fundamental to enhancing learning outcomes in higher education. While traditional assessment methods emphasise both achievements and development areas, the process remains time-intensive for educators. This research explores the application of cognitive computing, specifically open-source Large Language Models (LLMs) Mistral-7B and CodeLlama-7B, to streamline feedback generation for student reports containing both Python programming elements and English narrative content. The findings indicate that these models can provide contextually appropriate feedback on both technical Python coding and English specification and documentation. They effectively identified coding weaknesses and provided constructive suggestions for improvement, as well as insightful feedback on English language quality, structure, and clarity in report writing. These results contribute to the growing body of knowledge on automated assessment feedback in higher education, offering practical insights for institutions considering the implementation of open-source LLMs in their workflows. There are around 22 thousand assessment submissions per year in the School of Computer Science, which is one of eight schools in the Faculty of Engineering and Physical Sciences, which is one of seven faculties in the University of Leeds, which is one of one hundred and sixty-six universities in the UK, so there is clear potential for our methods to scale up to millions of assessment submissions. This study also examines the limitations of current approaches and proposes potential enhancements. The findings support a hybrid system where cognitive computing manages routine tasks and educators focus on complex, personalised evaluations, enhancing feedback quality, consistency, and efficiency in educational settings.
Druh dokumentu: text
Popis souboru: application/pdf
Jazyk: English
Relation: https://dx.doi.org/10.3390/bdcc9050112
DOI: 10.3390/bdcc9050112
Dostupnost: https://doi.org/10.3390/bdcc9050112
Rights: https://creativecommons.org/licenses/by/4.0/
Přístupové číslo: edsbas.4276FD7B
Databáze: BASE
FullText Text:
  Availability: 0
CustomLinks:
  – Url: https://doi.org/10.3390/bdcc9050112#
    Name: EDS - BASE (s4221598)
    Category: fullText
    Text: View record from BASE
  – Url: https://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=EBSCO&SrcAuth=EBSCO&DestApp=WOS&ServiceName=TransferToWoS&DestLinkType=GeneralSearchSummary&Func=Links&author=Abbas%20N
    Name: ISI
    Category: fullText
    Text: Nájsť tento článok vo Web of Science
    Icon: https://imagesrvr.epnet.com/ls/20docs.gif
    MouseOverText: Nájsť tento článok vo Web of Science
Header DbId: edsbas
DbLabel: BASE
An: edsbas.4276FD7B
RelevancyScore: 1009
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 1009.3056640625
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Cognitive Computing with Large Language Models for Student Assessment Feedback
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Noorhan+Abbas%22">Noorhan Abbas</searchLink><br /><searchLink fieldCode="AR" term="%22Eric+Atwell%22">Eric Atwell</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: Big Data and Cognitive Computing ; Volume 9 ; Issue 5 ; Pages: 112
– Name: Publisher
  Label: Publisher Information
  Group: PubInfo
  Data: Multidisciplinary Digital Publishing Institute
– Name: DatePubCY
  Label: Publication Year
  Group: Date
  Data: 2025
– Name: Subset
  Label: Collection
  Group: HoldingsInfo
  Data: MDPI Open Access Publishing
– Name: Subject
  Label: Subject Terms
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22data+science+assessments%22">data science assessments</searchLink><br /><searchLink fieldCode="DE" term="%22Mistral-7B%22">Mistral-7B</searchLink><br /><searchLink fieldCode="DE" term="%22CodeLlama-7B%22">CodeLlama-7B</searchLink><br /><searchLink fieldCode="DE" term="%22automatic+assessment+feedback%22">automatic assessment feedback</searchLink><br /><searchLink fieldCode="DE" term="%22Python+code+analysis%22">Python code analysis</searchLink>
– Name: Abstract
  Label: Description
  Group: Ab
  Data: Effective student feedback is fundamental to enhancing learning outcomes in higher education. While traditional assessment methods emphasise both achievements and development areas, the process remains time-intensive for educators. This research explores the application of cognitive computing, specifically open-source Large Language Models (LLMs) Mistral-7B and CodeLlama-7B, to streamline feedback generation for student reports containing both Python programming elements and English narrative content. The findings indicate that these models can provide contextually appropriate feedback on both technical Python coding and English specification and documentation. They effectively identified coding weaknesses and provided constructive suggestions for improvement, as well as insightful feedback on English language quality, structure, and clarity in report writing. These results contribute to the growing body of knowledge on automated assessment feedback in higher education, offering practical insights for institutions considering the implementation of open-source LLMs in their workflows. There are around 22 thousand assessment submissions per year in the School of Computer Science, which is one of eight schools in the Faculty of Engineering and Physical Sciences, which is one of seven faculties in the University of Leeds, which is one of one hundred and sixty-six universities in the UK, so there is clear potential for our methods to scale up to millions of assessment submissions. This study also examines the limitations of current approaches and proposes potential enhancements. The findings support a hybrid system where cognitive computing manages routine tasks and educators focus on complex, personalised evaluations, enhancing feedback quality, consistency, and efficiency in educational settings.
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: text
– Name: Format
  Label: File Description
  Group: SrcInfo
  Data: application/pdf
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: NoteTitleSource
  Label: Relation
  Group: SrcInfo
  Data: https://dx.doi.org/10.3390/bdcc9050112
– Name: DOI
  Label: DOI
  Group: ID
  Data: 10.3390/bdcc9050112
– Name: URL
  Label: Availability
  Group: URL
  Data: https://doi.org/10.3390/bdcc9050112
– Name: Copyright
  Label: Rights
  Group: Cpyrght
  Data: https://creativecommons.org/licenses/by/4.0/
– Name: AN
  Label: Accession Number
  Group: ID
  Data: edsbas.4276FD7B
PLink https://erproxy.cvtisr.sk/sfx/access?url=https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=edsbas&AN=edsbas.4276FD7B
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.3390/bdcc9050112
    Languages:
      – Text: English
    Subjects:
      – SubjectFull: data science assessments
        Type: general
      – SubjectFull: Mistral-7B
        Type: general
      – SubjectFull: CodeLlama-7B
        Type: general
      – SubjectFull: automatic assessment feedback
        Type: general
      – SubjectFull: Python code analysis
        Type: general
    Titles:
      – TitleFull: Cognitive Computing with Large Language Models for Student Assessment Feedback
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Noorhan Abbas
      – PersonEntity:
          Name:
            NameFull: Eric Atwell
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 01
              Type: published
              Y: 2025
          Identifiers:
            – Type: issn-locals
              Value: edsbas
            – Type: issn-locals
              Value: edsbas.oa
          Titles:
            – TitleFull: Big Data and Cognitive Computing ; Volume 9 ; Issue 5 ; Pages: 112
              Type: main
ResultId 1