Determining progress in writing competency by assessing students' argumentation

A problem when it comes to evaluating the quality of education in professional competencies, such as writing skills, is being able to detect and measure progression. We have previously defined course level based learning outcomes for academic writing competency in computer science; these are used in...

Full description

Saved in:
Bibliographic Details
Published in:2016 IEEE Frontiers in Education Conference (FIE) pp. 1 - 6
Main Authors: Cassel, Sofia, Nylen, Aletta
Format: Conference Proceeding
Language:English
Published: IEEE 01.10.2016
Subjects:
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Abstract A problem when it comes to evaluating the quality of education in professional competencies, such as writing skills, is being able to detect and measure progression. We have previously defined course level based learning outcomes for academic writing competency in computer science; these are used in a writing across the curriculum (WAC), in the discipline (WID) program. However, in order to assess whether the program is effective, i.e., that the participating students' writing skills progress throughout the education, we need a different set of criteria. Such criteria must capture the quality of the text from an academic perspective. They must also be easy to evaluate, and it must be possible to compare evaluations of different texts. There are many, sometimes conflicting, definitions of what `good academic writing' or `quality' in academic communication is. In this paper, we have defined it in terms of how the material is structured, how well arguments are presented, and how critical thinking is used to strengthen arguments. Following this definition, it is clear that argumentative skills can be used as an indicator of quality in academic communication. Our criteria for measuring writing competency are thus heavily based on assessing students' use of argumentative skills in written texts and are similar to criteria previously used to assess the quality of student participation in classroom discussions. This paper presents a framework for quantitative and qualitative evaluation of texts written by computer science students. We have related the criteria in our framework to general definitions of academic writing, and to our previously defined goals for writing competencies. The framework provides a grading scheme that can be used to assign a score to a text, corresponding to the level of academic quality exhibited in that text. The results of our framework thus enables comparisons between different student texts. We have used the framework to evaluate writing progression for a group of IT engineering students over three years.
AbstractList A problem when it comes to evaluating the quality of education in professional competencies, such as writing skills, is being able to detect and measure progression. We have previously defined course level based learning outcomes for academic writing competency in computer science; these are used in a writing across the curriculum (WAC), in the discipline (WID) program. However, in order to assess whether the program is effective, i.e., that the participating students' writing skills progress throughout the education, we need a different set of criteria. Such criteria must capture the quality of the text from an academic perspective. They must also be easy to evaluate, and it must be possible to compare evaluations of different texts. There are many, sometimes conflicting, definitions of what `good academic writing' or `quality' in academic communication is. In this paper, we have defined it in terms of how the material is structured, how well arguments are presented, and how critical thinking is used to strengthen arguments. Following this definition, it is clear that argumentative skills can be used as an indicator of quality in academic communication. Our criteria for measuring writing competency are thus heavily based on assessing students' use of argumentative skills in written texts and are similar to criteria previously used to assess the quality of student participation in classroom discussions. This paper presents a framework for quantitative and qualitative evaluation of texts written by computer science students. We have related the criteria in our framework to general definitions of academic writing, and to our previously defined goals for writing competencies. The framework provides a grading scheme that can be used to assign a score to a text, corresponding to the level of academic quality exhibited in that text. The results of our framework thus enables comparisons between different student texts. We have used the framework to evaluate writing progression for a group of IT engineering students over three years.
Author Nylen, Aletta
Cassel, Sofia
Author_xml – sequence: 1
  givenname: Sofia
  surname: Cassel
  fullname: Cassel, Sofia
  organization: Dept. of Inf. Technol., Uppsala Univ., Uppsala, Sweden
– sequence: 2
  givenname: Aletta
  surname: Nylen
  fullname: Nylen, Aletta
  organization: Dept. of Inf. Technol., Uppsala Univ., Uppsala, Sweden
BookMark eNotjzFrwzAUhFVohzbNXuiirZNdPVnyi8aSJm0gkKWdgyS_GEEtG8mh-N_XoZnu-O44uAd2G_tIjD2BKAGEed3uNqUUUJeIGrXSN2xpcAVaGAFohLpnh3caKXUhhtjyIfVtopx5iPw3hfHCfN8NcyX6ibuJ25zn_MLzeG4ojvmF29Seu9naMfTxkd2d7E-m5VUX7Hu7-Vp_FvvDx279ti8CSKwK8kDSAYEl4Ymccd6iRGOcReObk5CVc5Zqo7FpJDTSqhUqpcE7UEB1tWDP_7uBiI5DCp1N0_F6s_oDz7lN7A
ContentType Conference Proceeding
DBID 6IE
6IH
CBEJK
RIE
RIO
DOI 10.1109/FIE.2016.7757545
DatabaseName IEEE Electronic Library (IEL) Conference Proceedings
IEEE Proceedings Order Plan (POP) 1998-present by volume
IEEE Xplore All Conference Proceedings
IEEE Electronic Library (IEL)
IEEE Proceedings Order Plans (POP) 1998-present
DatabaseTitleList
Database_xml – sequence: 1
  dbid: RIE
  name: IEEE Electronic Library (IEL)
  url: https://ieeexplore.ieee.org/
  sourceTypes: Publisher
DeliveryMethod fulltext_linktorsrc
Discipline Education
Computer Science
EISBN 9781509017904
1509017909
EndPage 6
ExternalDocumentID 7757545
Genre orig-research
GroupedDBID 6IE
6IH
CBEJK
RIE
RIO
ID FETCH-LOGICAL-i1273-ec1e2b1e1ae0ceeb9bca72799ba79cdf023bbae6957dd21d2a4874451cb141e63
IEDL.DBID RIE
IngestDate Thu Jun 29 18:38:04 EDT 2023
IsPeerReviewed false
IsScholarly true
Language English
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-i1273-ec1e2b1e1ae0ceeb9bca72799ba79cdf023bbae6957dd21d2a4874451cb141e63
PageCount 6
ParticipantIDs ieee_primary_7757545
PublicationCentury 2000
PublicationDate 2016-Oct.
PublicationDateYYYYMMDD 2016-10-01
PublicationDate_xml – month: 10
  year: 2016
  text: 2016-Oct.
PublicationDecade 2010
PublicationTitle 2016 IEEE Frontiers in Education Conference (FIE)
PublicationTitleAbbrev FIE
PublicationYear 2016
Publisher IEEE
Publisher_xml – name: IEEE
Score 1.9772079
Snippet A problem when it comes to evaluating the quality of education in professional competencies, such as writing skills, is being able to detect and measure...
SourceID ieee
SourceType Publisher
StartPage 1
SubjectTerms Atmospheric measurements
Cognition
Computer science
Computer Science Education
Context
Education
Particle measurements
Proficiency assessment
Writing
Writing across the curriculum
Title Determining progress in writing competency by assessing students' argumentation
URI https://ieeexplore.ieee.org/document/7757545
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV07T8MwED61FQNToS3iLQ9ILLit87I9QytYSgeQulV-XFCXFPWF-u-xnaQIiYXNOjmxZSe5z7nv7gO44-ifFBNTkUY5TeKcUeXOQpQzwyMtRJylOohN8MlEzGZy2oCHQy4MIgbyGfZ9M8Ty7dJs_a-yAecOXCRpE5qc8zJXq448DuVg_DLyVK2sX3X7pZcS3MW4_b-BTqD3k3dHpgePcgoNLDrQroUXSPUedrzUckXL6MLrU0VocVeQwLZy3y6yKMiXL1fkbKZGxnui90SFIK-3r8uqlut7olYfYULhjj14H4_eHp9ppZJAF8xhD4qGYaQZMoVDNz8ttVEOlEipFZfG5s4pa60wkym3NmI2UokveZ8yo1nCMIvPoFUsCzwHYtAIyWye2yx3wCJWsRxaq5jAjBuByQV0_VrNP8tCGPNqmS7_Nl_Bsd-Okvl2Da3Naos3cGR2m8V6dRt27xse-J_k
linkProvider IEEE
linkToHtml http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV1LTwIxEJ4gmugJBYxvezDx4gLdV7dnhUBE5IAJN9LHrNnLYnho-Pe23QVj4sVbM-lum3Z35-vON_MB3DG0T4oKvCTyUy8MUuoJcxbyGFXMl0kSxJF0YhNsNEqmUz6uwMMuFwYRHfkMW7bpYvl6rtb2V1mbMQMuwmgP9qMw9GmRrbWNPXZ4uzfoWrJW3Co7_lJMcQ6jV_vfUMfQ_Mm8I-OdTzmBCuZ1qG2lF0j5Jtat2HJJzGjA61NJaTFXEMe3Ml8vkuXkyxYsMja1xcYbIjdEuDCvtS-LupbLeyIW725C7o5NeOt1J499r9RJ8DJq0IeHiqIvKVKBHTM_yaUSBpZwLgXjSqfGLUspMOYR09qn2hehLXofUSVpSDEOTqGaz3M8A6JQJZzqNNVxaqBFIALe0VrQBGOmEgzPoWHXavZRlMKYlct08bf5Fg77k5fhbDgYPV_Ckd2aggd3BdXVYo3XcKA-V9lyceN28huZEqMr
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=proceeding&rft.title=2016+IEEE+Frontiers+in+Education+Conference+%28FIE%29&rft.atitle=Determining+progress+in+writing+competency+by+assessing+students%27+argumentation&rft.au=Cassel%2C+Sofia&rft.au=Nylen%2C+Aletta&rft.date=2016-10-01&rft.pub=IEEE&rft.spage=1&rft.epage=6&rft_id=info:doi/10.1109%2FFIE.2016.7757545&rft.externalDocID=7757545