Exploring the benefits of utilizing conceptual information in test-to-code traceability

Striving for reliability of software systems often results in immense numbers of tests. Due to the lack of a generally used annotation, finding the parts of code these tests were meant to assess can be a demanding task. This is a valid problem of software engineering called test-to-code traceability...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:2018 IEEE ACM 6th International Workshop on Realizing Artificial Intelligence Synergies in Software Engineering (RAISE) S. 8 - 14
Hauptverfasser: Kicsi, András, Tóth, László, Vidács, László
Format: Tagungsbericht
Sprache:Englisch
Veröffentlicht: New York, NY, USA ACM 28.05.2018
Schriftenreihe:ACM Conferences
Schlagworte:
Artificial intelligence
Computing methodologies > Artificial intelligence > Natural language processing
Data mining
Information retrieval
Large scale integration
LSI
Natural language processing
natural language processing (nlp)
Production
Software and its engineering > Software creation and management > Software verification and validation > Process validation > Traceability
Software engineering
testing
traceability
LSI
natural language processing (nlp)
traceability
testing
ISBN:1450357237, 9781450357234
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Abstract Striving for reliability of software systems often results in immense numbers of tests. Due to the lack of a generally used annotation, finding the parts of code these tests were meant to assess can be a demanding task. This is a valid problem of software engineering called test-to-code traceability. Recent research on the subject has attempted to cope with this problem applying various approaches and their combinations, achieving profound results. These approaches have involved the use of naming conventions during development processes and also have utilized various information retrieval (IR) methods often referred to as conceptual information. In this work we investigate the benefits of textual information located in software code and its value for aiding traceability. We evaluated the capabilities of the natural language processing technique called Latent Semantic Indexing (LSI) in the view of the results of the naming conventions technique on five real, medium sized software systems. Although LSI is already used for this purpose, we extend the viewpoint of one-to-one traceability approach to the more versatile view of LSI as a recommendation system. We found that considering the top 5 elements in the ranked list increases the results by 30% on average and makes LSI a viable alternative in projects where naming conventions are not followed systematically.
AbstractList Striving for reliability of software systems often results in immense numbers of tests. Due to the lack of a generally used annotation, finding the parts of code these tests were meant to assess can be a demanding task. This is a valid problem of software engineering called test-to-code traceability. Recent research on the subject has attempted to cope with this problem applying various approaches and their combinations, achieving profound results. These approaches have involved the use of naming conventions during development processes and also have utilized various information retrieval (IR) methods often referred to as conceptual information. In this work we investigate the benefits of textual information located in software code and its value for aiding traceability. We evaluated the capabilities of the natural language processing technique called Latent Semantic Indexing (LSI) in the view of the results of the naming conventions technique on five real, medium sized software systems. Although LSI is already used for this purpose, we extend the viewpoint of one-to-one traceability approach to the more versatile view of LSI as a recommendation system. We found that considering the top 5 elements in the ranked list increases the results by 30% on average and makes LSI a viable alternative in projects where naming conventions are not followed systematically.
Author Tóth, László
Vidács, László
Kicsi, András
Author_xml – sequence: 1
  givenname: András
  surname: Kicsi
  fullname: Kicsi, András
  email: akicsi@inf.u-szeged.hu
  organization: University of Szeged, Szeged, Hungary
– sequence: 2
  givenname: László
  surname: Tóth
  fullname: Tóth, László
  email: premissa@inf.u-szeged.hu
  organization: University of Szeged, Szeged, Hungary
– sequence: 3
  givenname: László
  surname: Vidács
  fullname: Vidács, László
  email: lac@inf.u-szeged.hu
  organization: University of Szeged, Szeged, Hungary
BookMark eNqNkDtPAzEQhI0ACQipKWhc0lywz_b5XKIoPKRINCBKy481GC52dOdIhF_PRUlBSTWz-81uMRfoJOUECF1RMqOUi1tGFaeEz_baHKGLcUuYkDWTx3-HMzQdhk9CSN20XDFxjt4W3-su9zG94_IB2EKCEMuAc8CbErv4syMuJwfrsjEdjinkfmVKzGn0uMBQqpIrlz3g0hsHxo5XZXuJToPpBpgedIJe7xcv88dq-fzwNL9bVoZxWiqjakGDMV62PpDay0ZIrhxvBPOCWBucEnVQjAvnGye5k9A2arReOWolYRN0vf8bAUCv-7gy_Va3XNStbEZ6s6fGrbTN-WvQlOhdZ_rQ2UF30dk_o9r2EQL7BddbbQs
CODEN IEEPAD
ContentType Conference Proceeding
Copyright 2018 ACM
Copyright_xml – notice: 2018 ACM
DBID 6IE
6IL
CBEJK
RIE
RIL
DOI 10.1145/3194104.3194106
DatabaseName IEEE Electronic Library (IEL) Conference Proceedings
IEEE Xplore POP ALL
IEEE Xplore All Conference Proceedings
IEEE Electronic Library (IEL)
IEEE Proceedings Order Plans (POP All) 1998-Present
DatabaseTitleList

Database_xml – sequence: 1
  dbid: RIE
  name: IEEE Electronic Library (IEL)
  url: https://ieeexplore.ieee.org/
  sourceTypes: Publisher
DeliveryMethod fulltext_linktorsrc
Discipline Computer Science
EISBN 1450357237
9781450357234
EndPage 14
ExternalDocumentID 8452876
Genre orig-research
GroupedDBID 6IE
6IF
6IL
6IN
AAJGR
ABLEC
ACM
ADPZR
ALMA_UNASSIGNED_HOLDINGS
APO
BEFXN
BFFAM
BGNUA
BKEBE
BPEOZ
CBEJK
GUFHI
IEGSK
LHSKQ
OCL
RIB
RIC
RIE
RIL
AAWTH
ID FETCH-LOGICAL-a341t-a9251faad78df02d765749c4653d50bbfc952f9345cd6c74c7e869d6cd9c1b703
IEDL.DBID RIE
ISBN 1450357237
9781450357234
ISICitedReferencesCount 18
ISICitedReferencesURI http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000444764500002&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
IngestDate Wed Aug 27 02:55:13 EDT 2025
Wed Jan 31 06:49:01 EST 2024
Wed Jul 31 05:39:07 EDT 2024
IsDoiOpenAccess false
IsOpenAccess true
IsPeerReviewed false
IsScholarly true
Keywords LSI
natural language processing (nlp)
traceability
testing
Language English
License Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from Permissions@acm.org
LinkModel DirectLink
MeetingName ICSE '18: 40th International Conference on Software Engineering
MergedId FETCHMERGED-LOGICAL-a341t-a9251faad78df02d765749c4653d50bbfc952f9345cd6c74c7e869d6cd9c1b703
OpenAccessLink http://publicatio.bibl.u-szeged.hu/14496/1/RAISE_2018_paper_2-CR.pdf
PageCount 7
ParticipantIDs acm_books_10_1145_3194104_3194106
ieee_primary_8452876
acm_books_10_1145_3194104_3194106_brief
PublicationCentury 2000
PublicationDate 20180528
2018-May
PublicationDateYYYYMMDD 2018-05-28
2018-05-01
PublicationDate_xml – month: 05
  year: 2018
  text: 20180528
  day: 28
PublicationDecade 2010
PublicationPlace New York, NY, USA
PublicationPlace_xml – name: New York, NY, USA
PublicationSeriesTitle ACM Conferences
PublicationTitle 2018 IEEE ACM 6th International Workshop on Realizing Artificial Intelligence Synergies in Software Engineering (RAISE)
PublicationTitleAbbrev RAISE
PublicationYear 2018
Publisher ACM
Publisher_xml – name: ACM
SSID ssj0002684935
Score 2.157865
Snippet Striving for reliability of software systems often results in immense numbers of tests. Due to the lack of a generally used annotation, finding the parts of...
SourceID ieee
acm
SourceType Publisher
StartPage 8
SubjectTerms Artificial intelligence
Computing methodologies -- Artificial intelligence -- Natural language processing
Data mining
Information retrieval
Large scale integration
LSI
Natural language processing
natural language processing (nlp)
Production
Software and its engineering -- Software creation and management -- Software verification and validation -- Process validation -- Traceability
Software engineering
testing
traceability
Title Exploring the benefits of utilizing conceptual information in test-to-code traceability
URI https://ieeexplore.ieee.org/document/8452876
WOSCitedRecordID wos000444764500002&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV3NS8MwFH9sw4OnqZs4v4ggeDH7aJOmuTocnsYOG-5W8gmF2crWCfrXm7S1IgjiKaEpLbwm-b2Xvt_vAdxyKlzwTwQWxApMFA-wlMrimGvDCSNmHNmy2ASbz-P1mi9acN9wYYwxZfKZGfpu-S9f52rvj8pGMaHOwY_a0GaMVVyt5jzFq5bwkNbqPRNCR25yERdsDKvWa4oI9fKjiEqJIbPu_95-BP1vMh5aNDBzDC2TnUD3qxoDqhdnD56bdDrknDr04DYxmxY7lFu0KtJN-uFHphVLcS82qCYi-Q-D0gwtHTzgIsfTXBvkEEyZSsH7vQ-r2eNy-oTrsglYOEgqsODOZ7FCaBZrOw40iygjXHkhNU3HUlrFaWB5SKjSkWJEMRNH3HU1VxPpdoBT6GR5Zs4ACa1EYEMW2klIQim4iKQLUALLqLBjaQdw42ya-Hhgl1QUZ5rUdq_baAB3f96TyG1q3NN63urJa6WzkdQGP__98gUcOuclrpIPL6FTbPfmCg7UW5Huttfl5PgEviO31g
linkProvider IEEE
linkToHtml http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV1bS8MwFD54A33ysol3Iwi-mG1tk6Z5dSiKOnzYcG8lVyjMVbZO0F9v0taKIIhPCU1p4TTJd056vu8AnHMqXPBPBBbECkwUD7GUyuKEa8MJI6YX27LYBBsMkvGYPy3BZcOFMcaUyWem47vlv3ydq4U_KusmhDoHP16GVUpIGFRsreZExeuW8IjW-j0BoV03vYgLNzpV61VFhHr5UUalRJGbzf-9fwva33Q89NQAzTYsmekObH7VY0D18mzBc5NQh5xbh67cNmazYo5yi0ZFNsk-_Ei_4ikuxATVVCT_aVA2RUMHELjIcT_XBjkMU6bS8H5vw-jmeti_xXXhBCwcKBVYcOe1WCE0S7TthZrFlBGuvJSapj0preI0tDwiVOlYMaKYSWLuupqrQLo9YBdWpvnU7AESWonQRiyyQUQiKbiIpQtRQsuosD1p9-HM2TT1EcE8rUjONK3tXrfxPlz8eU8qZ5lxT2t5q6evldJGWhv84PfLp7B-O3x8SB_uBveHsOFcmaRKRTyClWK2MMewpt6KbD47KSfKJ3xEux0
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=proceeding&rft.title=Proceedings+of+the+6th+International+Workshop+on+Realizing+Artificial+Intelligence+Synergies+in+Software+Engineering&rft.atitle=Exploring+the+benefits+of+utilizing+conceptual+information+in+test-to-code+traceability&rft.au=Kicsi%2C+Andr%C3%A1s&rft.au=T%C3%B3th%2C+L%C3%A1szl%C3%B3&rft.au=Vid%C3%A1cs%2C+L%C3%A1szl%C3%B3&rft.series=ACM+Conferences&rft.date=2018-05-28&rft.pub=ACM&rft.isbn=1450357237&rft.spage=8&rft.epage=14&rft_id=info:doi/10.1145%2F3194104.3194106
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=9781450357234/lc.gif&client=summon&freeimage=true
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=9781450357234/mc.gif&client=summon&freeimage=true
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=9781450357234/sc.gif&client=summon&freeimage=true