Recommender systems for manual testing deciding how to assign tests in a test team
BACKGROUND: Software testing can be an arduous and expensive activity. A typical activity to maximise testing productivity is to allocate test cases according to the testers' profile. However, optimising the allocation of manual test cases is not a trivial task: in big companies, test managers...
Uloženo v:
| Vydáno v: | Proceedings of the ACM-IEEE international symposium on Empirical software engineering and measurement s. 201 - 210 |
|---|---|
| Hlavní autoři: | , , |
| Médium: | Konferenční příspěvek |
| Jazyk: | angličtina |
| Vydáno: |
New York, NY, USA
ACM
19.09.2012
|
| Edice: | ACM Conferences |
| Témata: |
Software and its engineering
> Software creation and management
> Software verification and validation
Software and its engineering
> Software creation and management
> Software verification and validation
> Empirical software validation
Software and its engineering
> Software creation and management
> Software verification and validation
> Process validation
|
| ISBN: | 9781450310567, 1450310567 |
| On-line přístup: | Získat plný text |
| Tagy: |
Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
|
| Abstract | BACKGROUND: Software testing can be an arduous and expensive activity. A typical activity to maximise testing productivity is to allocate test cases according to the testers' profile. However, optimising the allocation of manual test cases is not a trivial task: in big companies, test managers are responsible for allocating hundreds of test cases among several testers. OBJECTIVE: In this paper we propose and evaluate 2 assignment algorithms for test case allocation and 3 tester profiles based on recommender systems. Each assignment algorithm can be combined with 3 tester profiles, which results in six possible allocation systems. METHOD: We run a controlled experiment that uses 100 test suites, each one with at least 50 test cases, from a real industrial setting in order to compare our allocation systems to the manager's allocation in terms of precision, recall and unassignment (percentage of test cases the algorithm could not allocate). RESULTS: In our experiment, the statistical analysis shows that one of the systems outperforms the others with respect to the precision and recall metrics. For unassignment, three of our six allocation systems achieved zero (best value) for the unassignment rate. CONCLUSION: The results of our experiment suggest that, in similar environments, test managers can use our allocation systems to reduce the amount of time spent in the test case allocation task. In the real industrial setting in which our work was developed, managers spend from 16 to 30 working days a year on test case allocation. Our algorithms can help them do it faster and better. |
|---|---|
| AbstractList | BACKGROUND: Software testing can be an arduous and expensive activity. A typical activity to maximise testing productivity is to allocate test cases according to the testers' profile. However, optimising the allocation of manual test cases is not a trivial task: in big companies, test managers are responsible for allocating hundreds of test cases among several testers. OBJECTIVE: In this paper we propose and evaluate 2 assignment algorithms for test case allocation and 3 tester profiles based on recommender systems. Each assignment algorithm can be combined with 3 tester profiles, which results in six possible allocation systems. METHOD: We run a controlled experiment that uses 100 test suites, each one with at least 50 test cases, from a real industrial setting in order to compare our allocation systems to the manager's allocation in terms of precision, recall and unassignment (percentage of test cases the algorithm could not allocate). RESULTS: In our experiment, the statistical analysis shows that one of the systems outperforms the others with respect to the precision and recall metrics. For unassignment, three of our six allocation systems achieved zero (best value) for the unassignment rate. CONCLUSION: The results of our experiment suggest that, in similar environments, test managers can use our allocation systems to reduce the amount of time spent in the test case allocation task. In the real industrial setting in which our work was developed, managers spend from 16 to 30 working days a year on test case allocation. Our algorithms can help them do it faster and better. |
| Author | Miranda, Breno Iyoda, Juliano Manabu Aranha, Eduardo Henrique da Silva |
| Author_xml | – sequence: 1 givenname: Breno surname: Miranda fullname: Miranda, Breno email: bafm@cin.ufpe.br organization: Universidade Federal de Pernambuco, Recife-PE, Brazil – sequence: 2 givenname: Eduardo Henrique da Silva surname: Aranha fullname: Aranha, Eduardo Henrique da Silva email: eduardo@dimap.ufrn.br organization: Universidade Federal do Rio Grande do Norte, Natal-RN, Brazil – sequence: 3 givenname: Juliano Manabu surname: Iyoda fullname: Iyoda, Juliano Manabu email: jmi@cin.ufpe.br organization: Universidade Federal de Pernambuco, Recife-PE, Brazil |
| BookMark | eNqNjztLxEAURgdUUNfUtqnEJnHuvG5SyqKrsCCI1sM87sjqJgOZWPjvXTU_wOoU3-GDc86OxzwSY5fAWwClb4REITS0v-z6I1b12B0GLoFrg6esKuWdcw4gNEpzxq6eKeRhoDHSVJevMtNQ6pSnenDjp9vXM5V5N75dsJPk9oWqhSv2en_3sn5otk-bx_XttnFC4NwkjB599DEiGN3HKI3kJMB4Tc4F33cuYDKIwamgkLxTHiFFrTQhxCRX7Prv14XB-pw_igVuf9LskmaXtIPa_lO1ftpRkt94LVFq |
| ContentType | Conference Proceeding |
| Copyright | 2012 ACM |
| Copyright_xml | – notice: 2012 ACM |
| DOI | 10.1145/2372251.2372289 |
| DatabaseTitleList | |
| DeliveryMethod | fulltext_linktorsrc |
| Discipline | Computer Science |
| EndPage | 210 |
| GroupedDBID | 6IE 6IF 6IK 6IL 6IN AAJGR AAKMM ACM ADPZR ALMA_UNASSIGNED_HOLDINGS APO BEFXN BFFAM BGNUA BKEBE BPEOZ CBEJK GUFHI IEGSK IERZE OCL RIB RIC RIE RIL |
| ID | FETCH-LOGICAL-a227t-f7db7bdbdd71659dd3630e216b5eaacb98ac7f677ca4c47eba4b71fd545e71df3 |
| ISBN | 9781450310567 1450310567 |
| ISICitedReferencesCount | 5 |
| ISICitedReferencesURI | http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000319423700028&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| IngestDate | Mon Feb 05 09:27:01 EST 2024 Wed Jan 31 06:47:25 EST 2024 |
| IsDoiOpenAccess | false |
| IsOpenAccess | true |
| IsPeerReviewed | false |
| IsScholarly | false |
| Keywords | manual testing recommender systems test allocation |
| Language | English |
| License | Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from Permissions@acm.org |
| LinkModel | OpenURL |
| MeetingName | ESEM '12: 2012 ACM-IEEE International Symposium on Empirical Software Engineering and Measurement |
| MergedId | FETCHMERGED-LOGICAL-a227t-f7db7bdbdd71659dd3630e216b5eaacb98ac7f677ca4c47eba4b71fd545e71df3 |
| PageCount | 10 |
| ParticipantIDs | acm_books_10_1145_2372251_2372289 acm_books_10_1145_2372251_2372289_brief |
| PublicationCentury | 2000 |
| PublicationDate | 20120919 |
| PublicationDateYYYYMMDD | 2012-09-19 |
| PublicationDate_xml | – month: 09 year: 2012 text: 20120919 day: 19 |
| PublicationDecade | 2010 |
| PublicationPlace | New York, NY, USA |
| PublicationPlace_xml | – name: New York, NY, USA |
| PublicationSeriesTitle | ACM Conferences |
| PublicationTitle | Proceedings of the ACM-IEEE international symposium on Empirical software engineering and measurement |
| PublicationYear | 2012 |
| Publisher | ACM |
| Publisher_xml | – name: ACM |
| SSID | ssj0001125736 |
| Score | 1.5266597 |
| Snippet | BACKGROUND: Software testing can be an arduous and expensive activity. A typical activity to maximise testing productivity is to allocate test cases according... |
| SourceID | acm |
| SourceType | Publisher |
| StartPage | 201 |
| SubjectTerms | General and reference -- Cross-computing tools and techniques -- Validation Software and its engineering -- Software creation and management -- Software verification and validation Software and its engineering -- Software creation and management -- Software verification and validation -- Empirical software validation Software and its engineering -- Software creation and management -- Software verification and validation -- Process validation Software and its engineering -- Software creation and management -- Software verification and validation -- Software defect analysis -- Software testing and debugging |
| Subtitle | deciding how to assign tests in a test team |
| Title | Recommender systems for manual testing |
| WOSCitedRecordID | wos000319423700028&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| link | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwtV1NT9wwELUK6qEnPkpVClRBqtoDSruJnTg-IrQVHEBIpRK3yI5taSWSoM0uhX_PjO1sUoTUcuCS3bVW3k3eaDwz9ntDyBeN5ClLwXgrwWJmqI0LLbLY5rTiWuvEptI1m-AXF8X1tbgMNd3OtRPgTVPc34vbV4UaxgBspM6-AO7VpDAA7wF0uALscH0SET-7-FyuBrt-___45DzGpM5pQwzlv-6hxiNbyxo3DKb17cyrhXTgmP_geTAzSBW6LYZ6KCeODQ0T2Lp2HemCLrSTeMBzsUhNWaCMR_iHjns4x9qFNyvTtIPBycbvPU01Wm17hPQJJy6r5dGv2c3dav04e2j9BMjtlk3rjvCopfePqNvcgYGdj7iMf5U28IyIiEcO9DgITffZbsIyFDLNfP-O3uOGWogJ_nfy_LrAUEIjpRzcV_LdvRZijaxxPvGcv6EuBxEfp7njAPY_10uD9Z-DRBQM_HgyJcY4VT2KUK42yc5wv9FgA1vkjWm2yUbfvCMKvvw9-TrCLQq4RYBb5HGLAm475PfP6dXJaRyaZsQyTfkitlwrrrTSGjLhTGhNczoxaZKrzEhZKVHIituc80qyinGjJFM8sRoiacMTbekHst60jflIokJMhE1ynlLJmMqUENJCLia0yWya62KXHMLNlmj7XekJ7lkZHkgZHsgu-fbP75QKTMN--o_Z9si7wU72yfpivjQH5G11t5h1888OyEfm11-- |
| linkProvider | IEEE |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=proceeding&rft.title=Proceedings+of+the+ACM-IEEE+international+symposium+on+Empirical+software+engineering+and+measurement&rft.atitle=Recommender+systems+for+manual+testing&rft.au=Miranda%2C+Breno&rft.au=Aranha%2C+Eduardo+Henrique+da+Silva&rft.au=Iyoda%2C+Juliano+Manabu&rft.series=ACM+Conferences&rft.date=2012-09-19&rft.pub=ACM&rft.isbn=9781450310567&rft.spage=201&rft.epage=210&rft_id=info:doi/10.1145%2F2372251.2372289 |
| thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=9781450310567/lc.gif&client=summon&freeimage=true |
| thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=9781450310567/mc.gif&client=summon&freeimage=true |
| thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=9781450310567/sc.gif&client=summon&freeimage=true |