Software test results exploration and visualization with continuous integration and nightly testing

Software testing is key for quality assurance of embedded systems. However, with increased development pace, the amount of test results data risks growing to a level where exploration and visualization of the results are unmanageable. This paper covers a tool, Tim, implemented at a company developin...

Full description

Saved in:

Bibliographic Details
Published in:	International journal on software tools for technology transfer Vol. 24; no. 2; pp. 261 - 285
Main Authors:	Strandberg, Per Erik, Afzal, Wasif, Sundmark, Daniel
Format:	Journal Article
Language:	English
Published:	Berlin/Heidelberg Springer Berlin Heidelberg 01.04.2022 Springer Nature B.V
Subjects:	Anomalies Computer Science Embedded systems Exploration Meetings Quality assurance Risk management Software Software development Software Engineering Software Engineering/Programming and Operating Systems Software testing Source code Test results Theory of Computation Visual analytics Visualization Software testing Visual analytics Test results
ISSN:	1433-2779, 1433-2787, 1433-2787
Online Access:	Get full text
Tags:	Add Tag No Tags, Be the first to tag this record!

Abstract	Software testing is key for quality assurance of embedded systems. However, with increased development pace, the amount of test results data risks growing to a level where exploration and visualization of the results are unmanageable. This paper covers a tool, Tim, implemented at a company developing embedded systems, where software development occurs in parallel branches and nightly testing is partitioned over software branches, test systems and test cases. Tim aims to replace a previous solution with problems of scalability, requirements and technological flora. Tim was implemented with a reference group over several months. For validation, data were collected both from reference group meetings and logs from the usage of the tool. Data were analyzed quantitatively and qualitatively. The main contributions from the study include the implementation of eight views for test results exploration and visualization, the identification of four solutions patterns for these views (filtering, aggregation, previews and comparisons), as well as six challenges frequently discussed at reference group meetings (expectations, anomalies, navigation, integrations, hardware details and plots). Results are put in perspective with related work and future work is proposed, e.g., enhanced anomaly detection and integrations with more systems such as risk management, source code and requirements repositories.
AbstractList	Software testing is key for quality assurance of embedded systems. However, with increased development pace, the amount of test results data risks growing to a level where exploration and visualization of the results are unmanageable. This paper covers a tool, Tim, implemented at a company developing embedded systems, where software development occurs in parallel branches and nightly testing is partitioned over software branches, test systems and test cases. Tim aims to replace a previous solution with problems of scalability, requirements and technological flora. Tim was implemented with a reference group over several months. For validation, data were collected both from reference group meetings and logs from the usage of the tool. Data were analyzed quantitatively and qualitatively. The main contributions from the study include the implementation of eight views for test results exploration and visualization, the identification of four solutions patterns for these views (filtering, aggregation, previews and comparisons), as well as six challenges frequently discussed at reference group meetings (expectations, anomalies, navigation, integrations, hardware details and plots). Results are put in perspective with related work and future work is proposed, e.g., enhanced anomaly detection and integrations with more systems such as risk management, source code and requirements repositories.
Author	Strandberg, Per Erik Afzal, Wasif Sundmark, Daniel
Author_xml	– sequence: 1 givenname: Per Erik surname: Strandberg fullname: Strandberg, Per Erik email: per.strandberg@westermo.com, per.erik.strandberg@mdh.se organization: Westermo Network Technologies AB, Mälardalen University – sequence: 2 givenname: Wasif surname: Afzal fullname: Afzal, Wasif organization: Mälardalen University – sequence: 3 givenname: Daniel surname: Sundmark fullname: Sundmark, Daniel organization: Mälardalen University
BackLink	https://urn.kb.se/resolve?urn=urn:nbn:se:mdh:diva-57571$$DView record from Swedish Publication Index (Mälardalens högskola)
BookMark	eNp9kMtOwzAURC0EElD4AVaR2BK4ftROloi3VIkFj63lOk7qKrWL7VDK1xMaBIgFG9uyzsydO_to23lnEDrCcIoBxFnsTyhzICQH4EzkeAvtYUZpTkQhtr_fotxF-zHOAbDgotxD-sHXaaWCyZKJKQsmdm2KmXlbtj6oZL3LlKuyVxs71dr34Wdl0yzT3iXrOt_FzLpkml-0s80steuNpXXNAdqpVRvN4dc9Qk_XV48Xt_nk_ubu4nySawaQcsWAUqIrxjgrtS6h4IZoXuMpHlNcEmIoL3kBRQVMCRDlVE95ZVi_B1ClazpCJ4NvXJllN5XLYBcqrKVXVl7a53PpQyMX1UyOxVjgHj8e8GXwL10fVc59F1yfUBLOOGA-LkRPkYHSwccYTP1ti0F-di-H7mXfvdx0Lz-tiz8ibdOmnxSUbf-X0q8l-jmuMeEn1T-qDzujnIE
CitedBy_id	crossref_primary_10_1016_j_jss_2025_112579 crossref_primary_10_1155_2022_8008461 crossref_primary_10_1016_j_cag_2024_104064 crossref_primary_10_1186_s41239_023_00386_6 crossref_primary_10_1155_2022_4505814
Cites_doi	10.1145/774833.774843 10.1109/AINS.2018.8631436 10.1109/MCG.2016.33 10.1145/3379597.3387482 10.1002/spe.2929 10.1109/ASE.2017.8115668 10.1109/QRS-C51114.2020.00053 10.1002/9781118181034 10.1109/ACCESS.2017.2685629 10.1007/978-3-030-64148-1_26 10.1145/3239235.3239248 10.1145/3239235.3268921 10.1007/978-3-319-06862-6_12 10.1016/j.infsof.2016.07.006 10.1109/ACCESS.2019.2917403 10.1145/3338906.3338931 10.1109/TVCG.2009.111 10.1002/smr.2251 10.1023/B:AIRE.0000045502.10941.a9 10.1109/ISSRE.2016.53 10.1016/j.infsof.2015.05.004 10.1016/j.infsof.2018.01.005 10.1145/3395363.3397359 10.1016/j.csda.2008.11.033 10.1016/j.jss.2018.06.027 10.22215/timreview/1232 10.1007/978-3-030-34968-4_26 10.1109/MS.2017.3571562 10.1007/978-3-642-25676-9_8 10.1201/b10683 10.1109/CSMR-WCRE.2014.6747169 10.1049/sfw2.12030 10.1109/TVCG.2012.213 10.1145/3383219.3383244 10.1109/MS.2008.129 10.1109/BELIV51497.2020.00016 10.1109/MS.2017.34 10.1007/s10664-010-9146-4 10.1191/1478088706qp063oa 10.1145/3213846.3213859 10.1145/3428270 10.1145/1478559.1478597 10.5465/amj.2005.19573102 10.1007/978-3-030-65939-4 10.1109/ISSRE.2016.23 10.1109/MS.2017.30 10.1109/CESI.2013.6618476 10.1109/ESEM.2019.8870192
ContentType	Journal Article
Copyright	The Author(s) 2022 The Author(s) 2022. This work is published under http://creativecommons.org/licenses/by/4.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.
Copyright_xml	– notice: The Author(s) 2022 – notice: The Author(s) 2022. This work is published under http://creativecommons.org/licenses/by/4.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.
DBID	C6C AAYXX CITATION 3V. 7SC 7XB 8AL 8AO 8FD 8FE 8FG 8FK 8G5 ABJCF ABUWG AFKRA ARAPS AZQEC BENPR BGLVJ CCPQU DWQXO GNUQQ GUQSH HCIFZ JQ2 K7- L6V L7M L~C L~D M0N M2O M7S MBDVC P5Z P62 PADUT PHGZM PHGZT PKEHL PQEST PQGLB PQQKQ PQUKI PRINS PTHSS Q9U ABGEM ADTPV AOWAS D8T DF7 ZZAVC
DOI	10.1007/s10009-022-00647-1
DatabaseName	Springer Nature OA Free Journals CrossRef ProQuest Central (Corporate) Computer and Information Systems Abstracts ProQuest Central (purchase pre-March 2016) Computing Database (Alumni Edition) ProQuest Pharma Collection Technology Research Database ProQuest SciTech Collection ProQuest Technology Collection ProQuest Central (Alumni) (purchase pre-March 2016) ProQuest Research Library Materials Science & Engineering Collection ProQuest Central (Alumni) ProQuest Central Advanced Technologies & Computer Science Collection ProQuest Central Essentials ProQuest Central Technology Collection ProQuest One Community College ProQuest Central ProQuest Central Student ProQuest Research Library SciTech Collection (ProQuest) ProQuest Computer Science Collection Computer Science Database (ProQuest) ProQuest Engineering Collection Advanced Technologies Database with Aerospace Computer and Information Systems Abstracts Academic Computer and Information Systems Abstracts Professional Computing Database Research Library (ProQuest) Engineering Database Research Library (Corporate) Advanced Technologies & Aerospace Database ProQuest Advanced Technologies & Aerospace Collection Research Library China ProQuest Central Premium ProQuest One Academic (New) ProQuest One Academic Middle East (New) ProQuest One Academic Eastern Edition (DO NOT USE) ProQuest One Applied & Life Sciences ProQuest One Academic (retired) ProQuest One Academic UKI Edition ProQuest Central China Engineering Collection ProQuest Central Basic SWEPUB Mälardalens högskola full text SwePub SwePub Articles SWEPUB Freely available online SWEPUB Mälardalens högskola SwePub Articles full text
DatabaseTitle	CrossRef Research Library Prep Computer Science Database ProQuest Central Student Technology Collection Technology Research Database Computer and Information Systems Abstracts – Academic ProQuest One Academic Middle East (New) ProQuest Advanced Technologies & Aerospace Collection ProQuest Central Essentials ProQuest Computer Science Collection Computer and Information Systems Abstracts ProQuest Central (Alumni Edition) SciTech Premium Collection ProQuest One Community College Research Library (Alumni Edition) ProQuest Pharma Collection ProQuest Central China ProQuest Central ProQuest One Applied & Life Sciences ProQuest Engineering Collection ProQuest Central Korea ProQuest Research Library Research Library China ProQuest Central (New) Advanced Technologies Database with Aerospace Engineering Collection Advanced Technologies & Aerospace Collection ProQuest Computing Engineering Database ProQuest Central Basic ProQuest Computing (Alumni Edition) ProQuest One Academic Eastern Edition ProQuest Technology Collection ProQuest SciTech Collection Computer and Information Systems Abstracts Professional Advanced Technologies & Aerospace Database ProQuest One Academic UKI Edition Materials Science & Engineering Collection ProQuest One Academic ProQuest One Academic (New) ProQuest Central (Alumni)
DatabaseTitleList	Research Library Prep CrossRef
Database_xml	– sequence: 1 dbid: BENPR name: ProQuest Central url: https://www.proquest.com/central sourceTypes: Aggregation Database
DeliveryMethod	fulltext_linktorsrc
Discipline	Computer Science
EISSN	1433-2787
EndPage	285
ExternalDocumentID	oai_DiVA_org_mdh_57571 10_1007_s10009_022_00647_1
GrantInformation_xml	– fundername: Mälardalen University
GroupedDBID	-59 -5G -BR -EM -Y2 -~C .4S .86 .DC .VR 06D 0R~ 0VY 1N0 1SB 203 29J 2J2 2JN 2JY 2KG 2KM 2LR 2P1 2VQ 2~H 30V 3V. 4.4 406 408 409 40D 40E 5GY 5VS 67Z 6NX 8AO 8FE 8FG 8FW 8G5 8TC 95- 95. 95~ 96X AAAVM AABHQ AACDK AAHNG AAIAL AAJBT AAJKR AANZL AARHV AARTL AASML AATNV AATVU AAUYE AAWCG AAYIU AAYQN AAYTO AAYZH ABAKF ABBBX ABBXA ABDZT ABECU ABFTD ABFTV ABHLI ABHQN ABJCF ABJNI ABJOX ABKCH ABKTR ABMNI ABMQK ABNWP ABQBU ABQSL ABSXP ABTEG ABTHY ABTKH ABTMW ABULA ABUWG ABWNU ABXPI ACAOD ACBXY ACDTI ACGFS ACHSB ACHXU ACIWK ACKNC ACMDZ ACMLO ACOKC ACOMO ACPIV ACSNA ACZOJ ADHHG ADHIR ADINQ ADKNI ADKPE ADRFC ADTPH ADURQ ADYFF ADZKW AEBTG AEFQL AEGAL AEGNC AEJHL AEJRE AEKMD AEMSY AEOHA AEPYU AESKC AETLH AEVLU AEXYK AFBBN AFGCZ AFKRA AFLOW AFQWF AFWTZ AFZKB AGAYW AGDGC AGGDS AGJBK AGMZJ AGQEE AGQMX AGRTI AGWIL AGWZB AGYKE AHAVH AHBYD AHKAY AHSBF AHYZX AIAKS AIGIU AIIXL AILAN AITGF AJBLW AJRNO AJZVZ ALMA_UNASSIGNED_HOLDINGS ALWAN AMKLP AMXSW AMYLF AMYQR AOCGG ARAPS ARCSS ARMRJ ASPBG AVWKF AXYYD AYJHY AZFZN AZQEC B-. BA0 BDATZ BENPR BGLVJ BGNMA BPHCQ BSONS C6C CAG CCPQU COF CS3 CSCUP DDRTE DL5 DNIVK DPUIP DU5 DWQXO EBLON EBS EDO EIOEI EJD ESBYG FEDTE FERAY FFXSO FIGPU FINBP FNLPD FRRFC FSGXE FWDCC GGCAI GGRSB GJIRD GNUQQ GNWQR GQ6 GQ7 GQ8 GUQSH GXS H13 HCIFZ HF~ HG5 HG6 HMJXF HQYDN HRMNR HVGLF HZ~ I-F I09 IHE IJ- IKXTQ ITM IWAJR IXC IZIGR IZQ I~X I~Z J-C J0Z JBSCW JCJTX JZLTJ K6V K7- KDC KOV L6V LAS LLZTM M0N M2O M4Y M7S MA- MK~ ML~ N2Q NB0 NPVJJ NQJWS NU0 O9- O93 O9J OAM P62 P9O PADUT PF0 PQQKQ PROAC PT4 PT5 PTHSS Q2X QOS R89 R9I RIG RNI ROL RPX RSV RZK S16 S1Z S27 S3B SAP SCO SDH SHX SISQX SJYHP SNE SNPRN SNX SOHCF SOJ SPISZ SRMVM SSLCW STPWE SZN T13 TSG TSK TSV TUC TUS U2A UG4 UOJIU UTJUX UZXMN VC2 VFIZW W23 W48 WK8 YLTOR Z45 Z7R Z7X Z7Z Z83 Z88 ZMTXR AAPKM AAYXX ABBRH ABDBE ABFSG ABRTQ ACSTC ADHKG AEZWR AFDZB AFFHD AFHIU AFOHR AGQPQ AHPBZ AHWEU AIXLP ATHPR AYFIA CITATION PHGZM PHGZT PQGLB 7SC 7XB 8AL 8FD 8FK JQ2 L7M L~C L~D MBDVC PKEHL PQEST PQUKI PRINS Q9U ABGEM ADTPV AOWAS D8T DF7 ZZAVC
ID	FETCH-LOGICAL-c400t-a40332cd44649cc9086e2c6f1b1531922e3696808d04a7079bcb6de467903acf3
IEDL.DBID	RSV
ISICitedReferencesCount	9
ISICitedReferencesURI	http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000757730900001&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
ISSN	1433-2779 1433-2787
IngestDate	Tue Nov 04 16:16:41 EST 2025 Wed Nov 05 00:43:48 EST 2025 Sat Nov 29 03:07:49 EST 2025 Tue Nov 18 21:24:50 EST 2025 Fri Feb 21 02:47:27 EST 2025
IsDoiOpenAccess	true
IsOpenAccess	true
IsPeerReviewed	true
IsScholarly	true
Issue	2
Keywords	Software testing Visual analytics Test results
Language	English
LinkModel	DirectLink
MergedId	FETCHMERGED-LOGICAL-c400t-a40332cd44649cc9086e2c6f1b1531922e3696808d04a7079bcb6de467903acf3
Notes	ObjectType-Article-1 SourceType-Scholarly Journals-1 ObjectType-Feature-2 content type line 14
OpenAccessLink	https://link.springer.com/10.1007/s10009-022-00647-1
PQID	2646016587
PQPubID	46652
PageCount	25
ParticipantIDs	swepub_primary_oai_DiVA_org_mdh_57571 proquest_journals_2646016587 crossref_primary_10_1007_s10009_022_00647_1 crossref_citationtrail_10_1007_s10009_022_00647_1 springer_journals_10_1007_s10009_022_00647_1
PublicationCentury	2000
PublicationDate	2022-04-01
PublicationDateYYYYMMDD	2022-04-01
PublicationDate_xml	– month: 04 year: 2022 text: 2022-04-01 day: 01
PublicationDecade	2020
PublicationPlace	Berlin/Heidelberg
PublicationPlace_xml	– name: Berlin/Heidelberg – name: Heidelberg
PublicationTitle	International journal on software tools for technology transfer
PublicationTitleAbbrev	Int J Softw Tools Technol Transfer
PublicationYear	2022
Publisher	Springer Berlin Heidelberg Springer Nature B.V
Publisher_xml	– name: Springer Berlin Heidelberg – name: Springer Nature B.V
References	Kalloniatis, M., Luu, C.: The perception of color. In: The Organization of the Retina and Visual System, Webvision (2007) IvarssonMGorschekTA method for evaluating rigor and industrial relevance of technology evaluationsEmpir. Softw. Eng.201116336539510.1007/s10664-010-9146-4 GarousiVElberzhagerFTest automation: not just for test executionIEEE Softw.2017342909610.1109/MS.2017.34 Brandtner, M., Giger, E., Gall, H.: Supporting continuous integration by mashing-up software quality information. In: Software Evolution Week—IEEE Conference on Software Maintenance, Reengineering, and Reverse Engineering. IEEE (2014) DiehlSSoftware Visualization: Visualizing the Structure, Behaviour, and Evolution of Software2007BerlinSpringer1116.68025 FernandezABergelAA domain-specific language to visualize software evolutionInf. Softw. Technol.20189811813010.1016/j.infsof.2018.01.005 TukeyJWExploratory Data Analysis1977LondonPearson0409.62003 Borg, M., Brytting, A., Hansson, D.: Enabling visual design verification analytics—from prototype visualizations to ananalytics tool using the unity game engine. In: Proceedings of the Design and Verification Conference Europe (DVCon EU), Munich, Germany (2018) FroeseM-EToryMLessons learned from designing visualization dashboardsIEEE Comput. Graph. Appl.2016362838910.1109/MCG.2016.33 Ralph, P., Baltes, S., Bianculli, D., Dittrich, Y., Felderer, M., Feldt, R., Filieri, A. Furia,, C.A., Graziotin, D., He, P., et al.: ACM SIGSOFT empirical standards. arXiv preprint arXiv:2010.03525 (2020) Orso, A., Jones, J., Harrold, M.J.: Visualization of Program-Execution Data for Deployed Software. In: Symposium on Software Visualization. ACM (2003) Munzner, T.: A nested model for visualization design and validation. IEEE Trans. Vis. Comput. Graph. 15(6) 921–928 (2009) Strandberg, P.E., Ostrand, T.J., Weyuker, E.J., Sundmark, D., Afzal, W.: Automated test mapping and coverage for network topologies. In: International Symposium on Software Testing and Analysis. ACM (2018) Staron, M.: Automotive software architectures. Springer (2021). https://doi.org/10.1007/978-3-030-65939-4 BraunVClarkeVUsing thematic analysis in psychologyQual. Res. Psychol.2006327710110.1191/1478088706qp063oa Hove, S.E., Anda, B.: Experiences from conducting semi-structured interviews in empirical software engineering research. In: International Software Metrics Symposium. IEEE (2005) Sannö, A., Öberg, A.E., Flores-Garcia, E., Jackson, M.: Increasing the impact of industry—academia collaboration through co-production. Technol. Innov. Manag. Rev. 9(4), 37–47 (2019) Muruti, G., Rahim, F.A., Bin Ibrahim, Z.-A.: A survey on anomalies detection techniques and measurement methods. In: 2018 IEEE Conference on Application, Information and Network Security (AINS), pp. 81–86. IEEE (2018) Eldh, S.: Some researcher considerations when conducting empirical studies in industry. In: International Workshop on Conducting Empirical Studies in Industry. IEEE (2013) LamWWinterSWeiAXieTMarinovDBellJA large-scale longitudinal study of flaky testsProc. ACM Program. Lang.20204OOPSLA12910.1145/3428270 WardMOGrinsteinGKeimDInteractive Data Visualization: Foundations, Techniques, and Applications2010Boca RatonCRC Press10.1201/b10683 RunesonPHöstMRainerARegnellBCase Study Research in Software Engineering: Guidelines and Examples2012New YorkWiley10.1002/9781118181034 SedlmairMMeyerMMunznerTDesign study methodology: reflections from the trenches and the stacksIEEE Trans. Vis. Comput. Graph.201218122431244010.1109/TVCG.2012.213 ZeileisAHornikKMurrellPEscaping RGBland: selecting colors for statistical graphicsComput. Stat. Data Anal.200953932593270275113510.1016/j.csda.2008.11.033 Pinto, G., Miranda, B., Dissanayake, S., d’Amorim, M., Treude, C., Bertolino, A.: What is the vocabulary of flaky tests? In: Proceedings of the 17th International Conference on Mining Software Repositories, pp. 492–502 (2020) Ball, M., Hardie, F.: Effects and detection of intermittent failures in digital systems. In: Proceedings of the November 18–20, 1969, Fall Joint Computer Conference, pp. 329–335. ACM (1969) Enoiu, E., Tukseferi, G., Feldt, R.: Towards a model of testers’ cognitive processes: software testing as a problem solving approach. In: 2020 IEEE 20th International Conference on Software Quality, Reliability and Security Companion (QRS-C), pp. 272–279. IEEE (2020) BriandLBianculliDNejatiSPastoreFSabetzadehMThe case for context-driven software engineering research: generalizability is overratedIEEE Softw.2017345727510.1109/MS.2017.3571562 Strandberg, P.E., Ostrand, T.J., Weyuker, E.J., Afzal, W., Sundmark, D.: Intermittently failing tests in the embedded systems domain. In International Symposium on Software Testing and Analysis, ISSTA 2020. ACM (2020) VermeulenFOn rigor and relevance: fostering dialectic progress in management researchAcad. Manag. J.200548697898210.5465/amj.2005.19573102 Nilsson, A., Bosch, J., Berger, C.: Visualizing testing activities to support continuous integration: a multiple case study. In: International Conference on Agile Software Development. Springer (2014) Zhang, X., Xu, Y., Lin, Q., Qiao, B., Zhang, H., Dang, Y., Xie, C., Yang, X., Cheng, Q., Li, Z., et al.: Robust log-based anomaly detection on unstable log data. In: Proceedings of the 2019 27th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering, pp. 807–817 (2019) HevnerARMarchSTParkJRamSDesign science in information systems researchManag. Inf. Syst. Q.20082816 StrandbergPEAfzalWOstrandTWeyukerESundmarkDAutomated system level regression test prioritization in a nutshellIEEE Softw.201734111010.1109/MS.2017.30 Wang, R., Artho, C., Kristensen, L.M., Stolz, V.: Visualization and abstractions for execution paths in model-based software testing. In: International Conference on Integrated Formal Methods, pp. 474–492. Springer (2019) HodgeVAustinJA survey of outlier detection methodologiesArtif. Intell. Rev.20042228512610.1023/B:AIRE.0000045502.10941.a9 BjarnasonESmolanderKEngströmERunesonPA theory of distances in software engineeringInf. Softw. Technol.20167020421910.1016/j.infsof.2015.05.004 ShahinMBabarMAZhuLContinuous integration, delivery and deployment: a systematic review on approaches, tools, challenges and practicesIEEE Access201753909394310.1109/ACCESS.2017.2685629 Strandberg, P.E.: Ethical interviews in software engineering. In: International Symposium on Empirical Software Engineering and Measurement (2019) ZolfaghariBPariziRMSrivastavaGHailemariamYRoot causing, detecting, and fixing flaky tests: state of the art and future roadmapSoftw. Pract. Exp.202151585186710.1002/spe.2929 Ahmad, A., Leifler, O., Sandahl, K.: Data visualisation in continuous integration and delivery: information needs, challenges, and recommendations. IET Softw. (2021). https://doi.org/10.1049/sfw2.12030 CooperWFElectrical control of dangerous machinery and processesJ. Inst. Electr. Eng. Part II Power Eng.19479439216232 Ram, P., Rodríguez, P., Oivo, M., Bagnato, A., Abherve, A., Choraś, M., Kozik, R.: An empirical investigation into industrial use of software metrics programs. In: International Conference on Product-Focused Software Process Improvement, pp. 419–433. Springer (2020) Ram, P., Rodríguez, P., Oivo, M., Martínez-Fernández, S., Bagnato, A., Choraś, M., Kozik, R., Aaramaa, S., Ahola, M.: Actionable software metrics: an industrial perspective. In: Proceedings of the Evaluation and Assessment in Software Engineering, pp. 240–249. ACM (2020) Garousi, V., Felderer, M., Kuhrmann, M., Herkiloğlu, K., Eldh, S.: Exploring the industry’s challenges in software testing: an empirical study. J. Softw. Evol. Process 32(8), e2251 (2020) Parmeza, E.: Experimental evaluation of tools for mining test execution logs. Master’s thesis, Mälardalen University (2020) Tómasdóttir, K.F., Aniche, M., van Deursen, A.: Why and how javascript developers use linters. In: 2017 32nd IEEE/ACM International Conference on Automated Software Engineering (ASE), pp. 578–589. IEEE (2017) Fowler, M.: Eradicating non-determinism in tests (blog post). https://www.martinfowler.com/articles/nonDeterminism.html (2011). Online, Accessed 2021-07-05 Martínez-FernándezSVollmerAMJedlitschkaAFranchXLópezLRamPRodríguezPAaramaaSBagnatoAChoraśMPartanenJContinuously assessing and improving software quality with software analytics tools: a case studyIEEE Access20197682196823910.1109/ACCESS.2019.2917403 Rosenberg, C.M., Moonen, L.: Improving problem identification via automated log clustering using dimensionality reduction. In: Proceedings of the 12th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement, pp. 1–10 (2018) GarousiVPetersenKOzkanBChallenges and best practices in industry-academia collaborations in software engineering: a systematic literature reviewInf. Softw. Technol.20167910612710.1016/j.infsof.2016.07.006 Ralph, P.: Toward a theory of debiasing software development. In: EuroSymposium on Systems Analysis and Design, pp. 92–105. Springer (2011) Duraes, J., Madeira, H., Castelhano, J., Duarte, C., Branco, M. C.: Wap: understanding the brain at software debugging. In: 2016 IEEE 27th International Symposium on Software Reliability Engineering (ISSRE), pp. 87–92. IEEE (2016) Strandberg, P.E., Afzal, W., Sundmark, D.: Decision making and visualizations based on test results. In: International Symposium on Empirical Software Engineering and Measurement (2018) Sabljakovic, H., Djordjevic, M.: Migrating and Evaluating a Testing Framework from a Dynamically to a Statically Typed Language. Master’s thesis, Mälardalen University (2018) MerinoLGhafariMAnslowCNierstraszOA systematic literature review of software visualization evaluationJ. Syst. Softw.201814416518010.1016/j.jss.2018.06.027 DeissenboeckFJuergensEHummelBWagnerSPararedaBMYPizkaMTool support for continuous quality controlIEEE Softw.2008255606710.1109/MS.2008.129 Strandberg, P.E., Sundmark, D., Afzal, W., Ostrand, T.J., Weyuker, E.J.: Experience report: automated system 647_CR48 V Garousi (647_CR19) 2016; 79 647_CR49 E Bjarnason (647_CR3) 2016; 70 M-E Froese (647_CR16) 2016; 36 647_CR41 647_CR42 647_CR45 647_CR46 M Sedlmair (647_CR43) 2012; 18 PE Strandberg (647_CR47) 2017; 34 B Zolfaghari (647_CR59) 2021; 51 647_CR36 P Runeson (647_CR40) 2012 647_CR37 647_CR38 647_CR39 JW Tukey (647_CR53) 1977 MO Ward (647_CR56) 2010 647_CR30 647_CR31 V Hodge (647_CR21) 2004; 22 647_CR32 647_CR33 647_CR34 647_CR35 M Ivarsson (647_CR23) 2011; 16 M Shahin (647_CR44) 2017; 5 S Martínez-Fernández (647_CR26) 2019; 7 647_CR28 647_CR29 647_CR22 647_CR24 A Zeileis (647_CR57) 2009; 53 L Merino (647_CR27) 2018; 144 V Garousi (647_CR17) 2017; 34 F Deissenboeck (647_CR9) 2008; 25 647_CR5 647_CR4 647_CR58 647_CR15 647_CR2 647_CR1 W Lam (647_CR25) 2020; 4 F Vermeulen (647_CR54) 2005; 48 V Braun (647_CR6) 2006; 3 647_CR18 647_CR50 647_CR51 647_CR52 647_CR11 647_CR55 S Diehl (647_CR10) 2007 647_CR12 647_CR13 A Fernandez (647_CR14) 2018; 98 WF Cooper (647_CR8) 1947; 94 AR Hevner (647_CR20) 2008; 28 L Briand (647_CR7) 2017; 34
References_xml	– reference: ZeileisAHornikKMurrellPEscaping RGBland: selecting colors for statistical graphicsComput. Stat. Data Anal.200953932593270275113510.1016/j.csda.2008.11.033 – reference: Martínez-FernándezSVollmerAMJedlitschkaAFranchXLópezLRamPRodríguezPAaramaaSBagnatoAChoraśMPartanenJContinuously assessing and improving software quality with software analytics tools: a case studyIEEE Access20197682196823910.1109/ACCESS.2019.2917403 – reference: TukeyJWExploratory Data Analysis1977LondonPearson0409.62003 – reference: Muruti, G., Rahim, F.A., Bin Ibrahim, Z.-A.: A survey on anomalies detection techniques and measurement methods. In: 2018 IEEE Conference on Application, Information and Network Security (AINS), pp. 81–86. IEEE (2018) – reference: DeissenboeckFJuergensEHummelBWagnerSPararedaBMYPizkaMTool support for continuous quality controlIEEE Softw.2008255606710.1109/MS.2008.129 – reference: Sannö, A., Öberg, A.E., Flores-Garcia, E., Jackson, M.: Increasing the impact of industry—academia collaboration through co-production. Technol. Innov. Manag. Rev. 9(4), 37–47 (2019) – reference: Oppermann, M., Munzner, T.: Data-first visualization design studies. In: 2020 IEEE Workshop on Evaluation and Beyond-Methodological Approaches to Visualization (BELIV), pp. 74–80. IEEE (2020) – reference: BjarnasonESmolanderKEngströmERunesonPA theory of distances in software engineeringInf. Softw. Technol.20167020421910.1016/j.infsof.2015.05.004 – reference: Enoiu, E., Tukseferi, G., Feldt, R.: Towards a model of testers’ cognitive processes: software testing as a problem solving approach. In: 2020 IEEE 20th International Conference on Software Quality, Reliability and Security Companion (QRS-C), pp. 272–279. IEEE (2020) – reference: HodgeVAustinJA survey of outlier detection methodologiesArtif. Intell. Rev.20042228512610.1023/B:AIRE.0000045502.10941.a9 – reference: Staron, M.: Automotive software architectures. Springer (2021). https://doi.org/10.1007/978-3-030-65939-4 – reference: Strandberg, P.E., Sundmark, D., Afzal, W., Ostrand, T.J., Weyuker, E.J.: Experience report: automated system level regression test prioritization using multiple factors. In: International symposium on software reliability engineering. IEEE (2016) – reference: BraunVClarkeVUsing thematic analysis in psychologyQual. Res. Psychol.2006327710110.1191/1478088706qp063oa – reference: StrandbergPEAfzalWOstrandTWeyukerESundmarkDAutomated system level regression test prioritization in a nutshellIEEE Softw.201734111010.1109/MS.2017.30 – reference: Strandberg, P.E., Ostrand, T.J., Weyuker, E.J., Sundmark, D., Afzal, W.: Automated test mapping and coverage for network topologies. In: International Symposium on Software Testing and Analysis. ACM (2018) – reference: HevnerARMarchSTParkJRamSDesign science in information systems researchManag. Inf. Syst. Q.20082816 – reference: Strandberg, P.E., Afzal, W., Sundmark, D.: Decision making and visualizations based on test results. In: International Symposium on Empirical Software Engineering and Measurement (2018) – reference: Ball, M., Hardie, F.: Effects and detection of intermittent failures in digital systems. In: Proceedings of the November 18–20, 1969, Fall Joint Computer Conference, pp. 329–335. ACM (1969) – reference: Ralph, P.: Toward a theory of debiasing software development. In: EuroSymposium on Systems Analysis and Design, pp. 92–105. Springer (2011) – reference: Kalloniatis, M., Luu, C.: The perception of color. In: The Organization of the Retina and Visual System, Webvision (2007) – reference: FernandezABergelAA domain-specific language to visualize software evolutionInf. Softw. Technol.20189811813010.1016/j.infsof.2018.01.005 – reference: Sabljakovic, H., Djordjevic, M.: Migrating and Evaluating a Testing Framework from a Dynamically to a Statically Typed Language. Master’s thesis, Mälardalen University (2018) – reference: Garousi, V., Felderer, M., Kuhrmann, M., Herkiloğlu, K., Eldh, S.: Exploring the industry’s challenges in software testing: an empirical study. J. Softw. Evol. Process 32(8), e2251 (2020) – reference: Wang, R., Artho, C., Kristensen, L.M., Stolz, V.: Visualization and abstractions for execution paths in model-based software testing. In: International Conference on Integrated Formal Methods, pp. 474–492. Springer (2019) – reference: MerinoLGhafariMAnslowCNierstraszOA systematic literature review of software visualization evaluationJ. Syst. Softw.201814416518010.1016/j.jss.2018.06.027 – reference: Munzner, T.: A nested model for visualization design and validation. IEEE Trans. Vis. Comput. Graph. 15(6) 921–928 (2009) – reference: Parmeza, E.: Experimental evaluation of tools for mining test execution logs. Master’s thesis, Mälardalen University (2020) – reference: SedlmairMMeyerMMunznerTDesign study methodology: reflections from the trenches and the stacksIEEE Trans. Vis. Comput. Graph.201218122431244010.1109/TVCG.2012.213 – reference: Strandberg, P.E.: Ethical interviews in software engineering. In: International Symposium on Empirical Software Engineering and Measurement (2019) – reference: Nilsson, A., Bosch, J., Berger, C.: Visualizing testing activities to support continuous integration: a multiple case study. In: International Conference on Agile Software Development. Springer (2014) – reference: Ralph, P., Baltes, S., Bianculli, D., Dittrich, Y., Felderer, M., Feldt, R., Filieri, A. Furia,, C.A., Graziotin, D., He, P., et al.: ACM SIGSOFT empirical standards. arXiv preprint arXiv:2010.03525 (2020) – reference: FroeseM-EToryMLessons learned from designing visualization dashboardsIEEE Comput. Graph. Appl.2016362838910.1109/MCG.2016.33 – reference: Rosenberg, C.M., Moonen, L.: Improving problem identification via automated log clustering using dimensionality reduction. In: Proceedings of the 12th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement, pp. 1–10 (2018) – reference: RunesonPHöstMRainerARegnellBCase Study Research in Software Engineering: Guidelines and Examples2012New YorkWiley10.1002/9781118181034 – reference: GarousiVPetersenKOzkanBChallenges and best practices in industry-academia collaborations in software engineering: a systematic literature reviewInf. Softw. Technol.20167910612710.1016/j.infsof.2016.07.006 – reference: VermeulenFOn rigor and relevance: fostering dialectic progress in management researchAcad. Manag. J.200548697898210.5465/amj.2005.19573102 – reference: GarousiVElberzhagerFTest automation: not just for test executionIEEE Softw.2017342909610.1109/MS.2017.34 – reference: Eldh, S.: Some researcher considerations when conducting empirical studies in industry. In: International Workshop on Conducting Empirical Studies in Industry. IEEE (2013) – reference: Orso, A., Jones, J., Harrold, M.J.: Visualization of Program-Execution Data for Deployed Software. In: Symposium on Software Visualization. ACM (2003) – reference: Pinto, G., Miranda, B., Dissanayake, S., d’Amorim, M., Treude, C., Bertolino, A.: What is the vocabulary of flaky tests? In: Proceedings of the 17th International Conference on Mining Software Repositories, pp. 492–502 (2020) – reference: DiehlSSoftware Visualization: Visualizing the Structure, Behaviour, and Evolution of Software2007BerlinSpringer1116.68025 – reference: CooperWFElectrical control of dangerous machinery and processesJ. Inst. Electr. Eng. Part II Power Eng.19479439216232 – reference: Ram, P., Rodríguez, P., Oivo, M., Bagnato, A., Abherve, A., Choraś, M., Kozik, R.: An empirical investigation into industrial use of software metrics programs. In: International Conference on Product-Focused Software Process Improvement, pp. 419–433. Springer (2020) – reference: Hove, S.E., Anda, B.: Experiences from conducting semi-structured interviews in empirical software engineering research. In: International Software Metrics Symposium. IEEE (2005) – reference: LamWWinterSWeiAXieTMarinovDBellJA large-scale longitudinal study of flaky testsProc. ACM Program. Lang.20204OOPSLA12910.1145/3428270 – reference: Brandtner, M., Giger, E., Gall, H.: Supporting continuous integration by mashing-up software quality information. In: Software Evolution Week—IEEE Conference on Software Maintenance, Reengineering, and Reverse Engineering. IEEE (2014) – reference: Ahmad, A., Leifler, O., Sandahl, K.: Data visualisation in continuous integration and delivery: information needs, challenges, and recommendations. IET Softw. (2021). https://doi.org/10.1049/sfw2.12030 – reference: Zhang, X., Xu, Y., Lin, Q., Qiao, B., Zhang, H., Dang, Y., Xie, C., Yang, X., Cheng, Q., Li, Z., et al.: Robust log-based anomaly detection on unstable log data. In: Proceedings of the 2019 27th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering, pp. 807–817 (2019) – reference: Ram, P., Rodríguez, P., Oivo, M., Martínez-Fernández, S., Bagnato, A., Choraś, M., Kozik, R., Aaramaa, S., Ahola, M.: Actionable software metrics: an industrial perspective. In: Proceedings of the Evaluation and Assessment in Software Engineering, pp. 240–249. ACM (2020) – reference: Strandberg, P.E., Ostrand, T.J., Weyuker, E.J., Afzal, W., Sundmark, D.: Intermittently failing tests in the embedded systems domain. In International Symposium on Software Testing and Analysis, ISSTA 2020. ACM (2020) – reference: Duraes, J., Madeira, H., Castelhano, J., Duarte, C., Branco, M. C.: Wap: understanding the brain at software debugging. In: 2016 IEEE 27th International Symposium on Software Reliability Engineering (ISSRE), pp. 87–92. IEEE (2016) – reference: ZolfaghariBPariziRMSrivastavaGHailemariamYRoot causing, detecting, and fixing flaky tests: state of the art and future roadmapSoftw. Pract. Exp.202151585186710.1002/spe.2929 – reference: IvarssonMGorschekTA method for evaluating rigor and industrial relevance of technology evaluationsEmpir. Softw. Eng.201116336539510.1007/s10664-010-9146-4 – reference: Borg, M., Brytting, A., Hansson, D.: Enabling visual design verification analytics—from prototype visualizations to ananalytics tool using the unity game engine. In: Proceedings of the Design and Verification Conference Europe (DVCon EU), Munich, Germany (2018) – reference: WardMOGrinsteinGKeimDInteractive Data Visualization: Foundations, Techniques, and Applications2010Boca RatonCRC Press10.1201/b10683 – reference: ShahinMBabarMAZhuLContinuous integration, delivery and deployment: a systematic review on approaches, tools, challenges and practicesIEEE Access201753909394310.1109/ACCESS.2017.2685629 – reference: Tómasdóttir, K.F., Aniche, M., van Deursen, A.: Why and how javascript developers use linters. In: 2017 32nd IEEE/ACM International Conference on Automated Software Engineering (ASE), pp. 578–589. IEEE (2017) – reference: Fowler, M.: Eradicating non-determinism in tests (blog post). https://www.martinfowler.com/articles/nonDeterminism.html (2011). Online, Accessed 2021-07-05 – reference: BriandLBianculliDNejatiSPastoreFSabetzadehMThe case for context-driven software engineering research: generalizability is overratedIEEE Softw.2017345727510.1109/MS.2017.3571562 – ident: 647_CR32 doi: 10.1145/774833.774843 – ident: 647_CR29 doi: 10.1109/AINS.2018.8631436 – volume: 36 start-page: 83 issue: 2 year: 2016 ident: 647_CR16 publication-title: IEEE Comput. Graph. Appl. doi: 10.1109/MCG.2016.33 – volume: 28 start-page: 6 issue: 1 year: 2008 ident: 647_CR20 publication-title: Manag. Inf. Syst. Q. – ident: 647_CR34 doi: 10.1145/3379597.3387482 – volume: 51 start-page: 851 issue: 5 year: 2021 ident: 647_CR59 publication-title: Softw. Pract. Exp. doi: 10.1002/spe.2929 – ident: 647_CR52 doi: 10.1109/ASE.2017.8115668 – ident: 647_CR13 doi: 10.1109/QRS-C51114.2020.00053 – volume-title: Case Study Research in Software Engineering: Guidelines and Examples year: 2012 ident: 647_CR40 doi: 10.1002/9781118181034 – ident: 647_CR36 – volume-title: Software Visualization: Visualizing the Structure, Behaviour, and Evolution of Software year: 2007 ident: 647_CR10 – volume: 5 start-page: 3909 year: 2017 ident: 647_CR44 publication-title: IEEE Access doi: 10.1109/ACCESS.2017.2685629 – ident: 647_CR37 doi: 10.1007/978-3-030-64148-1_26 – ident: 647_CR39 doi: 10.1145/3239235.3239248 – ident: 647_CR41 – ident: 647_CR48 doi: 10.1145/3239235.3268921 – ident: 647_CR30 doi: 10.1007/978-3-319-06862-6_12 – volume: 79 start-page: 106 year: 2016 ident: 647_CR19 publication-title: Inf. Softw. Technol. doi: 10.1016/j.infsof.2016.07.006 – ident: 647_CR24 – volume: 7 start-page: 68219 year: 2019 ident: 647_CR26 publication-title: IEEE Access doi: 10.1109/ACCESS.2019.2917403 – ident: 647_CR58 doi: 10.1145/3338906.3338931 – ident: 647_CR28 doi: 10.1109/TVCG.2009.111 – ident: 647_CR18 doi: 10.1002/smr.2251 – volume: 22 start-page: 85 issue: 2 year: 2004 ident: 647_CR21 publication-title: Artif. Intell. Rev. doi: 10.1023/B:AIRE.0000045502.10941.a9 – ident: 647_CR11 doi: 10.1109/ISSRE.2016.53 – volume: 70 start-page: 204 year: 2016 ident: 647_CR3 publication-title: Inf. Softw. Technol. doi: 10.1016/j.infsof.2015.05.004 – volume: 98 start-page: 118 year: 2018 ident: 647_CR14 publication-title: Inf. Softw. Technol. doi: 10.1016/j.infsof.2018.01.005 – ident: 647_CR49 doi: 10.1145/3395363.3397359 – volume: 53 start-page: 3259 issue: 9 year: 2009 ident: 647_CR57 publication-title: Comput. Stat. Data Anal. doi: 10.1016/j.csda.2008.11.033 – volume: 144 start-page: 165 year: 2018 ident: 647_CR27 publication-title: J. Syst. Softw. doi: 10.1016/j.jss.2018.06.027 – ident: 647_CR42 doi: 10.22215/timreview/1232 – ident: 647_CR55 doi: 10.1007/978-3-030-34968-4_26 – ident: 647_CR15 – volume: 34 start-page: 72 issue: 5 year: 2017 ident: 647_CR7 publication-title: IEEE Softw. doi: 10.1109/MS.2017.3571562 – volume: 94 start-page: 216 issue: 39 year: 1947 ident: 647_CR8 publication-title: J. Inst. Electr. Eng. Part II Power Eng. – ident: 647_CR35 doi: 10.1007/978-3-642-25676-9_8 – volume-title: Interactive Data Visualization: Foundations, Techniques, and Applications year: 2010 ident: 647_CR56 doi: 10.1201/b10683 – ident: 647_CR5 doi: 10.1109/CSMR-WCRE.2014.6747169 – ident: 647_CR1 doi: 10.1049/sfw2.12030 – volume: 18 start-page: 2431 issue: 12 year: 2012 ident: 647_CR43 publication-title: IEEE Trans. Vis. Comput. Graph. doi: 10.1109/TVCG.2012.213 – ident: 647_CR38 doi: 10.1145/3383219.3383244 – volume: 25 start-page: 60 issue: 5 year: 2008 ident: 647_CR9 publication-title: IEEE Softw. doi: 10.1109/MS.2008.129 – ident: 647_CR31 doi: 10.1109/BELIV51497.2020.00016 – volume: 34 start-page: 90 issue: 2 year: 2017 ident: 647_CR17 publication-title: IEEE Softw. doi: 10.1109/MS.2017.34 – volume: 16 start-page: 365 issue: 3 year: 2011 ident: 647_CR23 publication-title: Empir. Softw. Eng. doi: 10.1007/s10664-010-9146-4 – volume: 3 start-page: 77 issue: 2 year: 2006 ident: 647_CR6 publication-title: Qual. Res. Psychol. doi: 10.1191/1478088706qp063oa – ident: 647_CR22 – volume-title: Exploratory Data Analysis year: 1977 ident: 647_CR53 – ident: 647_CR50 doi: 10.1145/3213846.3213859 – ident: 647_CR33 – volume: 4 start-page: 1 issue: OOPSLA year: 2020 ident: 647_CR25 publication-title: Proc. ACM Program. Lang. doi: 10.1145/3428270 – ident: 647_CR2 doi: 10.1145/1478559.1478597 – volume: 48 start-page: 978 issue: 6 year: 2005 ident: 647_CR54 publication-title: Acad. Manag. J. doi: 10.5465/amj.2005.19573102 – ident: 647_CR45 doi: 10.1007/978-3-030-65939-4 – ident: 647_CR4 – ident: 647_CR51 doi: 10.1109/ISSRE.2016.23 – volume: 34 start-page: 1 issue: 1 year: 2017 ident: 647_CR47 publication-title: IEEE Softw. doi: 10.1109/MS.2017.30 – ident: 647_CR12 doi: 10.1109/CESI.2013.6618476 – ident: 647_CR46 doi: 10.1109/ESEM.2019.8870192
SSID	ssj0017679
Score	2.3658159
Snippet	Software testing is key for quality assurance of embedded systems. However, with increased development pace, the amount of test results data risks growing to a...
SourceID	swepub proquest crossref springer
SourceType	Open Access Repository Aggregation Database Enrichment Source Index Database Publisher
StartPage	261
SubjectTerms	Anomalies Computer Science Embedded systems Exploration Meetings Quality assurance Risk management Software Software development Software Engineering Software Engineering/Programming and Operating Systems Software testing Source code Test results Theory of Computation Visual analytics Visualization
SummonAdditionalLinks	– databaseName: Computer Science Database (ProQuest) dbid: K7- link: http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwpV3NT9swFLdG2YHL-NgQHQX5ACdmLXbcOD5NaFBN2oSQgKk3y3YcqFTS0qQg_nueXafVduiFcxw70fv2e-_3EDrRwiSpMwXpyzIjHAwu0VJYInUmJaeGcxPQ9f-Iq6t8OJTX8cKtjmWVrU4MirqYWH9H_h0Mt0cO6efix_SJ-KlRPrsaR2hsoE3KGPV8_luQZRZBZAFrD1yClDAhZGyaia1zIS0AoVjotyT0X8O08jaXCdL_wESDARpsv_fTd9Cn6Hri8wWv7KIPrtpD2-1YBxyl_DOyN6CaX_TMYXBDGwzx-Hzc1NiFar1ASKyrAj-Pat-QuWjjxP4-F_u691E1n8xr3MJQtKsDYMn4NWwJ__kF3Q0ub3_-InEWA7Eg5Q3RPElTZguIHrm0VkIk5JjNSmqol2LGnB8MmCd5kXDtUfeMNVnhQA3LJNW2TPdRp5pU7gBh4BoqUmayMjfcgULwkPMcgnpdakcZ7SLaEkLZCFTu52WM1Qpi2RNPAfFUIJ6Cd86W70wXMB1rV_daQqkosrVaUamLvrU0Xz1et9vpgi-WJ3vI7ovR33M1md2rx-JBgU8s6Nf1px6iLRbY0VcF9VCnmc3dEfpon5tRPTsOjP0G9h_-hQ priority: 102 providerName: ProQuest
Title	Software test results exploration and visualization with continuous integration and nightly testing
URI	https://link.springer.com/article/10.1007/s10009-022-00647-1 https://www.proquest.com/docview/2646016587 https://urn.kb.se/resolve?urn=urn:nbn:se:mdh:diva-57571
Volume	24
WOSCitedRecordID	wos000757730900001&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
hasFullText	1
inHoldings	1
isFullTextHit
isPrint
journalDatabaseRights	– providerCode: PRVPQU databaseName: Advanced Technologies & Aerospace Database customDbUrl: eissn: 1433-2787 dateEnd: 20241207 omitProxy: false ssIdentifier: ssj0017679 issn: 1433-2779 databaseCode: P5Z dateStart: 20190101 isFulltext: true titleUrlDefault: https://search.proquest.com/hightechjournals providerName: ProQuest – providerCode: PRVPQU databaseName: Computer Science Database (ProQuest) customDbUrl: eissn: 1433-2787 dateEnd: 20241207 omitProxy: false ssIdentifier: ssj0017679 issn: 1433-2779 databaseCode: K7- dateStart: 20190101 isFulltext: true titleUrlDefault: http://search.proquest.com/compscijour providerName: ProQuest – providerCode: PRVPQU databaseName: Engineering Database customDbUrl: eissn: 1433-2787 dateEnd: 20241207 omitProxy: false ssIdentifier: ssj0017679 issn: 1433-2779 databaseCode: M7S dateStart: 20190101 isFulltext: true titleUrlDefault: http://search.proquest.com providerName: ProQuest – providerCode: PRVPQU databaseName: ProQuest Central customDbUrl: eissn: 1433-2787 dateEnd: 20241207 omitProxy: false ssIdentifier: ssj0017679 issn: 1433-2779 databaseCode: BENPR dateStart: 20190101 isFulltext: true titleUrlDefault: https://www.proquest.com/central providerName: ProQuest – providerCode: PRVPQU databaseName: Research Library customDbUrl: eissn: 1433-2787 dateEnd: 20241207 omitProxy: false ssIdentifier: ssj0017679 issn: 1433-2779 databaseCode: M2O dateStart: 20190101 isFulltext: true titleUrlDefault: https://search.proquest.com/pqrl providerName: ProQuest – providerCode: PRVAVX databaseName: SpringerLink customDbUrl: eissn: 1433-2787 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0017679 issn: 1433-2779 databaseCode: RSV dateStart: 19971201 isFulltext: true titleUrlDefault: https://link.springer.com/search?facet-content-type=%22Journal%22 providerName: Springer Nature
link	http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnV3dT9swELdY2cNeVmCbKIPKD-yJWUocN44f-WiFBHQV3RDai2U7DlTqUpSknfjvObtJO6YJib34JfbFOt_Zd_bd7xA6VFwHkdUp6YksJgwOXKIEN0SoWAgWasa0R9e_5MNhcnsrRnVSWNlEuzdPkn6n_iPZzV_kg_PkMyQJ-DybcNwlTh2vxzertwMee4Q9MAQiQjkXdarMv2k8P47WNubqWfQvCFF_7Aza_zfhLfS-NjPx8VIuttGGzXdQuynhgGuN_oDMGLbh36qwGEzOCoPvPZ9WJbY-Ms8vGlZ5iheT0iVfLlM2sbu7xS7GfZLPZ_MSN5ATTW8PTjJ99CRhwh_Rj0H_--k5qesuEAMaXRHFgiiiJgVPkQljBHg9lpo4C3XoNJZS64oAJkGSBkw5hD1tdJxa2HJFECmTRZ9QK5_ldhdhkJCQR1THWaKZBeV38PIMHHiVKRvSsIPChv3S1KDkrjbGVK7hlB0XJXBRei5KGHO0GvOwhOR4sfd-s6qyVs9SghXoYGh6Ce-gr83irT-_RO3LUhpWf3bw3GeTm2M5K-7kr_Regv3Lw73Xkf2M3lEvJy4iaB-1qmJuD9Bbs6gmZdFFmyf94ei6i95ccALtFf3mWj6GdtT72fXi_wRXDPnx
linkProvider	Springer Nature
linkToHtml	http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMw1V1Lb9QwELZKQYIL5VVRKOADPYFF_GgcHxCqKFWrXVZIFNSbsR0HVlqyJcm26p_iNzJ24l3BYW89cI4fiv15ZuyZ-Qahl0bajHtbkn1V5USAwiVGSUeUyZUS1AphI7v-WE4mxdmZ-rSBfqdcmBBWmWRiFNTl3IU38jeguANzyH4h353_IqFqVPCuphIaPSxG_uoSrmzt25ND2N89xo4-nL4_JkNVAeIArx0xIuOcuRLuQUI5p8Cm98zlFbU04JExH0rcFVlRZsIE_jjrbF56ECgq48ZVHMa9gW4KXsjA1T-SZOm1kHnk9gMThBMmpRqSdIZUveiGgKtfzO8k9G9FuLJulw7Zf8hLo8I72vrfluoeujuY1vigPwv30YavH6CtVLYCD1LsIXKfQfVcmsZjMLM73Ph2Meta7GM0YgQqNnWJL6ZtSDjt01RxeK_GIa5_Wi_mixYnmo3UOhKyzK7ikLCuj9CXa_nVbbRZz2v_GGE4FVRyZvOqsMKDwAuU-sJbbirjKaM7iKaN124gYg_1QGZ6RSEdwKIBLDqCRUOfV8s-5z0NydrWuwkYehBJrV6hYge9ThhbfV432l6Pw-XMgZL8cPr1QM-b7_pn-UODzS_pk_WzvkC3j08_jvX4ZDJ6iu6weBRCBNQu2uyahX-GbrmLbto2z-OhwujbdUPzD_cAWOk
linkToPdf	http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMw1V1Lb9QwELZKQaiXlqcoLeADPYHV2PHG8QGhimVFtdWqEg_1ZmzHgZW22ZJkW_Wv9dd17MS7gsPeeuAcP5Tkm4c9M98g9FYLk6TOFGQgy4xwMLhES2GJ1JmUnBrOTWDXPxGTSX52Jk830E2shfFplVEnBkVdzK2_Iz8Ew-2ZQwa5OCz7tIjT4ejjxR_iO0j5SGtsp9FBZOyur-D41nw4HsK_PmBs9Pnbpy-k7zBALGC3JZonacpsAWciLq2V4N87ZrOSGuqxyZjz7e7yJC8Srj2XnLEmKxwoF5mk2pYprHsP3QcrPPAyNhZkGcEQWeD5A3ckJUwI2Rfs9GV7ISQBx8BQ60no30Zx5ekug7P_EJkG4zfa-Z8_2yO03bvc-KiTkcdow1VP0E5sZ4F77fYU2a9gkq507TC43y2uXbOYtQ12IUsxABjrqsCX08YXonblq9jfY2Of7z-tFvNFgyP9RhwdiFpm12FJ-MbP0Pc7edXnaLOaV-4FwiAtVKTMZGVuuANF6Kn2uTOpLrWjjO4iGkGgbE_Q7vuEzNSKWtoDRwFwVACOgjnvlnMuOnqStaP3I0hUr6oatULILnof8bZ6vG61gw6Ty509Vflw-uNIzetf6rz4reAsIOjL9bu-QQ8BkerkeDLeQ1ssSIVPjNpHm229cK_QA3vZTpv6dZAvjH7eNTJvAfRFYaM
openUrl	ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Software+test+results+exploration+and+visualization+with+continuous+integration+and+nightly+testing&rft.jtitle=International+journal+on+software+tools+for+technology+transfer&rft.au=Strandberg%2C+Per+Erik&rft.au=Afzal%2C+Wasif&rft.au=Sundmark%2C+Daniel&rft.date=2022-04-01&rft.issn=1433-2779&rft.volume=24&rft.issue=2&rft.spage=261&rft_id=info:doi/10.1007%2Fs10009-022-00647-1&rft.externalDocID=oai_DiVA_org_mdh_57571
thumbnail_l	http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1433-2779&client=summon
thumbnail_m	http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1433-2779&client=summon
thumbnail_s	http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1433-2779&client=summon