Automated test generation using model checking: an industrial evaluation

In software development, testers often focus on functional testing to validate implemented programs against their specifications. In safety-critical software development, testers are also required to show that tests exercise, or cover, the structure and logic of the implementation. To achieve differ...

Celý popis

Uložené v:

Podrobná bibliografia
Vydané v:	International journal on software tools for technology transfer Ročník 18; číslo 3; s. 335 - 353
Hlavní autori:	Enoiu, Eduard P., Čaušević, Adnan, Ostrand, Thomas J., Weyuker, Elaine J., Sundmark, Daniel, Pettersson, Paul
Médium:	Journal Article
Jazyk:	English
Vydavateľské údaje:	Berlin/Heidelberg Springer Berlin Heidelberg 01.06.2016 Springer Nature B.V
Predmet:	automated software testing Automation Computer programs Computer Science Decisions function block diagram Ictss 2013 industrial study Logic model checking safety-critical software Software Software development Software Engineering Software Engineering/Programming and Operating Systems test generation Test methods Theory of Computation Software testing Model-based testing PLC Automated test generation Programmable Logic Controllers Model checking FBD Logic coverage safety-critical systems Structured Text Function Block Diagram IEC 1131-3
ISSN:	1433-2779, 1433-2787, 1433-2787
On-line prístup:	Získať plný text
Tagy:	Pridať tag Žiadne tagy, Buďte prvý, kto otaguje tento záznam!

Abstract	In software development, testers often focus on functional testing to validate implemented programs against their specifications. In safety-critical software development, testers are also required to show that tests exercise, or cover, the structure and logic of the implementation. To achieve different types of logic coverage, various program artifacts such as decisions and conditions are required to be exercised during testing. Use of model checking for structural test generation has been proposed by several researchers. The limited application to models used in practice and the state space explosion can, however, impact model checking and hence the process of deriving tests for logic coverage. Thus, there is a need to validate these approaches against relevant industrial systems such that more knowledge is built on how to efficiently use them in practice. In this paper, we present a tool-supported approach to handle software written in the Function Block Diagram language such that logic coverage criteria can be formalized and used by a model checker to automatically generate tests. To this end, we conducted a study based on industrial use-case scenarios from Bombardier Transportation AB, showing how our toolbox CompleteTest can be applied to generate tests in software systems used in the safety-critical domain. To evaluate the approach, we applied the toolbox to 157 programs and found that it is efficient in terms of time required to generate tests that satisfy logic coverage and scales well for most of the programs.
AbstractList	In software development, testers often focus on functional testing to validate implemented programs against their specifications. In safety-critical software development, testers are also required to show that tests exercise, or cover, the structure and logic of the implementation. To achieve different types of logic coverage, various program artifacts such as decisions and conditions are required to be exercised during testing. Use of model checking for structural test generation has been proposed by several researchers. The limited application to models used in practice and the state space explosion can, however, impact model checking and hence the process of deriving tests for logic coverage. Thus, there is a need to validate these approaches against relevant industrial systems such that more knowledge is built on how to efficiently use them in practice. In this paper, we present a tool-supported approach to handle software written in the Function Block Diagram language such that logic coverage criteria can be formalized and used by a model checker to automatically generate tests. To this end, we conducted a study based on industrial use-case scenarios from Bombardier Transportation AB, showing how our toolbox CompleteTest can be applied to generate tests in software systems used in the safety-critical domain. To evaluate the approach, we applied the toolbox to 157 programs and found that it is efficient in terms of time required to generate tests that satisfy logic coverage and scales well for most of the programs. In software development, testers often focus on functional testing to validate implemented programs against their specifications. In safety-critical software development, testers are also required to show that tests exercise, or cover, the structure and logic of the implementation. To achieve different types of logic coverage, various program artifacts such as decisions and conditions are required to be exercised during testing. Use of model checking for structural test generation has been proposed by several researchers. The limited application to models used in practice and the state space explosion can, however, impact model checking and hence the process of deriving tests for logic coverage. Thus, there is a need to validate these approaches against relevant industrial systems such that more knowledge is built on how to efficiently use them in practice. In this paper, we present a tool-supported approach to handle software written in the Function Block Diagram language such that logic coverage criteria can be formalized and used by a model checker to automatically generate tests. To this end, we conducted a study based on industrial use-case scenarios from Bombardier Transportation AB, showing how our toolbox CompleteTest can be applied to generate tests in software systems used in the safety-critical domain. To evaluate the approach, we applied the toolbox to 157 programs and found that it is efficient in terms of time required to generate tests that satisfy logic coverage and scales well for most of the programs. Issue Title: ICTSS 2013 In software development, testers often focus on functional testing to validate implemented programs against their specifications. In safety-critical software development, testers are also required to show that tests exercise, or cover, the structure and logic of the implementation. To achieve different types of logic coverage, various program artifacts such as decisions and conditions are required to be exercised during testing. Use of model checking for structural test generation has been proposed by several researchers. The limited application to models used in practice and the state space explosion can, however, impact model checking and hence the process of deriving tests for logic coverage. Thus, there is a need to validate these approaches against relevant industrial systems such that more knowledge is built on how to efficiently use them in practice. In this paper, we present a tool-supported approach to handle software written in the Function Block Diagram language such that logic coverage criteria can be formalized and used by a model checker to automatically generate tests. To this end, we conducted a study based on industrial use-case scenarios from Bombardier Transportation AB, showing how our toolbox CompleteTest can be applied to generate tests in software systems used in the safety-critical domain. To evaluate the approach, we applied the toolbox to 157 programs and found that it is efficient in terms of time required to generate tests that satisfy logic coverage and scales well for most of the programs.
Author	Ostrand, Thomas J. Pettersson, Paul Weyuker, Elaine J. Enoiu, Eduard P. Čaušević, Adnan Sundmark, Daniel
Author_xml	– sequence: 1 givenname: Eduard P. surname: Enoiu fullname: Enoiu, Eduard P. email: eduard.paul.enoiu@mdh.se organization: Mälardalen University – sequence: 2 givenname: Adnan surname: Čaušević fullname: Čaušević, Adnan organization: Mälardalen University – sequence: 3 givenname: Thomas J. surname: Ostrand fullname: Ostrand, Thomas J. organization: Software Engineering Research Consultant – sequence: 4 givenname: Elaine J. surname: Weyuker fullname: Weyuker, Elaine J. organization: Mälardalen University – sequence: 5 givenname: Daniel surname: Sundmark fullname: Sundmark, Daniel organization: Mälardalen University, Swedish Institute of Computer Science – sequence: 6 givenname: Paul surname: Pettersson fullname: Pettersson, Paul organization: Mälardalen University
BackLink	https://urn.kb.se/resolve?urn=urn:nbn:se:mdh:diva-28100$$DView record from Swedish Publication Index (Mälardalens högskola)
BookMark	eNp9kVtPwyAcxYmZiZv6AXxr4osPVqGFUnxb5jVZ4ov6SiilG7OFCVTjt5ddNGaJvnDL75Bz_mcEBsYaBcAJghcIQnrp4wpZChFOYU5IyvbAEOE8TzNa0sHPmbIDMPJ-ASGiBWVDcD_ug-1EUHUSlA_JTBnlRNDWJL3XZpZ0tlZtIudKvsbrVSJMok3d--C0aBP1Ltp-jR-B_Ua0Xh1v90PwfHvzNLlPp493D5PxNJU4YyFtZEUwFJiQvGqq6KKEUpSI4UJipjLJCkIzmpOsKgpcY9TUMi9kQ-tcxidS5YfgfPOv_1DLvuJLpzvhPrkVml_rlzG3bsa7es6zMo4k4mcbfOnsWx8T8k57qdpWGGV7z1EJS4RISVFET3fQhe2diWF4tIlhVmLEIkU3lHTWe6caLnVYTyA4oVuOIF8VwjeF8FgIXxXCV0q0o_z2_p8m26aNrJkp98vTn6IvKS2enw
CitedBy_id	crossref_primary_10_1016_j_jss_2020_110813 crossref_primary_10_1007_s10270_020_00850_1 crossref_primary_10_1016_j_infsof_2018_12_001 crossref_primary_10_1016_j_jmsy_2023_07_015 crossref_primary_10_1007_s10270_021_00924_8 crossref_primary_10_1145_3728951 crossref_primary_10_1007_s10515_025_00489_6 crossref_primary_10_1007_s13042_020_01149_9 crossref_primary_10_1016_j_jss_2019_110455 crossref_primary_10_1007_s10009_015_0404_z crossref_primary_10_1007_s42979_025_03843_3 crossref_primary_10_1007_s10515_024_00417_0 crossref_primary_10_1016_j_jss_2024_112228 crossref_primary_10_1016_j_scico_2025_103265 crossref_primary_10_1007_s11219_017_9386_2 crossref_primary_10_1049_iet_sen_2019_0036 crossref_primary_10_1515_auto_2023_0162
Cites_doi	10.1017/CBO9780511809163 10.1007/3-540-46002-0_23 10.1007/s100090050010 10.1007/978-3-642-41707-8_1 10.1016/j.infsof.2009.01.003 10.1007/BFb0032042 10.1109/SEW.2003.1270730 10.1007/3-540-48683-6_3 10.1006/inco.1993.1024 10.1007/3-540-48166-4_10 10.1007/978-3-540-78917-8_3 10.1007/978-3-642-15651-9_17 10.7146/brics.v8i4.20458 10.1007/3-540-36577-X_40 10.1109/ECBS.2001.922409 10.1109/DASC.2000.886880 10.1016/S0304-3975(00)00089-X 10.1109/ISSRE.2005.26 10.1007/978-3-540-24617-6_9 10.1109/ICSTW.2013.27 10.1049/sej.1994.0025 10.1002/stvr.402 10.1109/ICSE.2013.6606556 10.1016/S0967-0661(98)00054-9 10.1109/ISIE.2002.1026065
ContentType	Journal Article
Copyright	Springer-Verlag Berlin Heidelberg 2014 Springer-Verlag Berlin Heidelberg 2016
Copyright_xml	– notice: Springer-Verlag Berlin Heidelberg 2014 – notice: Springer-Verlag Berlin Heidelberg 2016
DBID	AAYXX CITATION 3V. 7SC 7XB 8AL 8AO 8FD 8FE 8FG 8FK 8G5 ABJCF ABUWG AFKRA ARAPS AZQEC BENPR BGLVJ CCPQU DWQXO GNUQQ GUQSH HCIFZ JQ2 K7- L6V L7M L~C L~D M0N M2O M7S MBDVC P5Z P62 PADUT PHGZM PHGZT PKEHL PQEST PQGLB PQQKQ PQUKI PRINS PTHSS Q9U ABGEM ADTPV AOWAS D8T DF7 ZZAVC
DOI	10.1007/s10009-014-0355-9
DatabaseName	CrossRef ProQuest Central (Corporate) Computer and Information Systems Abstracts ProQuest Central (purchase pre-March 2016) Computing Database (Alumni Edition) ProQuest Pharma Collection Technology Research Database ProQuest SciTech Collection ProQuest Technology Collection ProQuest Central (Alumni) (purchase pre-March 2016) Research Library (Alumni Edition) Materials Science & Engineering Collection ProQuest Central (Alumni Edition) ProQuest Central UK/Ireland Advanced Technologies & Computer Science Collection ProQuest Central Essentials ProQuest Central Technology Collection ProQuest One Community College ProQuest Central Korea ProQuest Central Student Research Library Prep SciTech Premium Collection ProQuest Computer Science Collection Computer Science Database ProQuest Engineering Collection Advanced Technologies Database with Aerospace Computer and Information Systems Abstracts Academic Computer and Information Systems Abstracts Professional Computing Database Research Library Engineering Database Research Library (Corporate) Advanced Technologies & Aerospace Database ProQuest Advanced Technologies & Aerospace Collection Research Library China ProQuest Central Premium ProQuest One Academic (New) ProQuest One Academic Middle East (New) ProQuest One Academic Eastern Edition (DO NOT USE) ProQuest One Applied & Life Sciences ProQuest One Academic (retired) ProQuest One Academic UKI Edition ProQuest Central China Engineering Collection ProQuest Central Basic SWEPUB Mälardalens högskola full text SwePub SwePub Articles SWEPUB Freely available online SWEPUB Mälardalens högskola SwePub Articles full text
DatabaseTitle	CrossRef Research Library Prep Computer Science Database ProQuest Central Student Technology Collection Technology Research Database Computer and Information Systems Abstracts – Academic ProQuest One Academic Middle East (New) ProQuest Advanced Technologies & Aerospace Collection ProQuest Central Essentials ProQuest Computer Science Collection Computer and Information Systems Abstracts ProQuest Central (Alumni Edition) SciTech Premium Collection ProQuest One Community College Research Library (Alumni Edition) ProQuest Pharma Collection ProQuest Central China ProQuest Central ProQuest One Applied & Life Sciences ProQuest Engineering Collection ProQuest Central Korea ProQuest Research Library Research Library China ProQuest Central (New) Advanced Technologies Database with Aerospace Engineering Collection Advanced Technologies & Aerospace Collection ProQuest Computing Engineering Database ProQuest Central Basic ProQuest Computing (Alumni Edition) ProQuest One Academic Eastern Edition ProQuest Technology Collection ProQuest SciTech Collection Computer and Information Systems Abstracts Professional Advanced Technologies & Aerospace Database ProQuest One Academic UKI Edition Materials Science & Engineering Collection ProQuest One Academic ProQuest One Academic (New) ProQuest Central (Alumni)
DatabaseTitleList	Computer and Information Systems Abstracts Research Library Prep
Database_xml	– sequence: 1 dbid: BENPR name: ProQuest Central url: https://www.proquest.com/central sourceTypes: Aggregation Database
DeliveryMethod	fulltext_linktorsrc
Discipline	Computer Science
EISSN	1433-2787
EndPage	353
ExternalDocumentID	oai_DiVA_org_mdh_28100 4034496721 10_1007_s10009_014_0355_9
Genre	Feature
GroupedDBID	-59 -5G -BR -EM -Y2 -~C .4S .86 .DC .VR 06D 0R~ 0VY 1N0 1SB 203 29J 2J2 2JN 2JY 2KG 2KM 2LR 2P1 2VQ 2~H 30V 3V. 4.4 406 408 409 40D 40E 5GY 5VS 67Z 6NX 8AO 8FE 8FG 8FW 8G5 8TC 95- 95. 95~ 96X AAAVM AABHQ AACDK AAHNG AAIAL AAJBT AAJKR AANZL AARHV AARTL AASML AATNV AATVU AAUYE AAWCG AAYIU AAYQN AAYTO AAYZH ABAKF ABBBX ABBXA ABDZT ABECU ABFTD ABFTV ABHLI ABHQN ABJCF ABJNI ABJOX ABKCH ABKTR ABMNI ABMQK ABNWP ABQBU ABQSL ABSXP ABTEG ABTHY ABTKH ABTMW ABULA ABUWG ABWNU ABXPI ACAOD ACBXY ACDTI ACGFS ACHSB ACHXU ACIWK ACKNC ACMDZ ACMLO ACOKC ACOMO ACPIV ACSNA ACZOJ ADHHG ADHIR ADINQ ADKNI ADKPE ADRFC ADTPH ADURQ ADYFF ADZKW AEBTG AEFQL AEGAL AEGNC AEJHL AEJRE AEKMD AEMSY AEOHA AEPYU AESKC AETLH AEVLU AEXYK AFBBN AFGCZ AFKRA AFLOW AFQWF AFWTZ AFZKB AGAYW AGDGC AGGDS AGJBK AGMZJ AGQEE AGQMX AGRTI AGWIL AGWZB AGYKE AHAVH AHBYD AHKAY AHSBF AHYZX AIAKS AIGIU AIIXL AILAN AITGF AJBLW AJRNO AJZVZ ALMA_UNASSIGNED_HOLDINGS ALWAN AMKLP AMXSW AMYLF AMYQR AOCGG ARAPS ARCSS ARMRJ ASPBG AVWKF AXYYD AYJHY AZFZN AZQEC B-. BA0 BDATZ BENPR BGLVJ BGNMA BPHCQ BSONS CAG CCPQU COF CS3 CSCUP DDRTE DL5 DNIVK DPUIP DU5 DWQXO EBLON EBS EDO EIOEI EJD ESBYG FEDTE FERAY FFXSO FIGPU FINBP FNLPD FRRFC FSGXE FWDCC GGCAI GGRSB GJIRD GNUQQ GNWQR GQ6 GQ7 GQ8 GUQSH GXS H13 HCIFZ HF~ HG5 HG6 HMJXF HQYDN HRMNR HVGLF HZ~ I-F I09 IHE IJ- IKXTQ ITM IWAJR IXC IZIGR IZQ I~X I~Z J-C J0Z JBSCW JCJTX JZLTJ K6V K7- KDC KOV L6V LAS LLZTM M0N M2O M4Y M7S MA- MK~ ML~ N2Q NB0 NPVJJ NQJWS NU0 O9- O93 O9J OAM P62 P9O PADUT PF0 PQQKQ PROAC PT4 PT5 PTHSS Q2X QOS R89 R9I RIG RNI ROL RPX RSV RZK S16 S1Z S27 S3B SAP SCO SDH SHX SISQX SJYHP SNE SNPRN SNX SOHCF SOJ SPISZ SRMVM SSLCW STPWE SZN T13 TSG TSK TSV TUC TUS U2A UG4 UOJIU UTJUX UZXMN VC2 VFIZW W23 W48 WK8 YLTOR Z45 Z7R Z7X Z7Z Z83 Z88 ZMTXR AAPKM AAYXX ABBRH ABDBE ABFSG ABRTQ ACSTC ADHKG AEZWR AFDZB AFFHD AFHIU AFOHR AGQPQ AHPBZ AHWEU AIXLP ATHPR AYFIA CITATION PHGZM PHGZT PQGLB 7SC 7XB 8AL 8FD 8FK JQ2 L7M L~C L~D MBDVC PKEHL PQEST PQUKI PRINS Q9U ABGEM ADTPV AOWAS D8T DF7 ZZAVC
ID	FETCH-LOGICAL-c429t-fcb540a4553bfb01780ca81946c49e2c965727352b664d41fdc36cf7d3c2b65b3
IEDL.DBID	K7-
ISICitedReferencesCount	31
ISICitedReferencesURI	http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000374974200007&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
ISSN	1433-2779 1433-2787
IngestDate	Thu Oct 30 11:27:41 EDT 2025 Sun Nov 09 14:30:27 EST 2025 Wed Nov 05 00:43:28 EST 2025 Sat Nov 29 07:58:05 EST 2025 Tue Nov 18 22:21:35 EST 2025 Fri Feb 21 02:33:59 EST 2025
IsDoiOpenAccess	true
IsOpenAccess	true
IsPeerReviewed	true
IsScholarly	true
Issue	3
Keywords	Software testing Model-based testing PLC Automated test generation Programmable Logic Controllers Model checking FBD Logic coverage safety-critical systems Structured Text Function Block Diagram IEC 1131-3
Language	English
LinkModel	DirectLink
MergedId	FETCHMERGED-LOGICAL-c429t-fcb540a4553bfb01780ca81946c49e2c965727352b664d41fdc36cf7d3c2b65b3
Notes	SourceType-Scholarly Journals-1 ObjectType-Feature-1 content type line 14 ObjectType-Article-1 ObjectType-Feature-2 content type line 23
OpenAccessLink	https://urn.kb.se/resolve?urn=urn:nbn:se:mdh:diva-28100
PQID	1784028419
PQPubID	46652
PageCount	19
ParticipantIDs	swepub_primary_oai_DiVA_org_mdh_28100 proquest_miscellaneous_1808115871 proquest_journals_1784028419 crossref_citationtrail_10_1007_s10009_014_0355_9 crossref_primary_10_1007_s10009_014_0355_9 springer_journals_10_1007_s10009_014_0355_9
PublicationCentury	2000
PublicationDate	2016-06-01
PublicationDateYYYYMMDD	2016-06-01
PublicationDate_xml	– month: 06 year: 2016 text: 2016-06-01 day: 01
PublicationDecade	2010
PublicationPlace	Berlin/Heidelberg
PublicationPlace_xml	– name: Berlin/Heidelberg – name: Heidelberg
PublicationTitle	International journal on software tools for technology transfer
PublicationTitleAbbrev	Int J Softw Tools Technol Transfer
PublicationYear	2016
Publisher	Springer Berlin Heidelberg Springer Nature B.V
Publisher_xml	– name: Springer Berlin Heidelberg – name: Springer Nature B.V
References	Alur, R.: Timed automata. In: Computer aided verification, pp. 688–688. Springer, Berlin (1999) Khurshid, S., Păsăreanu, C.S., Visser, W.: Generalized symbolic execution for model checking and testing. In: Tools and Algorithms for the Construction and Analysis of Systems, pp. 553–568. Springer, Berlin (2003) Lakehal, A., Parissis, I.: Lustructu: a tool for the automatic coverage assessment of lustre programs. In: International Symposium on Software Reliability Engineering, p. 10. IEEE Press, New York (2005) Enoiu, E.P., Sundmark, D., Pettersson, P.: Model-based test suite generation for function block diagrams using the UPPAAL model checker. In: 2013 IEEE Sixth International Conference on Software Testing, Verification and Validation Workshops (ICSTW), pp. 158–167. IEEE Press, New York (2013) LarsenKGPetterssonPYiWUPPAAL in a NutshellInt. J.Softw. Tools Technol. Transf.19971113415210.1007/s1000900500101060.68577 CENELEC. 50128: Railway application-communications, signaling and processing systems-software for railway control and protection systems. Standard Report (2001) AmmannPOffuttJIntroduction to Software Testing2008CambridgeCambridge University Press10.1017/CBO97805118091631154.68042 ChilenskiJJMillerSPApplicability of modified condition/decision coverage to software testingSoftw. Eng. J.19949519320010.1049/sej.1994.0025 Alur, R., Dill, D.: Automata for modeling real-time systems. Autom. Lang. Progr. pp. 322–335 (1990) JeeEYooJChaSBaeDA data flow-based structural testing technique for FBD programsInf. Softw. Technol.20095171131113910.1016/j.infsof.2009.01.003 Rayadurgam, S., Heimdahl, M.P.E.: Coverage based test-case generation using model checkers. In: ECBS 2001. Proceedings of Eighth Annual IEEE International Conference and Workshop on the Engineering of Computer Based Systems, pp. 83–91. IEEE Press, New York (2001) Rayadurgam, S., Heimdahl, M.P.E.: Generating MC/DC adequate test sequences through model checking. In: NASA Goddard Software Engineering Workshop Proceedings, pp. 91–96. IEEE Press, New York (2003) DierksHPlc-automata: a new class of implementable real-time automataTheor. Comput. Sci.200125316193180619910.1016/S0304-3975(00)00089-X0954.68085 Gargantini, A., Heitmeyer, C.: Using model checking to generate tests from requirements specifications. In: Software Engineering, ESEC/FSE99, pp. 146–162. Springer, Berlin (1999) Behrmann, G., Fehnker, A., Hune, T., Larsen, K.G, Petterson, P., Romijn, J.: Guiding and cost-optimality in uppaal. In: AAAI-Spring Symposium on Model-based Validation of Intelligence, pp. 66–74 (2001) Black, P.: Modeling and marshaling: making tests from model checker counter-examples. In: Proceedings of the 19th digital avionics systems conference, vol. 1, pp. 1B3-1. IEEE Press, New York (2000) Seppi, K., Jones, M., Lamborn, P.: Guided model checking with a bayesian meta-heuristic. Fundam. Inf. 70(1), 111–126 (2006) Thieme, J., Hanisch, H.M.: Model-based generation of modular PLC code using IEC61131 function blocks. In: Proceedings of the International Symposium on Industrial Electronics, vol. 1, pp. 199–204. IEEE Press, New York (2002) AlurRCourcoubetisCDillDModel-checking in dense real-timeInf. Comput.19931041234122137010.1006/inco.1993.10240783.68076 Öhman, M., Johansson, S., Årzén, K.E.: Implementation aspects of the PLC standard IEC 1131–3. In: Journal on Control Engineering Practice, vol. 6, pp. 547–555. Elsevier, New York (1998) Jee, E., Kim, S., Cha, S., Lee, I.: Automated test coverage measurement for reactor protection system software implemented in function block diagram. In: Journal on Computer Safety, Reliability, and Security, pp. 223–236. Springer, Berlin (2010) Whalen, M., Gay, G., You, D., Heimdahl, M.P.E., Staats, M.: Observable modified condition/decision coverage. In: Proceedings of the International Conference on Software Engineering, pp. 102–111. IEEE Press, New York (2013) Enoiu, E.P., Sundmark, D., Pettersson, P.: Using logic coverage to improve testing function block diagrams. In: Testing Software and Systems, pp. 1–16. Springer, Berlin (2013) Ammann, P., Black, P.E., Ding, W.: Model checkers in software testing. In: NIST-IR 6777, National Institute of Standards and Technology Report (2002) Hong, H.S., Lee, I., Sokolsky, O., Ural, H.: A temporal logic-based theory of test coverage and generation. In: Tools and Algorithms for the Construction and Analysis of Systems, pp. 327–341. Springer, Berlin (2002) Hessel, A., Larsen, K., Mikucionis, M., Nielsen, B., Pettersson, P., Skou, A.: Testing real-time systems using UPPAAL. Form. Methods Test. pp. 77–117 (2008) Fraser, G., Wotawa, F., Ammann, P.E.: Testing with model checkers: a survey. In: Journal on Software Testing, Verification and Reliability, vol. 19, pp. 215–261. Wiley Online Library, New York (2009) Hessel, A., Larsen, K., Nielsen, B., Pettersson, P., Skou, A.: Time-optimal real-time test case generation using UPPAAL. In: Lecture notes in computer science. Formal approaches to software testing, pp. 114–130. Springer, Berlin (2004) H Dierks (355_CR10) 2001; 253 355_CR20 355_CR21 355_CR24 355_CR23 355_CR26 355_CR25 355_CR17 355_CR16 355_CR1 355_CR18 P Ammann (355_CR5) 2008 355_CR8 355_CR7 355_CR4 355_CR3 355_CR6 355_CR11 355_CR13 355_CR12 355_CR15 355_CR14 355_CR28 355_CR27 E Jee (355_CR19) 2009; 51 KG Larsen (355_CR22) 1997; 1 JJ Chilenski (355_CR9) 1994; 9 R Alur (355_CR2) 1993; 104
References_xml	– reference: AlurRCourcoubetisCDillDModel-checking in dense real-timeInf. Comput.19931041234122137010.1006/inco.1993.10240783.68076 – reference: Enoiu, E.P., Sundmark, D., Pettersson, P.: Using logic coverage to improve testing function block diagrams. In: Testing Software and Systems, pp. 1–16. Springer, Berlin (2013) – reference: Alur, R.: Timed automata. In: Computer aided verification, pp. 688–688. Springer, Berlin (1999) – reference: ChilenskiJJMillerSPApplicability of modified condition/decision coverage to software testingSoftw. Eng. J.19949519320010.1049/sej.1994.0025 – reference: Ammann, P., Black, P.E., Ding, W.: Model checkers in software testing. In: NIST-IR 6777, National Institute of Standards and Technology Report (2002) – reference: DierksHPlc-automata: a new class of implementable real-time automataTheor. Comput. Sci.200125316193180619910.1016/S0304-3975(00)00089-X0954.68085 – reference: Alur, R., Dill, D.: Automata for modeling real-time systems. Autom. Lang. Progr. pp. 322–335 (1990) – reference: AmmannPOffuttJIntroduction to Software Testing2008CambridgeCambridge University Press10.1017/CBO97805118091631154.68042 – reference: Seppi, K., Jones, M., Lamborn, P.: Guided model checking with a bayesian meta-heuristic. Fundam. Inf. 70(1), 111–126 (2006) – reference: Hessel, A., Larsen, K., Mikucionis, M., Nielsen, B., Pettersson, P., Skou, A.: Testing real-time systems using UPPAAL. Form. Methods Test. pp. 77–117 (2008) – reference: Khurshid, S., Păsăreanu, C.S., Visser, W.: Generalized symbolic execution for model checking and testing. In: Tools and Algorithms for the Construction and Analysis of Systems, pp. 553–568. Springer, Berlin (2003) – reference: Whalen, M., Gay, G., You, D., Heimdahl, M.P.E., Staats, M.: Observable modified condition/decision coverage. In: Proceedings of the International Conference on Software Engineering, pp. 102–111. IEEE Press, New York (2013) – reference: Enoiu, E.P., Sundmark, D., Pettersson, P.: Model-based test suite generation for function block diagrams using the UPPAAL model checker. In: 2013 IEEE Sixth International Conference on Software Testing, Verification and Validation Workshops (ICSTW), pp. 158–167. IEEE Press, New York (2013) – reference: Behrmann, G., Fehnker, A., Hune, T., Larsen, K.G, Petterson, P., Romijn, J.: Guiding and cost-optimality in uppaal. In: AAAI-Spring Symposium on Model-based Validation of Intelligence, pp. 66–74 (2001) – reference: Fraser, G., Wotawa, F., Ammann, P.E.: Testing with model checkers: a survey. In: Journal on Software Testing, Verification and Reliability, vol. 19, pp. 215–261. Wiley Online Library, New York (2009) – reference: Black, P.: Modeling and marshaling: making tests from model checker counter-examples. In: Proceedings of the 19th digital avionics systems conference, vol. 1, pp. 1B3-1. IEEE Press, New York (2000) – reference: Hong, H.S., Lee, I., Sokolsky, O., Ural, H.: A temporal logic-based theory of test coverage and generation. In: Tools and Algorithms for the Construction and Analysis of Systems, pp. 327–341. Springer, Berlin (2002) – reference: Rayadurgam, S., Heimdahl, M.P.E.: Generating MC/DC adequate test sequences through model checking. In: NASA Goddard Software Engineering Workshop Proceedings, pp. 91–96. IEEE Press, New York (2003) – reference: Öhman, M., Johansson, S., Årzén, K.E.: Implementation aspects of the PLC standard IEC 1131–3. In: Journal on Control Engineering Practice, vol. 6, pp. 547–555. Elsevier, New York (1998) – reference: Gargantini, A., Heitmeyer, C.: Using model checking to generate tests from requirements specifications. In: Software Engineering, ESEC/FSE99, pp. 146–162. Springer, Berlin (1999) – reference: JeeEYooJChaSBaeDA data flow-based structural testing technique for FBD programsInf. Softw. Technol.20095171131113910.1016/j.infsof.2009.01.003 – reference: CENELEC. 50128: Railway application-communications, signaling and processing systems-software for railway control and protection systems. Standard Report (2001) – reference: Hessel, A., Larsen, K., Nielsen, B., Pettersson, P., Skou, A.: Time-optimal real-time test case generation using UPPAAL. In: Lecture notes in computer science. Formal approaches to software testing, pp. 114–130. Springer, Berlin (2004) – reference: Thieme, J., Hanisch, H.M.: Model-based generation of modular PLC code using IEC61131 function blocks. In: Proceedings of the International Symposium on Industrial Electronics, vol. 1, pp. 199–204. IEEE Press, New York (2002) – reference: Rayadurgam, S., Heimdahl, M.P.E.: Coverage based test-case generation using model checkers. In: ECBS 2001. Proceedings of Eighth Annual IEEE International Conference and Workshop on the Engineering of Computer Based Systems, pp. 83–91. IEEE Press, New York (2001) – reference: LarsenKGPetterssonPYiWUPPAAL in a NutshellInt. J.Softw. Tools Technol. Transf.19971113415210.1007/s1000900500101060.68577 – reference: Jee, E., Kim, S., Cha, S., Lee, I.: Automated test coverage measurement for reactor protection system software implemented in function block diagram. In: Journal on Computer Safety, Reliability, and Security, pp. 223–236. Springer, Berlin (2010) – reference: Lakehal, A., Parissis, I.: Lustructu: a tool for the automatic coverage assessment of lustre programs. In: International Symposium on Software Reliability Engineering, p. 10. IEEE Press, New York (2005) – volume-title: Introduction to Software Testing year: 2008 ident: 355_CR5 doi: 10.1017/CBO9780511809163 – ident: 355_CR17 doi: 10.1007/3-540-46002-0_23 – volume: 1 start-page: 134 issue: 1 year: 1997 ident: 355_CR22 publication-title: Int. J.Softw. Tools Technol. Transf. doi: 10.1007/s100090050010 – ident: 355_CR12 doi: 10.1007/978-3-642-41707-8_1 – volume: 51 start-page: 1131 issue: 7 year: 2009 ident: 355_CR19 publication-title: Inf. Softw. Technol. doi: 10.1016/j.infsof.2009.01.003 – ident: 355_CR3 doi: 10.1007/BFb0032042 – ident: 355_CR24 doi: 10.1109/SEW.2003.1270730 – ident: 355_CR1 doi: 10.1007/3-540-48683-6_3 – volume: 104 start-page: 2 issue: 1 year: 1993 ident: 355_CR2 publication-title: Inf. Comput. doi: 10.1006/inco.1993.1024 – ident: 355_CR14 doi: 10.1007/3-540-48166-4_10 – ident: 355_CR15 doi: 10.1007/978-3-540-78917-8_3 – ident: 355_CR18 doi: 10.1007/978-3-642-15651-9_17 – ident: 355_CR6 doi: 10.7146/brics.v8i4.20458 – ident: 355_CR20 doi: 10.1007/3-540-36577-X_40 – ident: 355_CR25 doi: 10.1109/ECBS.2001.922409 – ident: 355_CR7 doi: 10.1109/DASC.2000.886880 – volume: 253 start-page: 61 issue: 1 year: 2001 ident: 355_CR10 publication-title: Theor. Comput. Sci. doi: 10.1016/S0304-3975(00)00089-X – ident: 355_CR21 doi: 10.1109/ISSRE.2005.26 – ident: 355_CR16 doi: 10.1007/978-3-540-24617-6_9 – ident: 355_CR8 – ident: 355_CR4 – ident: 355_CR11 doi: 10.1109/ICSTW.2013.27 – volume: 9 start-page: 193 issue: 5 year: 1994 ident: 355_CR9 publication-title: Softw. Eng. J. doi: 10.1049/sej.1994.0025 – ident: 355_CR13 doi: 10.1002/stvr.402 – ident: 355_CR28 doi: 10.1109/ICSE.2013.6606556 – ident: 355_CR23 doi: 10.1016/S0967-0661(98)00054-9 – ident: 355_CR26 – ident: 355_CR27 doi: 10.1109/ISIE.2002.1026065
SSID	ssj0017679
Score	2.2909276
Snippet	In software development, testers often focus on functional testing to validate implemented programs against their specifications. In safety-critical software... Issue Title: ICTSS 2013 In software development, testers often focus on functional testing to validate implemented programs against their specifications. In... In software development, testers often focus on functional testing to validate implemented programs against their specifications. In safety critical software...
SourceID	swepub proquest crossref springer
SourceType	Open Access Repository Aggregation Database Enrichment Source Index Database Publisher
StartPage	335
SubjectTerms	automated software testing Automation Computer programs Computer Science Decisions function block diagram Ictss 2013 industrial study Logic model checking safety-critical software Software Software development Software Engineering Software Engineering/Programming and Operating Systems test generation Test methods Theory of Computation
SummonAdditionalLinks	– databaseName: Springer LINK dbid: RSV link: http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnV3JTsMwELWgcOBCWUWhICPBBWQpi-043CoW9VQhloqbFTt2qQQpalO-n3GapAUBElzjJc6MJ_Pssd8gdMKppYbRhHg2ZYQmkSVKBIZwo2nqCWVFrItkE1GvJ56e4tvyHvekOu1ehSSLP_XCZbdiI9-nxAMnSeJltALeTjhrvLvv16GDiBcEe4ADQhJEUVyFMr_r4rMzmiPMOij6hUC0cDo3zX8NdwOtlxgTd2aTYhMtmWwLNav8Dbg0523U7UzzESBWk2IAnDkeFBTUTlPYHYcf4CJNDga1arehfoGTDA_rVB94ThS-gx5vrh8uu6TMrEA0-J-cWK0AqSWUsVBZBTITnk4AG1CuaWwCHXPmcA0LFOc0pb5Ndci1jdJQwyOmwl3UyEaZ2UM4DBLfCqYTHkYU0JPyVOwxEQFQ4ykzQQt5lYilLmnHXfaLFzknTHaSkiAp6SQl4xY6q5u8zTg3fqvcrvQmS_ObSPggWBcL6kPxcV0MhuOiIUlmRlOo43KO-DBSv4XOKxUudPHzC09nU6Iem2Povhr2O3I0HsjX9FkGAhrt_6nXA7QGUIzPDqG1USMfT80hWtXv-XAyPipm-Acuo_RP priority: 102 providerName: Springer Nature
Title	Automated test generation using model checking: an industrial evaluation
URI	https://link.springer.com/article/10.1007/s10009-014-0355-9 https://www.proquest.com/docview/1784028419 https://www.proquest.com/docview/1808115871 https://urn.kb.se/resolve?urn=urn:nbn:se:mdh:diva-28100
Volume	18
WOSCitedRecordID	wos000374974200007&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
hasFullText	1
inHoldings	1
isFullTextHit
isPrint
journalDatabaseRights	– providerCode: PRVPQU databaseName: Advanced Technologies & Aerospace Database customDbUrl: eissn: 1433-2787 dateEnd: 20171231 omitProxy: false ssIdentifier: ssj0017679 issn: 1433-2779 databaseCode: P5Z dateStart: 20021001 isFulltext: true titleUrlDefault: https://search.proquest.com/hightechjournals providerName: ProQuest – providerCode: PRVPQU databaseName: Computer Science Database customDbUrl: eissn: 1433-2787 dateEnd: 20171231 omitProxy: false ssIdentifier: ssj0017679 issn: 1433-2779 databaseCode: K7- dateStart: 20021001 isFulltext: true titleUrlDefault: http://search.proquest.com/compscijour providerName: ProQuest – providerCode: PRVPQU databaseName: Engineering Database customDbUrl: eissn: 1433-2787 dateEnd: 20171231 omitProxy: false ssIdentifier: ssj0017679 issn: 1433-2779 databaseCode: M7S dateStart: 20021001 isFulltext: true titleUrlDefault: http://search.proquest.com providerName: ProQuest – providerCode: PRVPQU databaseName: ProQuest Central customDbUrl: eissn: 1433-2787 dateEnd: 20171231 omitProxy: false ssIdentifier: ssj0017679 issn: 1433-2779 databaseCode: BENPR dateStart: 20021001 isFulltext: true titleUrlDefault: https://www.proquest.com/central providerName: ProQuest – providerCode: PRVPQU databaseName: Research Library customDbUrl: eissn: 1433-2787 dateEnd: 20171231 omitProxy: false ssIdentifier: ssj0017679 issn: 1433-2779 databaseCode: M2O dateStart: 20021001 isFulltext: true titleUrlDefault: https://search.proquest.com/pqrl providerName: ProQuest – providerCode: PRVAVX databaseName: SpringerLINK Contemporary 1997-Present customDbUrl: eissn: 1433-2787 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0017679 issn: 1433-2779 databaseCode: RSV dateStart: 19971201 isFulltext: true titleUrlDefault: https://link.springer.com/search?facet-content-type=%22Journal%22 providerName: Springer Nature
link	http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwpV1Lb9QwELag5cCF8lQXSmUkuIAsYsePmAtaoFUlxLJqoaq4WPFrWQmSspvl9zPOawGJXrjMIbGTkWfs-eJx5kPoqeSRB8FLkkUvCC9VJLZggcjguM8KGwvtWrIJNZsVFxd63m-4rftjlcOa2C7UvnZpj_wlVfApAmsp1a8vf5DEGpWyqz2FxnW0Sxmjyc_fKzJmEZRsa-0BJMgJU0oPWc3u17k2LUA5ySDkEv1nXNqCzTE_-lct0Tb-HO_9r-a30a0eeeJp5yp30LVQ3UV7A6sD7if5PXQy3TQ14NjgMcDQBi_awtTJfjgdkl_gljwHg7Fd2mZ_hcsKL0cCELwtH34ffT4--vT2hPR8C8RBVGpIdBbwW8mFyG20MHxF5kpADFw6rgNzWoqEdgSzUnLPafQuly4qnzu4JGz-AO1UdRX2Ec5ZSWMhXClzxQFT2czqTBQK4Jv0IrAJyobRNq4vRp44Mb6ZbRnlZCADBjLJQEZP0POxy2VXieOqxgeDLUw_Kddma4gJejLehumUciRlFeoNtElMJBQ0pRP0YjD9b4_49wufdd4x6pbqdr9bnk9NvVqY7_6rYQV0eni1Yo_QTUBksjuLdoB2mtUmPEY33M9muV4dot03R7P56WHr5SA_sI9JqjOQc_EF5OnZ-S92KQRh
linkProvider	ProQuest
linkToHtml	http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMw1V1Lb9QwEB6VggQXylMsFDASvYAsEsePGAmhFaXaqmWFREG9mcR2lpXapOxmQfwpfiPjvBaQ6K0HrontOPHnmc8Zez6Ap5IX3Aue0ahwgvJMFTRPmafSW-6iNC9SbRuxCTWdpsfH-v0G_OzPwoRtlb1NbAy1q2z4R_4iVrgUQVsa69dnX2lQjQrR1V5Co4XFgf_xHZdsy1f7uzi-O4ztvT16M6GdqgC1aHtrWtgcWUrGhUjyIg_q9JHN0C9yabn2zGopgk8XLJeSOx4XzibSFsolFi-JPMF2L8FlHqx_s1XwwxC1ULLJ7YcUJKFMKd1HUdujek0YIuY0QhdP9Z9-cE1uh3jsX7lLG3-3t_W_fakbcL1j1mTcToWbsOHLW7DVq1aQzojdhsl4VVfI070jSLNrMmsSbwd8knAIYEYacSCCYLYhjPCSZCWZDwInZJ0e_Q58vJD3uQubZVX6e0ASlsVFKmwmE8WRM-ZRriORKqSn0gnPRhD1o2tsl2w9aH6cmHWa6AAIg4AwARBGj-DZUOWszTRyXuHtfuxNZ3SWZj3wI3gy3EZzEWJAWemrFZYJSisx9jQewfMear818e8H7rRoHPoW8pLvzj-NTbWYmVP3xbAUK90_v2OP4erk6N2hOdyfHjyAa8g-Zbvvbhs268XKP4Qr9ls9Xy4eNTOLwOeLBugv5YhbJg
linkToPdf	http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMw1V1Lb9QwEB6VglAvLa-KLQWMRC8gq3n4EVeq0Ipl1apotQdAFReTOPayUknKbhbEX-PXMc5rAYneeuCa2I4Tf54ZZ-zvA3gumGOWs5QGLueUpdLRLIksFdawPEgylyhTi03IySQ5P1fTDfjZnYXx2yo7m1gb6rw0_h_5YShxKYK2NFSHrt0WMR2NX11-pV5BymdaOzmNBiJn9sd3XL4tj09HONYHUTR-8-71CW0VBqhBO1xRZzKMWFLGeZy5zCvVByZFH8mEYcpGRgnu_TuPMiFYzkKXm1gYJ_PY4CWexdjuDbgpcY3pF35T_rHPYEhR8_xhOBLTSErVZVSbY3t1SiJkNEB3T9WfPnEd6Pa52b94TGvfN975n7_aHdhuI24ybKbIXdiwxT3Y6dQsSGvc7sPJcFWVGL_bnGD4XZFZTcjtcUv84YAZqUWDCILc-PTCEUkLMu-FT8iaNv0BvL-W99mFzaIs7EMgcZSGLuEmFTGCIgiyIFMBTySGrSLnNhpA0I20Ni0Ju9cCudBr-mgPDo3g0B4cWg3gRV_lsmEguarwfocD3RqjpV6DYADP-ttoRnxuKC1sucIyXoElxJ6GA3jZwe63Jv79wIMGmX3fPF_5aP5hqMvFTH_JP-sowUp7V3fsKdxGXOq3p5OzR7CFQalotuPtw2a1WNnHcMt8q-bLxZN6khH4dN34_AWsUGQJ
openUrl	ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Automated+test+generation+using+model+checking%3A+an+industrial+evaluation&rft.jtitle=International+journal+on+software+tools+for+technology+transfer&rft.au=Enoiu%2C+Eduard+P&rft.au=Causevic%2C+Adnan&rft.au=Ostrand%2C+Thomas+J&rft.au=Weyuker%2C+Elaine+J&rft.date=2016-06-01&rft.issn=1433-2779&rft.eissn=1433-2787&rft.volume=18&rft.issue=3&rft.spage=335&rft.epage=353&rft_id=info:doi/10.1007%2Fs10009-014-0355-9&rft.externalDBID=NO_FULL_TEXT
thumbnail_l	http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1433-2779&client=summon
thumbnail_m	http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1433-2779&client=summon
thumbnail_s	http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1433-2779&client=summon