Abstraction-Aware Inference of Metamorphic Relations
Metamorphic testing is a valuable technique that helps in dealing with the oracle problem. It involves testing software against specifications of its intended behavior given in terms of so called metamorphic relations, statements that express properties relating different software elements (e.g., di...
Uloženo v:
| Vydáno v: | Proceedings of the ACM on software engineering Ročník 1; číslo FSE; s. 450 - 472 |
|---|---|
| Hlavní autoři: | , , , , , , , , |
| Médium: | Journal Article |
| Jazyk: | angličtina |
| Vydáno: |
New York, NY, USA
ACM
12.07.2024
|
| Témata: | |
| ISSN: | 2994-970X, 2994-970X |
| On-line přístup: | Získat plný text |
| Tagy: |
Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
|
| Abstract | Metamorphic testing is a valuable technique that helps in dealing with the oracle problem. It involves testing software against specifications of its intended behavior given in terms of so called metamorphic relations, statements that express properties relating different software elements (e.g., different inputs, methods, etc). The effective application of metamorphic testing strongly depends on identifying suitable domain-specific metamorphic relations, a challenging task, that is typically manually performed. This paper introduces MemoRIA, a novel approach that aims at automatically identifying metamorphic relations. The technique focuses on a particular kind of metamorphic relation, which asserts equivalences between methods and method sequences. MemoRIA works by first generating an object-protocol abstraction of the software being tested, then using fuzzing to produce candidate relations from the abstraction, and finally validating the candidate relations through run-time analysis. A SAT-based analysis is used to eliminate redundant relations, resulting in a concise set of metamorphic relations for the software under test. We evaluate our technique on a benchmark consisting of 22 Java subjects taken from the literature, and compare MemoRIA with the metamorphic relation inference technique SBES. Our results show that by incorporating the object protocol abstraction information, MemoRIA is able to more effectively infer meaningful metamorphic relations, that are also more precise, compared to SBES, measured in terms of mutation analysis. Also, the SAT-based reduction allows us to significantly reduce the number of reported metamorphic relations, while in general having a small impact in the bug finding ability of the corresponding obtained relations. |
|---|---|
| AbstractList | Metamorphic testing is a valuable technique that helps in dealing with the oracle problem. It involves testing software against specifications of its intended behavior given in terms of so called metamorphic relations , statements that express properties relating different software elements (e.g., different inputs, methods, etc). The effective application of metamorphic testing strongly depends on identifying suitable domain-specific metamorphic relations, a challenging task, that is typically manually performed. This paper introduces MemoRIA, a novel approach that aims at automatically identifying metamorphic relations. The technique focuses on a particular kind of metamorphic relation, which asserts equivalences between methods and method sequences. MemoRIA works by first generating an object-protocol abstraction of the software being tested, then using fuzzing to produce candidate relations from the abstraction, and finally validating the candidate relations through run-time analysis. A SAT-based analysis is used to eliminate redundant relations, resulting in a concise set of metamorphic relations for the software under test. We evaluate our technique on a benchmark consisting of 22 Java subjects taken from the literature, and compare MemoRIA with the metamorphic relation inference technique SBES. Our results show that by incorporating the object protocol abstraction information, MemoRIA is able to more effectively infer meaningful metamorphic relations, that are also more precise, compared to SBES, measured in terms of mutation analysis. Also, the SAT-based reduction allows us to significantly reduce the number of reported metamorphic relations, while in general having a small impact in the bug finding ability of the corresponding obtained relations. |
| ArticleNumber | 21 |
| Author | Molina, Facundo Frias, Marcelo F. Papadakis, Mike Garbervetsky, Diego Gorla, Alessandra Degiovanni, Renzo Nolasco, Agustín Aguirre, Nazareno Uchitel, Sebastian |
| Author_xml | – sequence: 1 givenname: Agustín orcidid: 0009-0007-2748-2467 surname: Nolasco fullname: Nolasco, Agustín email: nolasco@dc.exa.unrc.edu.ar organization: University of Rio Cuarto, Rio Cuarto, Argentina – sequence: 2 givenname: Facundo orcidid: 0000-0002-2441-1555 surname: Molina fullname: Molina, Facundo email: facundo.molina@imdea.org organization: IMDEA Software Institute, Madrid, Spain – sequence: 3 givenname: Renzo orcidid: 0000-0003-1611-3969 surname: Degiovanni fullname: Degiovanni, Renzo email: renzo.degiovanni@uni.lu organization: Luxembourg Institute of Science and Technology, Luxembourg, Luxembourg – sequence: 4 givenname: Alessandra orcidid: 0000-0002-6711-3080 surname: Gorla fullname: Gorla, Alessandra email: alessandra.gorla@imdea.org organization: IMDEA Software Institute, Madrid, Spain – sequence: 5 givenname: Diego orcidid: 0000-0003-4180-7196 surname: Garbervetsky fullname: Garbervetsky, Diego email: diegog@dc.uba.ar organization: University of Buenos Aires and ICC/CONICET, Buenos Aires, Argentina – sequence: 6 givenname: Mike orcidid: 0000-0003-1852-2547 surname: Papadakis fullname: Papadakis, Mike email: michail.papadakis@uni.lu organization: University of Luxembourg, Luxembourg, Luxembourg – sequence: 7 givenname: Sebastian orcidid: 0000-0001-9352-1478 surname: Uchitel fullname: Uchitel, Sebastian email: sebastian.uchitel@gmail.com organization: Imperial College, London, United Kingdom / University of Buenos Aires and ICC/CONICET, Buenos Aires, Argentina – sequence: 8 givenname: Nazareno orcidid: 0000-0003-0532-5296 surname: Aguirre fullname: Aguirre, Nazareno email: naguirre@dc.exa.unrc.edu.ar organization: University of Rio Cuarto, Rio Cuarto, Argentina / CONICET, Buenos Aires, Argentina – sequence: 9 givenname: Marcelo F. orcidid: 0000-0002-5592-1355 surname: Frias fullname: Frias, Marcelo F. email: mfrias@itba.edu.ar organization: The University of Texas at El Paso, El Paso, USA |
| BookMark | eNptj81LAzEQxYNUsNbi3dPePEVnNmmzOZaitVARRMHbMpud4Mp-lGRB_O_d2ioint7jzY_hvVMxaruWhThHuELUs2s118pocyTGqbVaWgMvo1_-RExjfAOAIUE0MBZ6UcQ-kOurrpWLdwqcrFvPgVvHSeeTe-6p6cL2tXLJI9e04-KZOPZUR54edCKeb2-elndy87BaLxcbSZimRmKhFGXGplhmMPOWsFRsyKOzZaqdz5gLsIVjOxgsnGMNYJWbE3BZIqmJkPu_LnQxBva5q_qvCkPlqs4R8t3q_LB64C__8NtQNRQ-_iEv9iS55gf6Pn4C0o5gxw |
| CitedBy_id | crossref_primary_10_1145_3708521 |
| Cites_doi | 10.1016/j.scico.2007.01.015 10.1145/2931037.2931049 10.1145/2025113.2025179 10.1145/3510003.3510082 10.1109/ICSE43902.2021.00112 10.1145/3213846.3213872 10.1145/2491509.2491519 10.1109/TSE.2016.2532875 10.1109/TSE.2013.46 10.1145/2568225.2568287 10.1016/j.jss.2015.07.037 10.1145/3368089.3409758 10.1145/3143561 10.1109/TSE.2014.2312918 10.1109/MS.2018.2875968 10.1016/j.jss.2017.05.043 10.1145/2384616.2384624 10.1145/3106237.3106309 10.1609/aaai.v33i01.33019478 10.1109/TSE.2010.98 10.1145/2610384.2628055 10.1109/ICSE.2013.6606624 10.1109/ICSME.2019.00035 10.1145/3415153 10.1007/978-3-642-22655-7_2 10.1109/TSE.2023.3255177 10.1145/2635868.2635888 10.1145/1985793.1985846 10.1145/3524846.3527338 10.1109/TSE.2019.2946563 10.1016/j.jss.2021.111041 10.1109/ICSE.2019.00084 10.1109/TSE.2014.2372785 10.1007/s10515-007-0015-3 10.1109/ASE.2011.6100138 10.1145/3510003.3510120 10.1145/2642937.2642994 10.1109/ICSE-SEIP52600.2021.00023 |
| ContentType | Journal Article |
| Copyright | Owner/Author |
| Copyright_xml | – notice: Owner/Author |
| DBID | AAYXX CITATION |
| DOI | 10.1145/3643747 |
| DatabaseName | CrossRef |
| DatabaseTitle | CrossRef |
| DatabaseTitleList | CrossRef |
| DeliveryMethod | fulltext_linktorsrc |
| Discipline | Computer Science |
| EISSN | 2994-970X |
| EndPage | 472 |
| ExternalDocumentID | 10_1145_3643747 3643747 |
| GrantInformation_xml | – fundername: Ministerio de Ciencia, Innovación y Universidades grantid: TED2021-132464B-I00 (PRODIGY) and PID2022-142290OB-I00 (ESPADA) funderid: https:\/\/doi.org\/10.13039\/100014440 – fundername: EU's Marie Sklodowska-Curie grantid: 101008233 (MISSION) funderid: https://doi.org/10.13039/ – fundername: Universidad de Buenos Aires grantid: UBACYT 2020-0233 and 2023-0134 funderid: https:\/\/doi.org\/10.13039\/501100005363 – fundername: Agencia Nacional de Promoción Científica y Tecnológica grantid: PICT 2018-3835, 2019-1442, 2019-1973, 2019-2050, 2020-2896, and 2021-4862 funderid: https:\/\/doi.org\/10.13039\/501100003074 – fundername: Amazon Research Award funderid: https://doi.org/10.13039/ – fundername: Comunidad de Madrid grantid: S2018\/TCS-4339 (BLOQUES-CM) funderid: https:\/\/doi.org\/10.13039\/100012818 – fundername: Fonds National de la Recherche Luxembourg grantid: C19\/IS\/13646587\/RASoRS funderid: https:\/\/doi.org\/10.13039\/501100001866 |
| GroupedDBID | AAKMM ACM AEJOY AKRVB ALMA_UNASSIGNED_HOLDINGS LHSKQ M~E AAYXX CITATION ROL |
| ID | FETCH-LOGICAL-a1227-1b33a87921d805f9a1d3e7af1c9d24cf8eeb09bce9eeb1bcce40093c6a0edd1a3 |
| ISSN | 2994-970X |
| IngestDate | Tue Nov 18 22:25:44 EST 2025 Sat Nov 29 07:50:29 EST 2025 Mon Jul 14 20:49:06 EDT 2025 |
| IsDoiOpenAccess | true |
| IsOpenAccess | true |
| IsPeerReviewed | true |
| IsScholarly | true |
| Issue | FSE |
| Keywords | grammar-based fuzzing oracle problem Metamorphic testing |
| Language | English |
| License | This work is licensed under a Creative Commons Attribution International 4.0 License. https://creativecommons.org/licenses/by/4.0 |
| LinkModel | OpenURL |
| MergedId | FETCHMERGED-LOGICAL-a1227-1b33a87921d805f9a1d3e7af1c9d24cf8eeb09bce9eeb1bcce40093c6a0edd1a3 |
| ORCID | 0000-0003-0532-5296 0000-0002-5592-1355 0009-0007-2748-2467 0000-0002-2441-1555 0000-0003-4180-7196 0000-0002-6711-3080 0000-0001-9352-1478 0000-0003-1611-3969 0000-0003-1852-2547 |
| OpenAccessLink | https://dl.acm.org/doi/10.1145/3643747 |
| PageCount | 23 |
| ParticipantIDs | crossref_citationtrail_10_1145_3643747 crossref_primary_10_1145_3643747 acm_primary_3643747 |
| PublicationCentury | 2000 |
| PublicationDate | 20240712 2024-07-12 |
| PublicationDateYYYYMMDD | 2024-07-12 |
| PublicationDate_xml | – month: 07 year: 2024 text: 20240712 day: 12 |
| PublicationDecade | 2020 |
| PublicationPlace | New York, NY, USA |
| PublicationPlace_xml | – name: New York, NY, USA |
| PublicationTitle | Proceedings of the ACM on software engineering |
| PublicationTitleAbbrev | ACM PACMSE |
| PublicationYear | 2024 |
| Publisher | ACM |
| Publisher_xml | – name: ACM |
| References | Arianna Blasi, Alberto Goffi, Konstantin Kuznetsov, Alessandra Gorla, Michael D. Ernst, Mauro Pezzè, and Sergio Delgado Castellanos. 2018. Translating code comments to procedure specifications. In Proceedings of the 27th ACM SIGSOFT International Symposium on Software Testing and Analysis, ISSTA 2018, Amsterdam, The Netherlands, July 16-21, 2018, Frank Tip and Eric Bodden (Eds.). ACM, 242–253. https://doi.org/10.1145/3213846.3213872 10.1145/3213846.3213872 Guido de Caso, Víctor A. Braberman, Diego Garbervetsky, and Sebastián Uchitel. 2011. Program abstractions for behaviour validation. In Proceedings of the 33rd International Conference on Software Engineering, ICSE 2011, Waikiki, Honolulu , HI, USA, May 21-28, 2011, Richard N. Taylor, Harald C. Gall, and Nenad Medvidovic (Eds.). ACM, 381–390. https://doi.org/10.1145/1985793.1985846 10.1145/1985793.1985846 Antonio Carzaniga, Alessandra Gorla, Andrea Mattavelli, Nicolò Perino, and Mauro Pezzè. 2013. Automatic recovery from runtime failures. In 35th International Conference on Software Engineering, ICSE ’13, San Francisco, CA, USA, May 18-26, 2013, David Notkin, Betty H. C. Cheng, and Klaus Pohl (Eds.). IEEE Computer Society, 782–791. https://doi.org/10.1109/ICSE.2013.6606624 10.1109/ICSE.2013.6606624 Huai Liu, Fei-Ching Kuo, Dave Towey, and Tsong Yueh Chen. 2014. How Effectively Does Metamorphic Testing Alleviate the Oracle Problem? IEEE Trans. Software Eng., 40, 1 (2014), 4–22. https://doi.org/10.1109/TSE.2013.46 10.1109/TSE.2013.46 Facundo Molina, Pablo Ponzio, Nazareno Aguirre, and Marcelo F. Frias. 2021. EvoSpex: An Evolutionary Algorithm for Learning Postconditions. In 43rd IEEE/ACM International Conference on Software Engineering, ICSE 2021, Madrid, Spain, 22-30 May 2021. IEEE, 1223–1235. https://doi.org/10.1109/ICSE43902.2021.00112 10.1109/ICSE43902.2021.00112 Ruijie Meng, Zhen Dong, Jialin Li, Ivan Beschastnikh, and Abhik Roychoudhury. 2022. Linear-Time Temporal Logic Guided Greybox Fuzzing. In Proceedings of the 44th International Conference on Software Engineering (ICSE ’22). Association for Computing Machinery, New York, NY, USA. 1343–1355. isbn:9781450392211 https://doi.org/10.1145/3510003.3510082 10.1145/3510003.3510082 Facundo Molina, Marcelo d’Amorim, and Nazareno Aguirre. 2022. Fuzzing Class Specifications. In 44th IEEE/ACM 44th International Conference on Software Engineering, ICSE 2022, Pittsburgh, PA, USA, May 25-27, 2022. ACM, 1008–1020. https://doi.org/10.1145/3510003.3510120 10.1145/3510003.3510120 Antonio Carzaniga, Alberto Goffi, Alessandra Gorla, Andrea Mattavelli, and Mauro Pezzè. 2014. Cross-checking oracles from intrinsic software redundancy. In 36th International Conference on Software Engineering, ICSE ’14, Hyderabad, India - May 31 - June 07, 2014, Pankaj Jalote, Lionel C. Briand, and André van der Hoek (Eds.). ACM, 931–942. https://doi.org/10.1145/2568225.2568287 10.1145/2568225.2568287 Michael D. Ernst, Jeff H. Perkins, Philip J. Guo, Stephen McCamant, Carlos Pacheco, Matthew S. Tschantz, and Chen Xiao. 2007. The Daikon system for dynamic detection of likely invariants. Sci. Comput. Program., 69, 1-3 (2007), 35–45. https://doi.org/10.1016/j.scico.2007.01.015 10.1016/j.scico.2007.01.015 Todd W. Schiller and Michael D. Ernst. 2012. Reducing the barriers to writing verified specifications. In Proceedings of the 27th Annual ACM SIGPLAN Conference on Object-Oriented Programming, Systems, Languages, and Applications, OOPSLA 2012, part of SPLASH 2012, Tucson, AZ, USA, October 21-25, 2012, Gary T. Leavens and Matthew B. Dwyer (Eds.). ACM, 95–112. https://doi.org/10.1145/2384616.2384624 10.1145/2384616.2384624 Sergio Segura, Dave Towey, Zhi Quan Zhou, and Tsong Yueh Chen. 2020. Metamorphic Testing: Testing the Untestable. IEEE Softw., 37, 3 (2020), 46–53. https://doi.org/10.1109/MS.2018.2875968 10.1109/MS.2018.2875968 Thanh Le-Cong, Duc-Minh Luong, Xuan-Bach Dinh Le, David Lo, Nhat-Hoa Tran, Bui Quang Huy, and Quyet-Thang Huynh. 2023. Invalidator: Automated Patch Correctness Assessment Via Semantic and Syntactic Reasoning. IEEE Trans. Software Eng., 49, 6 (2023), 3411–3429. https://doi.org/10.1109/TSE.2023.3255177 10.1109/TSE.2023.3255177 Bo Zhang, Hongyu Zhang, Junjie Chen, Dan Hao, and Pablo Moscato. 2019. Automatic Discovery and Cleansing of Numerical Metamorphic Relations. In 2019 IEEE International Conference on Software Maintenance and Evolution (ICSME). 235–245. https://doi.org/10.1109/ICSME.2019.00035 10.1109/ICSME.2019.00035 Tsong Yueh Chen, Fei-Ching Kuo, Huai Liu, Pak-Lok Poon, Dave Towey, T. H. Tse, and Zhi Quan Zhou. 2018. Metamorphic Testing: A Review of Challenges and Opportunities. ACM Comput. Surv., 51, 1 (2018), 4:1–4:27. https://doi.org/10.1145/3143561 10.1145/3143561 Anthony J. H. Simons. 2007. JWalk: a tool for lazy, systematic testing of java classes by design introspection and user interaction. Autom. Softw. Eng., 14, 4 (2007), 369–418. https://doi.org/10.1007/s10515-007-0015-3 10.1007/s10515-007-0015-3 Guido de Caso, Víctor A. Braberman, Diego Garbervetsky, and Sebastián Uchitel. 2013. Enabledness-based program abstractions for behavior validation. ACM Trans. Softw. Eng. Methodol., 22, 3 (2013), 25:1–25:46. https://doi.org/10.1145/2491509.2491519 10.1145/2491509.2491519 Daniel Jackson. 2006. Software Abstractions - Logic, Language, and Analysis. MIT Press. isbn:978-0-262-10114-1 http://mitpress.mit.edu/catalog/item/default.asp?ttype=2&tid=10928 René Just, Darioush Jalali, and Michael D. Ernst. 2014. Defects4J: A Database of Existing Faults to Enable Controlled Testing Studies for Java Programs. In Proceedings of the 2014 International Symposium on Software Testing and Analysis (ISSTA 2014). Association for Computing Machinery, New York, NY, USA. 437–440. isbn:9781450326452 https://doi.org/10.1145/2610384.2628055 10.1145/2610384.2628055 Guido de Caso, Víctor A. Braberman, Diego Garbervetsky, and Sebastián Uchitel. 2012. Automated Abstractions for Contract Validation. IEEE Trans. Software Eng., 38, 1 (2012), 141–162. https://doi.org/10.1109/TSE.2010.98 10.1109/TSE.2010.98 Valerio Terragni, Gunel Jahangirova, Paolo Tonella, and Mauro Pezzè. 2020. Evolutionary Improvement of Assertion Oracles. In Proceedings of the 28th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE 2020). Association for Computing Machinery, New York, NY, USA. 1178–1189. isbn:9781450370431 https://doi.org/10.1145/3368089.3409758 10.1145/3368089.3409758 Tien-Duy B. Le, David Lo, Claire Le Goues, and Lars Grunske. 2016. A learning-to-rank based fault localization approach using likely invariants. In Proceedings of the 25th International Symposium on Software Testing and Analysis, ISSTA 2016, Saarbrücken, Germany, July 18-20, 2016, Andreas Zeller and Abhik Roychoudhury (Eds.). ACM, 177–188. https://doi.org/10.1145/2931037.2931049 10.1145/2931037.2931049 Facundo Molina, Renzo Degiovanni, Pablo Ponzio, Germán Regis, Nazareno Aguirre, and Marcelo F. Frias. 2019. Training binary classifiers as data structure invariants. In Proceedings of the 41st International Conference on Software Engineering, ICSE 2019, Montreal, QC, Canada, May 25-31, 2019, Joanne M. Atlee, Tevfik Bultan, and Jon Whittle (Eds.). IEEE / ACM, 759–770. https://doi.org/10.1109/ICSE.2019.00084 10.1109/ICSE.2019.00084 Google. 2023. Google’s AFL. https://github.com/google/AFL Oracle. 2023. Documentation of List Iterator implementation from java.util. https://docs.oracle.com/javase/8/docs/api/java/util/ListIterator.html Tsong Yueh Chen, Pak-Lok Poon, and Xiaoyuan Xie. 2016. METRIC: METamorphic Relation Identification based on the Category-choice framework. J. Syst. Softw., 116 (2016), 177–190. https://doi.org/10.1016/j.jss.2015.07.037 10.1016/j.jss.2015.07.037 René Just, Franz Schweiggert, and Gregory M. Kapfhammer. 2011. MAJOR: An efficient and extensible tool for mutation analysis in a Java compiler. In 26th IEEE/ACM International Conference on Automated Software Engineering (ASE 2011), Lawrence, KS, USA, November 6-10, 2011, Perry Alexander, Corina S. Pasareanu, and John G. Hosking (Eds.). IEEE Computer Society, 612–615. https://doi.org/10.1109/ASE.2011.6100138 10.1109/ASE.2011.6100138 Jie Zhang, Junjie Chen, Dan Hao, Yingfei Xiong, Bing Xie, Lu Zhang, and Hong Mei. 2014. Search-Based Inference of Polynomial Metamorphic Relations. In Proceedings of the 29th ACM/IEEE International Conference on Automated Software Engineering (ASE ’14). Association for Computing Machinery, New York, NY, USA. 701–712. isbn:9781450330138 https://doi.org/10.1145/2642937.2642994 10.1145/2642937.2642994 Javier Godoy, Juan Pablo Galeotti, Diego Garbervetsky, and Sebastián Uchitel. 2021. Enabledness-based Testing of Object Protocols. ACM Trans. Softw. Eng. Methodol., 30, 2 (2021), 12:1–12:36. https://doi.org/10.1145/3415153 10.1145/3415153 Arianna Blasi, Alessandra Gorla, Michael D. Ernst, Mauro Pezzè, and Antonio Carzaniga. 2021. MeMo: Automatically identifying metamorphic relations in Javadoc comments for test automation. J. Syst. Softw., 181 (2021), 111041. https://doi.org/10.1016/j.jss.2021.111041 10.1016/j.jss.2021.111041 Samuel Jero, Maria Leonor Pacheco, Dan Goldwasser, and Cristina Nita-Rotaru. 2019. Leveraging Textual Specifications for Grammar-Based Fuzzing of Network Protocols. Proceedings of the AAAI Conference on Artificial Intelligence, 33, 01 (2019), Jul., 9478–9483. https://doi.org/10.1609/aaai.v33i01.33019478 10.1609/aaai.v33i01.33019478 John Ahlgren, Maria Eugenia Berezin, Kinga Bojarczuk, Elena Dulskyte, Inna Dvortsova, Johann George, Natalija Gucevska, Mark Harman, Maria Lomeli, Erik Meijer, Silvia Sapora, and Justin Spahr-Summers. 2021. Testing Web Enabled Simulation at Scale Using Metamorphic Testing. In 43rd IEEE/ACM International Conference on Software Engineering: Software Engineering in Practice, ICSE (SEIP) 2021, Madrid, Spain, May 25-28, 2021. IEEE, 140–149. https://doi.org/10.1109/ICSE-SEIP52600.2021.00023 10.1109/ICSE-SEIP52600.2021.00 e_1_2_1_20_1 e_1_2_1_41_1 e_1_2_1_24_1 e_1_2_1_45_1 e_1_2_1_22_1 e_1_2_1_43_1 e_1_2_1_28_1 e_1_2_1_26_1 e_1_2_1_47_1 Jackson Daniel (e_1_2_1_25_1) e_1_2_1_31_1 e_1_2_1_8_1 e_1_2_1_6_1 e_1_2_1_12_1 e_1_2_1_35_1 e_1_2_1_50_1 e_1_2_1_4_1 e_1_2_1_10_1 e_1_2_1_33_1 e_1_2_1_2_1 e_1_2_1_16_1 e_1_2_1_39_1 e_1_2_1_14_1 e_1_2_1_37_1 e_1_2_1_18_1 Zeller Andreas (e_1_2_1_49_1) 2019 e_1_2_1_42_1 e_1_2_1_40_1 e_1_2_1_23_1 e_1_2_1_46_1 e_1_2_1_21_1 e_1_2_1_44_1 e_1_2_1_27_1 e_1_2_1_48_1 e_1_2_1_29_1 e_1_2_1_7_1 e_1_2_1_30_1 e_1_2_1_5_1 e_1_2_1_3_1 e_1_2_1_13_1 e_1_2_1_34_1 e_1_2_1_51_1 e_1_2_1_1_1 e_1_2_1_11_1 e_1_2_1_32_1 e_1_2_1_17_1 e_1_2_1_38_1 e_1_2_1_15_1 e_1_2_1_36_1 e_1_2_1_9_1 e_1_2_1_19_1 |
| References_xml | – reference: Xuan-Bach Dinh Le, Duc-Hiep Chu, David Lo, Claire Le Goues, and Willem Visser. 2017. S3: syntax- and semantic-guided repair synthesis via programming by examples. In Proceedings of the 2017 11th Joint Meeting on Foundations of Software Engineering, ESEC/FSE 2017, Paderborn, Germany, September 4-8, 2017, Eric Bodden, Wilhelm Schäfer, Arie van Deursen, and Andrea Zisman (Eds.). ACM, 593–604. https://doi.org/10.1145/3106237.3106309 10.1145/3106237.3106309 – reference: Anthony J. H. Simons. 2007. JWalk: a tool for lazy, systematic testing of java classes by design introspection and user interaction. Autom. Softw. Eng., 14, 4 (2007), 369–418. https://doi.org/10.1007/s10515-007-0015-3 10.1007/s10515-007-0015-3 – reference: René Just, Franz Schweiggert, and Gregory M. Kapfhammer. 2011. MAJOR: An efficient and extensible tool for mutation analysis in a Java compiler. In 26th IEEE/ACM International Conference on Automated Software Engineering (ASE 2011), Lawrence, KS, USA, November 6-10, 2011, Perry Alexander, Corina S. Pasareanu, and John G. Hosking (Eds.). IEEE Computer Society, 612–615. https://doi.org/10.1109/ASE.2011.6100138 10.1109/ASE.2011.6100138 – reference: Samuel Jero, Maria Leonor Pacheco, Dan Goldwasser, and Cristina Nita-Rotaru. 2019. Leveraging Textual Specifications for Grammar-Based Fuzzing of Network Protocols. Proceedings of the AAAI Conference on Artificial Intelligence, 33, 01 (2019), Jul., 9478–9483. https://doi.org/10.1609/aaai.v33i01.33019478 10.1609/aaai.v33i01.33019478 – reference: Oracle. 2023. Documentation of Stack implementation from java.util. https://docs.oracle.com/javase/7/docs/api/java/util/Stack.html – reference: Valerio Terragni, Gunel Jahangirova, Paolo Tonella, and Mauro Pezzè. 2020. Evolutionary Improvement of Assertion Oracles. In Proceedings of the 28th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE 2020). Association for Computing Machinery, New York, NY, USA. 1178–1189. isbn:9781450370431 https://doi.org/10.1145/3368089.3409758 10.1145/3368089.3409758 – reference: Yu Pei, Carlo A. Furia, Martin Nordio, Yi Wei, Bertrand Meyer, and Andreas Zeller. 2014. Automated Fixing of Programs with Contracts. IEEE Trans. Software Eng., 40, 5 (2014), 427–449. https://doi.org/10.1109/TSE.2014.2312918 10.1109/TSE.2014.2312918 – reference: Javier Troya, Sergio Segura, and Antonio Ruiz Cortés. 2018. Automated inference of likely metamorphic relations for model transformations. J. Syst. Softw., 136 (2018), 188–208. https://doi.org/10.1016/j.jss.2017.05.043 10.1016/j.jss.2017.05.043 – reference: Andreas Zeller, Rahul Gopinath, Marcel Böhme, Gordon Fraser, and Christian Holler. 2019. The Fuzzing Book. In The Fuzzing Book. Saarland University. https://www.fuzzingbook.org/ Retrieved 2019-09-09 16:42:54+02:00 – reference: Alberto Goffi, Alessandra Gorla, Andrea Mattavelli, Mauro Pezzè, and Paolo Tonella. 2014. Search-based synthesis of equivalent method sequences. In Proceedings of the 22nd ACM SIGSOFT International Symposium on Foundations of Software Engineering, (FSE-22), Hong Kong, China, November 16 - 22, 2014, Shing-Chi Cheung, Alessandro Orso, and Margaret-Anne D. Storey (Eds.). ACM, 366–376. https://doi.org/10.1145/2635868.2635888 10.1145/2635868.2635888 – reference: Facundo Molina, Pablo Ponzio, Nazareno Aguirre, and Marcelo F. Frias. 2021. EvoSpex: An Evolutionary Algorithm for Learning Postconditions. In 43rd IEEE/ACM International Conference on Software Engineering, ICSE 2021, Madrid, Spain, 22-30 May 2021. IEEE, 1223–1235. https://doi.org/10.1109/ICSE43902.2021.00112 10.1109/ICSE43902.2021.00112 – reference: Google. 2021. Google’s ClusterFuzz. https://github.com/google/clusterfuzz – reference: Guido de Caso, Víctor A. Braberman, Diego Garbervetsky, and Sebastián Uchitel. 2012. Automated Abstractions for Contract Validation. IEEE Trans. Software Eng., 38, 1 (2012), 141–162. https://doi.org/10.1109/TSE.2010.98 10.1109/TSE.2010.98 – reference: Tien-Duy B. Le, David Lo, Claire Le Goues, and Lars Grunske. 2016. A learning-to-rank based fault localization approach using likely invariants. In Proceedings of the 25th International Symposium on Software Testing and Analysis, ISSTA 2016, Saarbrücken, Germany, July 18-20, 2016, Andreas Zeller and Abhik Roychoudhury (Eds.). ACM, 177–188. https://doi.org/10.1145/2931037.2931049 10.1145/2931037.2931049 – reference: Todd W. Schiller and Michael D. Ernst. 2012. Reducing the barriers to writing verified specifications. In Proceedings of the 27th Annual ACM SIGPLAN Conference on Object-Oriented Programming, Systems, Languages, and Applications, OOPSLA 2012, part of SPLASH 2012, Tucson, AZ, USA, October 21-25, 2012, Gary T. Leavens and Matthew B. Dwyer (Eds.). ACM, 95–112. https://doi.org/10.1145/2384616.2384624 10.1145/2384616.2384624 – reference: Sergio Segura, Juan C. Alonso, Alberto Martin-Lopez, Amador Durán, Javier Troya, and Antonio Ruiz-Cortés. 2022. Automated Generation of Metamorphic Relations for Query-Based Systems. In IEEE/ACM 7th International Workshop on Metamorphic Testing, MET@ICSE 2022, Pittsburgh, PA, USA, May 9, 2022. ACM, 48–55. https://doi.org/10.1145/3524846.3527338 10.1145/3524846.3527338 – reference: Apache. 2023. Apache Commons site. https://commons.apache.org/ – reference: Antonio Carzaniga, Alberto Goffi, Alessandra Gorla, Andrea Mattavelli, and Mauro Pezzè. 2014. Cross-checking oracles from intrinsic software redundancy. In 36th International Conference on Software Engineering, ICSE ’14, Hyderabad, India - May 31 - June 07, 2014, Pankaj Jalote, Lionel C. Briand, and André van der Hoek (Eds.). ACM, 931–942. https://doi.org/10.1145/2568225.2568287 10.1145/2568225.2568287 – reference: Gordon Fraser and Andrea Arcuri. 2011. EvoSuite: automatic test suite generation for object-oriented software. In SIGSOFT FSE. ACM, 416–419. – reference: Google. 2023. Google’s OSS-Fuzz. https://github.com/google/oss-fuzz – reference: John Ahlgren, Maria Eugenia Berezin, Kinga Bojarczuk, Elena Dulskyte, Inna Dvortsova, Johann George, Natalija Gucevska, Mark Harman, Maria Lomeli, Erik Meijer, Silvia Sapora, and Justin Spahr-Summers. 2021. Testing Web Enabled Simulation at Scale Using Metamorphic Testing. In 43rd IEEE/ACM International Conference on Software Engineering: Software Engineering in Practice, ICSE (SEIP) 2021, Madrid, Spain, May 25-28, 2021. IEEE, 140–149. https://doi.org/10.1109/ICSE-SEIP52600.2021.00023 10.1109/ICSE-SEIP52600.2021.00023 – reference: Javier Godoy, Juan Pablo Galeotti, Diego Garbervetsky, and Sebastián Uchitel. 2021. Enabledness-based Testing of Object Protocols. ACM Trans. Softw. Eng. Methodol., 30, 2 (2021), 12:1–12:36. https://doi.org/10.1145/3415153 10.1145/3415153 – reference: Jie Zhang, Junjie Chen, Dan Hao, Yingfei Xiong, Bing Xie, Lu Zhang, and Hong Mei. 2014. Search-Based Inference of Polynomial Metamorphic Relations. In Proceedings of the 29th ACM/IEEE International Conference on Automated Software Engineering (ASE ’14). Association for Computing Machinery, New York, NY, USA. 701–712. isbn:9781450330138 https://doi.org/10.1145/2642937.2642994 10.1145/2642937.2642994 – reference: Google. 2023. Google’s AFL. https://github.com/google/AFL – reference: Huai Liu, Fei-Ching Kuo, Dave Towey, and Tsong Yueh Chen. 2014. How Effectively Does Metamorphic Testing Alleviate the Oracle Problem? IEEE Trans. Software Eng., 40, 1 (2014), 4–22. https://doi.org/10.1109/TSE.2013.46 10.1109/TSE.2013.46 – reference: Arianna Blasi, Alessandra Gorla, Michael D. Ernst, Mauro Pezzè, and Antonio Carzaniga. 2021. MeMo: Automatically identifying metamorphic relations in Javadoc comments for test automation. J. Syst. Softw., 181 (2021), 111041. https://doi.org/10.1016/j.jss.2021.111041 10.1016/j.jss.2021.111041 – reference: Oracle. 2023. Documentation of List Iterator implementation from java.util. https://docs.oracle.com/javase/8/docs/api/java/util/ListIterator.html – reference: 2024. MemoRIA implementation and replication package. https://zenodo.org/records/10683011 – reference: Nels E. Beckman, Duri Kim, and Jonathan Aldrich. 2011. An Empirical Study of Object Protocols in the Wild. In ECOOP 2011 - Object-Oriented Programming - 25th European Conference, Lancaster, UK, July 25-29, 2011 Proceedings, Mira Mezini (Ed.) (Lecture Notes in Computer Science, Vol. 6813). Springer, 2–26. https://doi.org/10.1007/978-3-642-22655-7_2 10.1007/978-3-642-22655-7_2 – reference: Bo Zhang, Hongyu Zhang, Junjie Chen, Dan Hao, and Pablo Moscato. 2019. Automatic Discovery and Cleansing of Numerical Metamorphic Relations. In 2019 IEEE International Conference on Software Maintenance and Evolution (ICSME). 235–245. https://doi.org/10.1109/ICSME.2019.00035 10.1109/ICSME.2019.00035 – reference: Valentin J. M. Manès, HyungSeok Han, Choongwoo Han, Sang Kil Cha, Manuel Egele, Edward J. Schwartz, and Maverick Woo. 2021. The Art, Science, and Engineering of Fuzzing: A Survey. IEEE Trans. Software Eng., 47, 11 (2021), 2312–2331. https://doi.org/10.1109/TSE.2019.2946563 10.1109/TSE.2019.2946563 – reference: Ruijie Meng, Zhen Dong, Jialin Li, Ivan Beschastnikh, and Abhik Roychoudhury. 2022. Linear-Time Temporal Logic Guided Greybox Fuzzing. In Proceedings of the 44th International Conference on Software Engineering (ICSE ’22). Association for Computing Machinery, New York, NY, USA. 1343–1355. isbn:9781450392211 https://doi.org/10.1145/3510003.3510082 10.1145/3510003.3510082 – reference: Graphstream Team. 2023. Graphstream project site. https://graphstream-project.org/ – reference: Thanh Le-Cong, Duc-Minh Luong, Xuan-Bach Dinh Le, David Lo, Nhat-Hoa Tran, Bui Quang Huy, and Quyet-Thang Huynh. 2023. Invalidator: Automated Patch Correctness Assessment Via Semantic and Syntactic Reasoning. IEEE Trans. Software Eng., 49, 6 (2023), 3411–3429. https://doi.org/10.1109/TSE.2023.3255177 10.1109/TSE.2023.3255177 – reference: Arianna Blasi, Alberto Goffi, Konstantin Kuznetsov, Alessandra Gorla, Michael D. Ernst, Mauro Pezzè, and Sergio Delgado Castellanos. 2018. Translating code comments to procedure specifications. In Proceedings of the 27th ACM SIGSOFT International Symposium on Software Testing and Analysis, ISSTA 2018, Amsterdam, The Netherlands, July 16-21, 2018, Frank Tip and Eric Bodden (Eds.). ACM, 242–253. https://doi.org/10.1145/3213846.3213872 10.1145/3213846.3213872 – reference: Antonio Carzaniga, Alessandra Gorla, Andrea Mattavelli, Nicolò Perino, and Mauro Pezzè. 2013. Automatic recovery from runtime failures. In 35th International Conference on Software Engineering, ICSE ’13, San Francisco, CA, USA, May 18-26, 2013, David Notkin, Betty H. C. Cheng, and Klaus Pohl (Eds.). IEEE Computer Society, 782–791. https://doi.org/10.1109/ICSE.2013.6606624 10.1109/ICSE.2013.6606624 – reference: Tsong Yueh Chen, Fei-Ching Kuo, Huai Liu, Pak-Lok Poon, Dave Towey, T. H. Tse, and Zhi Quan Zhou. 2018. Metamorphic Testing: A Review of Challenges and Opportunities. ACM Comput. Surv., 51, 1 (2018), 4:1–4:27. https://doi.org/10.1145/3143561 10.1145/3143561 – reference: Michael D. Ernst, Jeff H. Perkins, Philip J. Guo, Stephen McCamant, Carlos Pacheco, Matthew S. Tschantz, and Chen Xiao. 2007. The Daikon system for dynamic detection of likely invariants. Sci. Comput. Program., 69, 1-3 (2007), 35–45. https://doi.org/10.1016/j.scico.2007.01.015 10.1016/j.scico.2007.01.015 – reference: Facundo Molina, Marcelo d’Amorim, and Nazareno Aguirre. 2022. Fuzzing Class Specifications. In 44th IEEE/ACM 44th International Conference on Software Engineering, ICSE 2022, Pittsburgh, PA, USA, May 25-27, 2022. ACM, 1008–1020. https://doi.org/10.1145/3510003.3510120 10.1145/3510003.3510120 – reference: Guido de Caso, Víctor A. Braberman, Diego Garbervetsky, and Sebastián Uchitel. 2011. Program abstractions for behaviour validation. In Proceedings of the 33rd International Conference on Software Engineering, ICSE 2011, Waikiki, Honolulu , HI, USA, May 21-28, 2011, Richard N. Taylor, Harald C. Gall, and Nenad Medvidovic (Eds.). ACM, 381–390. https://doi.org/10.1145/1985793.1985846 10.1145/1985793.1985846 – reference: Facundo Molina, Renzo Degiovanni, Pablo Ponzio, Germán Regis, Nazareno Aguirre, and Marcelo F. Frias. 2019. Training binary classifiers as data structure invariants. In Proceedings of the 41st International Conference on Software Engineering, ICSE 2019, Montreal, QC, Canada, May 25-31, 2019, Joanne M. Atlee, Tevfik Bultan, and Jon Whittle (Eds.). IEEE / ACM, 759–770. https://doi.org/10.1109/ICSE.2019.00084 10.1109/ICSE.2019.00084 – reference: Guido de Caso, Víctor A. Braberman, Diego Garbervetsky, and Sebastián Uchitel. 2013. Enabledness-based program abstractions for behavior validation. ACM Trans. Softw. Eng. Methodol., 22, 3 (2013), 25:1–25:46. https://doi.org/10.1145/2491509.2491519 10.1145/2491509.2491519 – reference: 2023. Fuzzing Research Tools and their Relatedness. https://fuzzing-survey.org/ – reference: Sergio Segura, Gordon Fraser, Ana Belén Sánchez, and Antonio Ruiz Cortés. 2016. A Survey on Metamorphic Testing. IEEE Trans. Software Eng., 42, 9 (2016), 805–824. https://doi.org/10.1109/TSE.2016.2532875 10.1109/TSE.2016.2532875 – reference: Daniel Jackson. 2006. Software Abstractions - Logic, Language, and Analysis. MIT Press. isbn:978-0-262-10114-1 http://mitpress.mit.edu/catalog/item/default.asp?ttype=2&tid=10928 – reference: Javier Godoy et al.. 2023. EPA benchmark repository. https://github.com/j-godoy/epa-benchmark – reference: Sergio Segura, Dave Towey, Zhi Quan Zhou, and Tsong Yueh Chen. 2020. Metamorphic Testing: Testing the Untestable. IEEE Softw., 37, 3 (2020), 46–53. https://doi.org/10.1109/MS.2018.2875968 10.1109/MS.2018.2875968 – reference: Earl T. Barr, Mark Harman, Phil McMinn, Muzammil Shahbaz, and Shin Yoo. 2015. The Oracle Problem in Software Testing: A Survey. IEEE Trans. Software Eng., 41, 5 (2015), 507–525. https://doi.org/10.1109/TSE.2014.2372785 10.1109/TSE.2014.2372785 – reference: René Just, Darioush Jalali, and Michael D. Ernst. 2014. Defects4J: A Database of Existing Faults to Enable Controlled Testing Studies for Java Programs. In Proceedings of the 2014 International Symposium on Software Testing and Analysis (ISSTA 2014). Association for Computing Machinery, New York, NY, USA. 437–440. isbn:9781450326452 https://doi.org/10.1145/2610384.2628055 10.1145/2610384.2628055 – reference: Tsong Yueh Chen, Pak-Lok Poon, and Xiaoyuan Xie. 2016. METRIC: METamorphic Relation Identification based on the Category-choice framework. J. Syst. Softw., 116 (2016), 177–190. https://doi.org/10.1016/j.jss.2015.07.037 10.1016/j.jss.2015.07.037 – ident: e_1_2_1_17_1 doi: 10.1016/j.scico.2007.01.015 – ident: e_1_2_1_29_1 doi: 10.1145/2931037.2931049 – ident: e_1_2_1_19_1 doi: 10.1145/2025113.2025179 – ident: e_1_2_1_34_1 doi: 10.1145/3510003.3510082 – ident: e_1_2_1_37_1 doi: 10.1109/ICSE43902.2021.00112 – ident: e_1_2_1_7_1 doi: 10.1145/3213846.3213872 – ident: e_1_2_1_16_1 doi: 10.1145/2491509.2491519 – ident: e_1_2_1_43_1 doi: 10.1109/TSE.2016.2532875 – ident: e_1_2_1_32_1 doi: 10.1109/TSE.2013.46 – ident: e_1_2_1_9_1 doi: 10.1145/2568225.2568287 – ident: e_1_2_1_12_1 doi: 10.1016/j.jss.2015.07.037 – ident: e_1_2_1_18_1 – ident: e_1_2_1_47_1 doi: 10.1145/3368089.3409758 – ident: e_1_2_1_4_1 – ident: e_1_2_1_11_1 doi: 10.1145/3143561 – ident: e_1_2_1_40_1 doi: 10.1109/TSE.2014.2312918 – ident: e_1_2_1_44_1 doi: 10.1109/MS.2018.2875968 – ident: e_1_2_1_48_1 doi: 10.1016/j.jss.2017.05.043 – ident: e_1_2_1_41_1 doi: 10.1145/2384616.2384624 – ident: e_1_2_1_30_1 doi: 10.1145/3106237.3106309 – ident: e_1_2_1_15_1 doi: 10.1145/2491509.2491519 – ident: e_1_2_1_26_1 doi: 10.1609/aaai.v33i01.33019478 – ident: e_1_2_1_14_1 doi: 10.1109/TSE.2010.98 – ident: e_1_2_1_2_1 – ident: e_1_2_1_27_1 doi: 10.1145/2610384.2628055 – ident: e_1_2_1_10_1 doi: 10.1109/ICSE.2013.6606624 – ident: e_1_2_1_50_1 doi: 10.1109/ICSME.2019.00035 – ident: e_1_2_1_20_1 doi: 10.1145/3415153 – ident: e_1_2_1_6_1 doi: 10.1007/978-3-642-22655-7_2 – ident: e_1_2_1_31_1 doi: 10.1109/TSE.2023.3255177 – ident: e_1_2_1_46_1 – ident: e_1_2_1_38_1 – ident: e_1_2_1_24_1 – ident: e_1_2_1_21_1 doi: 10.1145/2635868.2635888 – ident: e_1_2_1_13_1 doi: 10.1145/1985793.1985846 – ident: e_1_2_1_42_1 doi: 10.1145/3524846.3527338 – ident: e_1_2_1_23_1 – ident: e_1_2_1_33_1 doi: 10.1109/TSE.2019.2946563 – ident: e_1_2_1_8_1 doi: 10.1016/j.jss.2021.111041 – ident: e_1_2_1_36_1 doi: 10.1109/ICSE.2019.00084 – ident: e_1_2_1_5_1 doi: 10.1109/TSE.2014.2372785 – ident: e_1_2_1_45_1 doi: 10.1007/s10515-007-0015-3 – volume-title: Software Abstractions - Logic, Language, and Analysis ident: e_1_2_1_25_1 – ident: e_1_2_1_1_1 – ident: e_1_2_1_28_1 doi: 10.1109/ASE.2011.6100138 – volume-title: The Fuzzing Book year: 2019 ident: e_1_2_1_49_1 – ident: e_1_2_1_35_1 doi: 10.1145/3510003.3510120 – ident: e_1_2_1_22_1 – ident: e_1_2_1_51_1 doi: 10.1145/2642937.2642994 – ident: e_1_2_1_3_1 doi: 10.1109/ICSE-SEIP52600.2021.00023 – ident: e_1_2_1_39_1 |
| SSID | ssj0002991170 |
| Score | 2.2616925 |
| Snippet | Metamorphic testing is a valuable technique that helps in dealing with the oracle problem. It involves testing software against specifications of its intended... |
| SourceID | crossref acm |
| SourceType | Enrichment Source Index Database Publisher |
| StartPage | 450 |
| SubjectTerms | Dynamic analysis Program specifications Software and its engineering Software testing and debugging Theory of computation |
| SubjectTermsDisplay | Software and its engineering -- Dynamic analysis Software and its engineering -- Software testing and debugging Theory of computation -- Program specifications |
| Title | Abstraction-Aware Inference of Metamorphic Relations |
| URI | https://dl.acm.org/doi/10.1145/3643747 |
| Volume | 1 |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| journalDatabaseRights | – providerCode: PRVHPJ databaseName: ROAD: Directory of Open Access Scholarly Resources customDbUrl: eissn: 2994-970X dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0002991170 issn: 2994-970X databaseCode: M~E dateStart: 20240101 isFulltext: true titleUrlDefault: https://road.issn.org providerName: ISSN International Centre |
| link | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwtV1NT9wwELUo9NBLP2groBTlUHGLSBwnsY8rPloOi5AK0t5WzthBlRZntdmlqIf-dsaO4w3QQ3voJYoSy5v4eceT8cx7hHzhquZ5AkWsK5nFTLEirnjN4pIWuVCFzjIJTmyivLjgk4m49KHs1skJlMbw-3sx_69Q4zUE25bO_gPcoVO8gOcIOh4Rdjz-FfCjykYvXLlCPPppE7vO-6I-l--il_K2wdF1GfSzQcDOu6iXYUlr-wSC0fHYbiq0aLJdh3pNYhiCyfiJ3EJXM3OzapduA_4kzLyx0wZynrKElVFNcKD1jU2HNU5ZCh_I_Aq3vjaLmfRFOG0rjVrIYYyCMhv8TOlgVvm8d2fXqGUjFmUyeWSEB3Pt7PvpwKSyjpjWr86sE_p5bviZ5cjI7DZkx-D5hEXb33lBtmiZC2v-xr_XwTh8JKvA0xVV276OfHvrs8DtwGcZOB9Xb8lr_9UQjTq035ENbbbJm16RI_IG-j1hz8CPAvhRU0cD8KMA_gdyfXZ6dfwt9roYsUwpxZGt8B_ES0FTxZO8FjJVmS5lnYJQlEHNta4SUYEWeJJWAJrZwBUUMtFKpTL7SDZNY_QOiWrQVPFag0Q3LeNS5jmA5RyUNK9wTd4l2_j-03nHfDL1o7JLDvvxmIKnkreKJrNpV-aerxtGoWHfx5Mme3_8hU_k1Xoe7ZPN5WKlP5OXcLf80S4OHHgPfddhng |
| linkProvider | ISSN International Centre |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Abstraction-Aware+Inference+of+Metamorphic+Relations&rft.jtitle=Proceedings+of+the+ACM+on+software+engineering&rft.au=Nolasco%2C+Agust%C3%ADn&rft.au=Molina%2C+Facundo&rft.au=Degiovanni%2C+Renzo&rft.au=Gorla%2C+Alessandra&rft.date=2024-07-12&rft.pub=ACM&rft.eissn=2994-970X&rft.volume=1&rft.issue=FSE&rft.spage=450&rft.epage=472&rft_id=info:doi/10.1145%2F3643747&rft.externalDocID=3643747 |
| thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=2994-970X&client=summon |
| thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=2994-970X&client=summon |
| thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=2994-970X&client=summon |