ChemTest: An Automated Software Testing Framework for an Emerging Paradigm
In recent years the use of non-traditional computing mechanisms has grown rapidly. One paradigm uses chemical reaction networks (CRNs) to compute via chemical interactions. CRNs are used to prototype molecular devices at the nanoscale such as intelligent drug therapeutics. In practice, these program...
Uloženo v:
| Vydáno v: | 2020 35th IEEE/ACM International Conference on Automated Software Engineering (ASE) s. 548 - 560 |
|---|---|
| Hlavní autoři: | , , , |
| Médium: | Konferenční příspěvek |
| Jazyk: | angličtina |
| Vydáno: |
ACM
01.09.2020
|
| Témata: | |
| ISSN: | 2643-1572 |
| On-line přístup: | Získat plný text |
| Tagy: |
Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
|
| Abstract | In recent years the use of non-traditional computing mechanisms has grown rapidly. One paradigm uses chemical reaction networks (CRNs) to compute via chemical interactions. CRNs are used to prototype molecular devices at the nanoscale such as intelligent drug therapeutics. In practice, these programs are first written and simulated in environments such as MatLab and later compiled into physical molecules such as DNA strands. However, techniques for testing the correctness of CRNs are lacking. Current methods of validating CRNs include model checking and theorem proving, but these are limited in scalability. In this paper we present the first (to the best of our knowledge) testing framework for CRNs, ChemTest. ChemTest evaluates test oracles on individual simulation traces and supports functional, metamorphic, internal and hyper test cases. It also allows for flakiness and programs that are probabilistic. We performed a large case study demonstrating that ChemTest can find seeded faults and scales beyond model checking. Of our tests, 21% are inherently flaky, suggesting that systematic support for this paradigm is needed. On average, functional tests find 66.5% of the faults, while metamorphic tests find 80.4%, showing the benefit of using metamorphic relationships in our test framework. In addition, we show how the time at evaluation impacts fault detection. |
|---|---|
| AbstractList | In recent years the use of non-traditional computing mechanisms has grown rapidly. One paradigm uses chemical reaction networks (CRNs) to compute via chemical interactions. CRNs are used to prototype molecular devices at the nanoscale such as intelligent drug therapeutics. In practice, these programs are first written and simulated in environments such as MatLab and later compiled into physical molecules such as DNA strands. However, techniques for testing the correctness of CRNs are lacking. Current methods of validating CRNs include model checking and theorem proving, but these are limited in scalability. In this paper we present the first (to the best of our knowledge) testing framework for CRNs, ChemTest. ChemTest evaluates test oracles on individual simulation traces and supports functional, metamorphic, internal and hyper test cases. It also allows for flakiness and programs that are probabilistic. We performed a large case study demonstrating that ChemTest can find seeded faults and scales beyond model checking. Of our tests, 21% are inherently flaky, suggesting that systematic support for this paradigm is needed. On average, functional tests find 66.5% of the faults, while metamorphic tests find 80.4%, showing the benefit of using metamorphic relationships in our test framework. In addition, we show how the time at evaluation impacts fault detection. |
| Author | Gerten, Michael C. Klinge, Titus H. Lathrop, James I. Cohen, Myra B. |
| Author_xml | – sequence: 1 givenname: Michael C. surname: Gerten fullname: Gerten, Michael C. email: mcgerten@iastate.edu organization: Iowa State University,Department of Computer Science,Ames,Iowa,USA – sequence: 2 givenname: James I. surname: Lathrop fullname: Lathrop, James I. email: jil@iastate.edu organization: Iowa State University,Department of Computer Science,Ames,Iowa,USA – sequence: 3 givenname: Myra B. surname: Cohen fullname: Cohen, Myra B. email: mcohen@iastate.edu organization: Iowa State University,Department of Computer Science,Ames,Iowa,USA – sequence: 4 givenname: Titus H. surname: Klinge fullname: Klinge, Titus H. email: titus.klinge@drake.edu organization: Drake University,Department of Mathematics and Computer Science,Des Moines,Iowa,USA |
| BookMark | eNotzEtLw0AUBeBRFGxr1y7czB9InffDXQitDwoK1nW5k9yJUZPIJFL896bo5hwOH5w5Oev6Dgm54mzFudI3UgrlnFpJxY2R7oQsvXUTMGmsceqUzIRRMuPaigsyH4Z3xvQ07Iw8Fm_Y7nAYb2ne0fx77FsYsaIvfRwPkJAerelquknQ4qFPHzT2iUJH1y2m-ijPkKBq6vaSnEf4HHD53wvyulnvivts-3T3UOTbDISy45QcofKRgy9tBIFegfQYSqU5K20I3IRSM264C9IoFhzT2hptSi1YwCgX5Prvt0HE_VdqWkg_ey-cYZbLXyoaTbA |
| CODEN | IEEPAD |
| ContentType | Conference Proceeding |
| DBID | 6IE 6IL CBEJK ESBDL RIE RIL |
| DOI | 10.1145/3324884.3416638 |
| DatabaseName | IEEE Electronic Library (IEL) Conference Proceedings IEEE Proceedings Order Plan All Online (POP All Online) 1998-present by volume IEEE Xplore All Conference Proceedings IEEE Xplore Open Access Journals IEEE/IET Electronic Library (IEL) (UW System Shared) IEEE Proceedings Order Plans (POP All) 1998-Present |
| DatabaseTitleList | |
| Database_xml | – sequence: 1 dbid: RIE name: IEEE/IET Electronic Library (IEL) (UW System Shared) url: https://ieeexplore.ieee.org/ sourceTypes: Publisher |
| DeliveryMethod | fulltext_linktorsrc |
| Discipline | Computer Science |
| EISBN | 9781450367684 1450367682 |
| EISSN | 2643-1572 |
| EndPage | 560 |
| ExternalDocumentID | 9286071 |
| Genre | orig-research |
| GroupedDBID | 29I 6IE 6IF 6IH 6IK 6IL 6IM 6IN 6J9 AAJGR AAWTH ABLEC ACREN ADYOE ADZIZ AFYQB ALMA_UNASSIGNED_HOLDINGS AMTXH APO BEFXN BFFAM BGNUA BKEBE BPEOZ CBEJK CHZPO ESBDL IEGSK IPLJI M43 OCL RIE RIL |
| ID | FETCH-LOGICAL-a247t-a21ead9f1a9c7fa2e94a39ebc4510c7bb16bc501618b3640b80557656c520bef3 |
| IEDL.DBID | RIE |
| ISICitedReferencesCount | 5 |
| ISICitedReferencesURI | http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000651313500047&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| IngestDate | Wed Aug 27 02:45:17 EDT 2025 |
| IsDoiOpenAccess | true |
| IsOpenAccess | true |
| IsPeerReviewed | false |
| IsScholarly | true |
| Language | English |
| LinkModel | DirectLink |
| MergedId | FETCHMERGED-LOGICAL-a247t-a21ead9f1a9c7fa2e94a39ebc4510c7bb16bc501618b3640b80557656c520bef3 |
| OpenAccessLink | https://ieeexplore.ieee.org/document/9286071 |
| PageCount | 13 |
| ParticipantIDs | ieee_primary_9286071 |
| PublicationCentury | 2000 |
| PublicationDate | 2020-Sept. |
| PublicationDateYYYYMMDD | 2020-09-01 |
| PublicationDate_xml | – month: 09 year: 2020 text: 2020-Sept. |
| PublicationDecade | 2020 |
| PublicationTitle | 2020 35th IEEE/ACM International Conference on Automated Software Engineering (ASE) |
| PublicationTitleAbbrev | ASE |
| PublicationYear | 2020 |
| Publisher | ACM |
| Publisher_xml | – name: ACM |
| SSID | ssj0051577 ssj0002871035 |
| Score | 2.1719227 |
| Snippet | In recent years the use of non-traditional computing mechanisms has grown rapidly. One paradigm uses chemical reaction networks (CRNs) to compute via chemical... |
| SourceID | ieee |
| SourceType | Publisher |
| StartPage | 548 |
| SubjectTerms | chemical reaction networks Chemicals flakiness metamorphic testing Model checking Scalability Software Software and its engineering → Software testing and debugging Software engineering Software testing Systematics |
| Title | ChemTest: An Automated Software Testing Framework for an Emerging Paradigm |
| URI | https://ieeexplore.ieee.org/document/9286071 |
| WOSCitedRecordID | wos000651313500047&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| link | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV3PS8MwFH7M4cHT1E38TQ4e7dY2aZN4G-IQD2PghN1Gkr7KDnZSO_33fem6iuDFSykNhJL0ve_L63vfA7iJM8LECFWAocwD8n46sMgxEIbgnAAzFc7VzSbkdKoWCz3rwG1bC4OIdfIZDv1t_S8_W7uND5WNdKy8HNoe7EmZbmu12niKZ_4hb6kvwbSUjZRPJJIRJ-KglBiS0yaMVb96qdRQMun97yUOYfBTk8dmLdocQQeLY-jtmjKwxkb78OQlAObk6-_YuGDjTbUmTooZeyZ_-2VKZH6MZmCTXVoWI97KTMF8fMq3LGIzU5ps9fo2gJfJw_z-MWgaJgQmFrKia0Qfhs4jo53MTYxaGK7ROkGW56S1UWpdUmvkW56K0CqvwEWMziVxaDHnJ9At1gWeAiPbzk2UZWFijUhVqhNuJW1fnoaaTon2DPp-aZbvW02MZbMq538_voCD2J9T69ysS-hW5QavYN99VquP8rreyG9FjJyD |
| linkProvider | IEEE |
| linkToHtml | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV1NS8NAEB1qFfRUtYrf7sGjafOxSXa9FbFUraVghd7K7mYiPZhKTPXvO5umEcGLlxCysITdzLy3k5k3AFd-QpjooXDQjVOHvJ90NAbocEVwToAZcWPKZhPxaCSmUzluwHVdC4OIZfIZduxt-S8_WZilDZV1pS-sHNoGbIac--6qWquOqFju7wY1-SWgjuNKzMfjYTcg6iAE75DbJpQVv7qplGDSb_3vNXbh4Kcqj41rvNmDBmb70Fq3ZWCVlbbhwYoATMjb37BexnrLYkGsFBP2TB73S-XI7BjNwPrrxCxGzJWpjNkIlW1axMYqV8n89e0AXvp3k9uBU7VMcJTP44KuHn0aMvWUNHGqfJRcBRK14WR7Jtbai7QJS5V8HUTc1cJqcBGnM6HvakyDQ2hmiwyPgJF1p8pLEjfUikcikmGgY9rANHIlnRP1MbTt0szeV6oYs2pVTv5-fAnbg8nTcDa8Hz2ewo5vT61lptYZNIt8ieewZT6L-Ud-UW7qN5upn8o |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=proceeding&rft.title=2020+35th+IEEE%2FACM+International+Conference+on+Automated+Software+Engineering+%28ASE%29&rft.atitle=ChemTest%3A+An+Automated+Software+Testing+Framework+for+an+Emerging+Paradigm&rft.au=Gerten%2C+Michael+C.&rft.au=Lathrop%2C+James+I.&rft.au=Cohen%2C+Myra+B.&rft.au=Klinge%2C+Titus+H.&rft.date=2020-09-01&rft.pub=ACM&rft.eissn=2643-1572&rft.spage=548&rft.epage=560&rft_id=info:doi/10.1145%2F3324884.3416638&rft.externalDocID=9286071 |