Automated Generation of Metamorphic Relations for Query-Based Systems

Searching and displaying data based on user queries is a pervasive feature of most software applications such as information systems, web portals, and web APIs. The large volume of data managed by these types of systems, henceforth called query-based systems (QBSs), makes them extremely hard to test...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Proceedings of the 7th International Workshop on Metamorphic Testing S. 48 - 55
Hauptverfasser: Segura, Sergio, Alonso, Juan C., Martin-Lopez, Alberto, Duran, Amador, Troya, Javier, Ruiz-Cortes, Antonio
Format: Tagungsbericht
Sprache:Englisch
Veröffentlicht: ACM 01.05.2022
Schlagworte:
Conferences
Limiting
Manuals
metamorphic relation
Metamorphic testing
oracle problem
Portals
Software
Task analysis
Video on demand
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Abstract Searching and displaying data based on user queries is a pervasive feature of most software applications such as information systems, web portals, and web APIs. The large volume of data managed by these types of systems, henceforth called query-based systems (QBSs), makes them extremely hard to test due to the difficulty to assess whether the output of a query is correct, the socalled test oracle problem. Metamorphic testing has proved to be a very effective approach to alleviate the oracle problem in QBSs, by exploiting the relations among multiple executions of the QBS under test, socalled metamorphic relations (MRs). However, the identification of MRs mostly remains a manual and creative task, limiting the appli-cability of the approach. In this paper, we propose a method for the automated generation of MRs in QBSs starting from a lightweight specification of the query parameters of the system. Evaluation results show that hundreds of MRs can be automatically identified in real-world systems like IMDb, SkyScanner, or YouTube in just a few seconds.
AbstractList Searching and displaying data based on user queries is a pervasive feature of most software applications such as information systems, web portals, and web APIs. The large volume of data managed by these types of systems, henceforth called query-based systems (QBSs), makes them extremely hard to test due to the difficulty to assess whether the output of a query is correct, the socalled test oracle problem. Metamorphic testing has proved to be a very effective approach to alleviate the oracle problem in QBSs, by exploiting the relations among multiple executions of the QBS under test, socalled metamorphic relations (MRs). However, the identification of MRs mostly remains a manual and creative task, limiting the appli-cability of the approach. In this paper, we propose a method for the automated generation of MRs in QBSs starting from a lightweight specification of the query parameters of the system. Evaluation results show that hundreds of MRs can be automatically identified in real-world systems like IMDb, SkyScanner, or YouTube in just a few seconds.
Author Ruiz-Cortes, Antonio
Duran, Amador
Martin-Lopez, Alberto
Troya, Javier
Segura, Sergio
Alonso, Juan C.
Author_xml – sequence: 1
  givenname: Sergio
  surname: Segura
  fullname: Segura, Sergio
  email: sergiosegura@us.es
  organization: I3US Institute, Universidad de Sevilla,SCORE Lab,Seville,Spain
– sequence: 2
  givenname: Juan C.
  surname: Alonso
  fullname: Alonso, Juan C.
  email: javalenzuela@us.es
  organization: I3US Institute, Universidad de Sevilla,SCORE Lab,Seville,Spain
– sequence: 3
  givenname: Alberto
  surname: Martin-Lopez
  fullname: Martin-Lopez, Alberto
  email: alberto.martin@us.es
  organization: I3US Institute, Universidad de Sevilla,SCORE Lab,Seville,Spain
– sequence: 4
  givenname: Amador
  surname: Duran
  fullname: Duran, Amador
  email: amador@us.es
  organization: I3US Institute, Universidad de Sevilla,SCORE Lab,Seville,Spain
– sequence: 5
  givenname: Javier
  surname: Troya
  fullname: Troya, Javier
  email: jtroya@uma.es
  organization: ITIS Software, Universidad de Málaga,Malaga,Spain
– sequence: 6
  givenname: Antonio
  surname: Ruiz-Cortes
  fullname: Ruiz-Cortes, Antonio
  email: aruiz@us.es
  organization: I3US Institute, Universidad de Sevilla,SCORE Lab,Seville,Spain
BookMark eNotjMtOwzAUBY0EElCyZsHGP5Bi-zp-LEtVClJRVR7rykmuRVATV7a7yN8TFVYjndGZW3I5hAEJuedszrmsHqES0kg1n6gBzAUprDaTYGCBaXFNipR-GGPCaMGVvSGrxSmH3mVs6RoHjC53YaDB0zfMrg_x-N019B0P5z1RHyLdnTCO5ZNL0-djTBn7dEeuvDskLP45I1_Pq8_lS7nZrl-Xi03pgKtcGqy99LbyCmrNrKqdNdxKBSg9tkJWQlQ1NF5pLhoA8N5xr1C2UDeNdBpm5OGv2yHi_hi73sVxb41QXEj4BXIgS54
CODEN IEEPAD
ContentType Conference Proceeding
DBID 6IE
6IL
CBEJK
RIE
RIL
DOI 10.1145/3524846.3527338
DatabaseName IEEE Electronic Library (IEL) Conference Proceedings
IEEE Proceedings Order Plan All Online (POP All Online) 1998-present by volume
IEEE Xplore All Conference Proceedings
IEEE Electronic Library (IEL)
IEEE Proceedings Order Plans (POP All) 1998-Present
DatabaseTitleList
Database_xml – sequence: 1
  dbid: RIE
  name: IEEE/IET Electronic Library (IEL)
  url: https://ieeexplore.ieee.org/
  sourceTypes: Publisher
DeliveryMethod fulltext_linktorsrc
EISBN 9781450393072
1450393071
EndPage 55
ExternalDocumentID 9826124
Genre orig-research
GroupedDBID 6IE
6IL
ACM
ALMA_UNASSIGNED_HOLDINGS
APO
CBEJK
LHSKQ
RIE
RIL
ID FETCH-LOGICAL-a316t-8ebf4f95f63b7096ba9819463e4fed245225b3cf6712c333ffa1f6e4d3bcc4a73
IEDL.DBID RIE
ISICitedReferencesCount 8
ISICitedReferencesURI http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000855504800008&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
IngestDate Wed Aug 27 02:25:29 EDT 2025
IsDoiOpenAccess false
IsOpenAccess true
IsPeerReviewed false
IsScholarly false
Language English
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-a316t-8ebf4f95f63b7096ba9819463e4fed245225b3cf6712c333ffa1f6e4d3bcc4a73
OpenAccessLink https://dl.acm.org/doi/pdf/10.1145/3524846.3527338
PageCount 8
ParticipantIDs ieee_primary_9826124
PublicationCentury 2000
PublicationDate 2022-May
PublicationDateYYYYMMDD 2022-05-01
PublicationDate_xml – month: 05
  year: 2022
  text: 2022-May
PublicationDecade 2020
PublicationTitle Proceedings of the 7th International Workshop on Metamorphic Testing
PublicationTitleAbbrev MET
PublicationYear 2022
Publisher ACM
Publisher_xml – name: ACM
SSID ssj0002872169
Score 1.8868914
Snippet Searching and displaying data based on user queries is a pervasive feature of most software applications such as information systems, web portals, and web...
SourceID ieee
SourceType Publisher
StartPage 48
SubjectTerms Conferences
Limiting
Manuals
metamorphic relation
Metamorphic testing
oracle problem
Portals
Software
Task analysis
Video on demand
Title Automated Generation of Metamorphic Relations for Query-Based Systems
URI https://ieeexplore.ieee.org/document/9826124
WOSCitedRecordID wos000855504800008&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV09T8MwED21iIEJUIv4lgdG3CaxY8cjoFYMUBUJULfKH2epAw0qCRL_HjuNAgMLm-XF8nl4z3f33gFccRs4NOae6kCPKU8tp0p6Tb0smGHCKtcMg3l9kLNZsVioeQ-uOy0MIjbNZziKy6aW70pbx1TZWBXR8Ir3oS-l3Gq1unxKYP5ZKlTr3pPyfByoBQ_oOmLRYyzqT36NT2nQY7r_v3MPYPgjwyPzDmAOoYfrAUxu6qoMNBMd2VpGx8iS0pNHrPRbGcK2sqRrcSOBk5KnGjdf9DbglSOtQ_kQXqaT57t72s5CoJqloqIFGs-9yr1gRoZvh9EqYDkXDLlHF8unWW6Y9UKmmWWMea9TL5A7ZqzlWrIj2FmXazwGYmySmFTJPJrxaWkL7mzCnM90gknh5QkMYgiW71u7i2V7-9O_t89gL4uKgKYH8Bx2qk2NF7BrP6vVx-ayeaNvCUGTcg
linkProvider IEEE
linkToHtml http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV09T8MwELVKQYIJUIv4xgMjbuPYieMRUKsi2qpIBXWr_HGWGGhQSZD499hpFBhY2Cwvls_De7679w6ha248h4bEEeXpMeHUcCKFU8SJjGmWGmmrYTAvYzGdZouFnLXQTaOFAYCq-Qx6YVnV8m1uypAq68ssGF7xLbSdcB7TjVqryah47h_TVNb-PZQnfU8uuMfXHgsuY0GB8muASoUfw_3_nXyAuj9CPDxrIOYQtWDVQYPbssg90QSLN6bRIbY4d3gChXrLfeBeDW6a3LBnpfiphPUXufOIZXHtUd5Fz8PB_H5E6mkIRDGaFiQD7biTiUuZFv7joZX0aM5TBtyBDQXUONHMuFTQ2DDGnFPUpcAt08ZwJdgRaq_yFRwjrE0UaSpFEuz4lDAZtyZi1sUqgihz4gR1QgiW7xvDi2V9-9O_t6_Q7mg-GS_HD9PHM7QXB31A1RF4jtrFuoQLtGM-i9eP9WX1Xt_lrJa5
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=proceeding&rft.title=Proceedings+of+the+7th+International+Workshop+on+Metamorphic+Testing&rft.atitle=Automated+Generation+of+Metamorphic+Relations+for+Query-Based+Systems&rft.au=Segura%2C+Sergio&rft.au=Alonso%2C+Juan+C.&rft.au=Martin-Lopez%2C+Alberto&rft.au=Duran%2C+Amador&rft.date=2022-05-01&rft.pub=ACM&rft.spage=48&rft.epage=55&rft_id=info:doi/10.1145%2F3524846.3527338&rft.externalDocID=9826124