Testing Cyber-Physical Systems Using a Line-Search Falsification Method

Saved in:
Bibliographic Details
Title: Testing Cyber-Physical Systems Using a Line-Search Falsification Method
Authors: Ramezani, Zahra, 1988, Claessen, Koen, 1975, Smallbone, Nicholas, 1986, Fabian, Martin, 1960, Åkesson, Knut, 1972
Source: IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems. 41(8):2393-2406
Subject Terms: Optimization methods, Testing, Falsification, Computational modeling, Semantics, Additives, Linear programming, Simulation-based Optimization., Benchmark testing, Cyber-Physical Systems
Description: Cyber-physical systems (CPSs) are complex and exhibit both continuous and discrete dynamics, hence it is difficult to guarantee that they satisfy given specifications, i.e., the properties that must be fulfilled by the system. Falsification of temporal logic properties is a testing approach that searches for counterexamples of a given specification that can be used to increase the confidence that a CPS does fulfill its specifications. Falsification can be done using random search methods or optimization methods, both of which have their own benefits and drawbacks. This paper introduces two methods that exploit randomness to different degrees: the optimization-free Hybrid-Corner-Random (), and the direct-search method Line-search Falsification (). combines randomly chosen parameter values with extreme parameter values, which performs surprisingly well on benchmark evaluations. The gradient-free optimization-based LSF optimizes over line segments through a vector of inputs in the n-dimensional parameter space. The two methods are compared to the Nelder-Mead and SNOBFIT methods, using a well-known set of benchmark problems and shows better performance than any of the evaluated methods. Falsification can be done using random search methods or optimization methods. This paper proposes a method based on combining randomly chosen parameter values with parameter extreme values. Evaluation results on benchmark problems show that this method performs well on many of the problems. Optimization-based methods are needed when optimization-free methods do not perform well in falsification. The efficiency of the falsification is affected by the optimization methods used to search for inputs that might falsify the specifications. This paper presents a new optimization method for falsification, Line-search Falsification, where optimization is done over line segments through a vector of inputs in the n-dimensional parameter space. The evaluation results on the benchmark problems show that using this method improves the falsification performance by reducing the number of simulations necessary to falsify a specification. .
File Description: electronic
Access URL: https://research.chalmers.se/publication/526076
https://research.chalmers.se/publication/526076/file/526076_Fulltext.pdf
Database: SwePub
FullText Text:
  Availability: 0
CustomLinks:
  – Url: https://research.chalmers.se/publication/526076#
    Name: EDS - SwePub (s4221598)
    Category: fullText
    Text: View record in SwePub
  – Url: https://resolver.ebscohost.com/openurl?sid=EBSCO:edsswe&genre=article&issn=19374151&ISBN=&volume=41&issue=8&date=20220101&spage=2393&pages=2393-2406&title=IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems&atitle=Testing%20Cyber-Physical%20Systems%20Using%20a%20Line-Search%20Falsification%20Method&aulast=Ramezani%2C%20Zahra&id=DOI:10.1109/TCAD.2021.3110740
    Name: Full Text Finder
    Category: fullText
    Text: Full Text Finder
    Icon: https://imageserver.ebscohost.com/branding/images/FTF.gif
    MouseOverText: Full Text Finder
  – Url: https://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=EBSCO&SrcAuth=EBSCO&DestApp=WOS&ServiceName=TransferToWoS&DestLinkType=GeneralSearchSummary&Func=Links&author=Ramezani%20Z
    Name: ISI
    Category: fullText
    Text: Nájsť tento článok vo Web of Science
    Icon: https://imagesrvr.epnet.com/ls/20docs.gif
    MouseOverText: Nájsť tento článok vo Web of Science
Header DbId: edsswe
DbLabel: SwePub
An: edsswe.oai.research.chalmers.se.ad964328.36e8.45df.950b.86890dcfcec1
RelevancyScore: 1011
AccessLevel: 6
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 1011.01770019531
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Testing Cyber-Physical Systems Using a Line-Search Falsification Method
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Ramezani%2C+Zahra%22">Ramezani, Zahra</searchLink>, 1988<br /><searchLink fieldCode="AR" term="%22Claessen%2C+Koen%22">Claessen, Koen</searchLink>, 1975<br /><searchLink fieldCode="AR" term="%22Smallbone%2C+Nicholas%22">Smallbone, Nicholas</searchLink>, 1986<br /><searchLink fieldCode="AR" term="%22Fabian%2C+Martin%22">Fabian, Martin</searchLink>, 1960<br /><searchLink fieldCode="AR" term="%22Åkesson%2C+Knut%22">Åkesson, Knut</searchLink>, 1972
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <i>IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems</i>. 41(8):2393-2406
– Name: Subject
  Label: Subject Terms
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Optimization+methods%22">Optimization methods</searchLink><br /><searchLink fieldCode="DE" term="%22Testing%22">Testing</searchLink><br /><searchLink fieldCode="DE" term="%22Falsification%22">Falsification</searchLink><br /><searchLink fieldCode="DE" term="%22Computational+modeling%22">Computational modeling</searchLink><br /><searchLink fieldCode="DE" term="%22Semantics%22">Semantics</searchLink><br /><searchLink fieldCode="DE" term="%22Additives%22">Additives</searchLink><br /><searchLink fieldCode="DE" term="%22Linear+programming%22">Linear programming</searchLink><br /><searchLink fieldCode="DE" term="%22Simulation-based+Optimization%2E%22">Simulation-based Optimization.</searchLink><br /><searchLink fieldCode="DE" term="%22Benchmark+testing%22">Benchmark testing</searchLink><br /><searchLink fieldCode="DE" term="%22Cyber-Physical+Systems%22">Cyber-Physical Systems</searchLink>
– Name: Abstract
  Label: Description
  Group: Ab
  Data: Cyber-physical systems (CPSs) are complex and exhibit both continuous and discrete dynamics, hence it is difficult to guarantee that they satisfy given specifications, i.e., the properties that must be fulfilled by the system. Falsification of temporal logic properties is a testing approach that searches for counterexamples of a given specification that can be used to increase the confidence that a CPS does fulfill its specifications. Falsification can be done using random search methods or optimization methods, both of which have their own benefits and drawbacks. This paper introduces two methods that exploit randomness to different degrees: the optimization-free Hybrid-Corner-Random (), and the direct-search method Line-search Falsification (). combines randomly chosen parameter values with extreme parameter values, which performs surprisingly well on benchmark evaluations. The gradient-free optimization-based LSF optimizes over line segments through a vector of inputs in the n-dimensional parameter space. The two methods are compared to the Nelder-Mead and SNOBFIT methods, using a well-known set of benchmark problems and shows better performance than any of the evaluated methods. Falsification can be done using random search methods or optimization methods. This paper proposes a method based on combining randomly chosen parameter values with parameter extreme values. Evaluation results on benchmark problems show that this method performs well on many of the problems. Optimization-based methods are needed when optimization-free methods do not perform well in falsification. The efficiency of the falsification is affected by the optimization methods used to search for inputs that might falsify the specifications. This paper presents a new optimization method for falsification, Line-search Falsification, where optimization is done over line segments through a vector of inputs in the n-dimensional parameter space. The evaluation results on the benchmark problems show that using this method improves the falsification performance by reducing the number of simulations necessary to falsify a specification. .
– Name: Format
  Label: File Description
  Group: SrcInfo
  Data: electronic
– Name: URL
  Label: Access URL
  Group: URL
  Data: <link linkTarget="URL" linkTerm="https://research.chalmers.se/publication/526076" linkWindow="_blank">https://research.chalmers.se/publication/526076</link><br /><link linkTarget="URL" linkTerm="https://research.chalmers.se/publication/526076/file/526076_Fulltext.pdf" linkWindow="_blank">https://research.chalmers.se/publication/526076/file/526076_Fulltext.pdf</link>
PLink https://erproxy.cvtisr.sk/sfx/access?url=https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=edsswe&AN=edsswe.oai.research.chalmers.se.ad964328.36e8.45df.950b.86890dcfcec1
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1109/TCAD.2021.3110740
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 14
        StartPage: 2393
    Subjects:
      – SubjectFull: Optimization methods
        Type: general
      – SubjectFull: Testing
        Type: general
      – SubjectFull: Falsification
        Type: general
      – SubjectFull: Computational modeling
        Type: general
      – SubjectFull: Semantics
        Type: general
      – SubjectFull: Additives
        Type: general
      – SubjectFull: Linear programming
        Type: general
      – SubjectFull: Simulation-based Optimization.
        Type: general
      – SubjectFull: Benchmark testing
        Type: general
      – SubjectFull: Cyber-Physical Systems
        Type: general
    Titles:
      – TitleFull: Testing Cyber-Physical Systems Using a Line-Search Falsification Method
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Ramezani, Zahra
      – PersonEntity:
          Name:
            NameFull: Claessen, Koen
      – PersonEntity:
          Name:
            NameFull: Smallbone, Nicholas
      – PersonEntity:
          Name:
            NameFull: Fabian, Martin
      – PersonEntity:
          Name:
            NameFull: Åkesson, Knut
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 01
              Type: published
              Y: 2022
          Identifiers:
            – Type: issn-print
              Value: 19374151
            – Type: issn-print
              Value: 02780070
            – Type: issn-locals
              Value: SWEPUB_FREE
            – Type: issn-locals
              Value: CTH_SWEPUB
          Numbering:
            – Type: volume
              Value: 41
            – Type: issue
              Value: 8
          Titles:
            – TitleFull: IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems
              Type: main
ResultId 1