A systems approach to risk management through leading safety indicators
The goal of leading indicators for safety is to identify the potential for an accident before it occurs. Past efforts have focused on identifying general leading indicators, such as maintenance backlog, that apply widely in an industry or even across industries. Other recommendations produce more sy...
Saved in:
| Published in: | Reliability engineering & system safety Vol. 136; pp. 17 - 34 |
|---|---|
| Main Author: | |
| Format: | Journal Article |
| Language: | English |
| Published: |
Elsevier Ltd
01.04.2015
|
| Subjects: | |
| ISSN: | 0951-8320, 1879-0836 |
| Online Access: | Get full text |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| Abstract | The goal of leading indicators for safety is to identify the potential for an accident before it occurs. Past efforts have focused on identifying general leading indicators, such as maintenance backlog, that apply widely in an industry or even across industries. Other recommendations produce more system-specific leading indicators, but start from system hazard analysis and thus are limited by the causes considered by the traditional hazard analysis techniques. Most rely on quantitative metrics, often based on probabilistic risk assessments. This paper describes a new and different approach to identifying system-specific leading indicators and provides guidance in designing a risk management structure to generate, monitor and use the results. The approach is based on the STAMP (System-Theoretic Accident Model and Processes) model of accident causation and tools that have been designed to build on that model. STAMP extends current accident causality to include more complex causes than simply component failures and chains of failure events or deviations from operational expectations. It incorporates basic principles of systems thinking and is based on systems theory rather than traditional reliability theory.
•Much effort has gone into developing leading indicators with only limited success.•A systems-theoretic, assumption-based approach may be more successful.•Leading indicators are warning signals of an assumption’s changing vulnerability.•Heuristic biases can be controlled by using plausibility rather than likelihood. |
|---|---|
| AbstractList | The goal of leading indicators for safety is to identify the potential for an accident before it occurs. Past efforts have focused on identifying general leading indicators, such as maintenance backlog, that apply widely in an industry or even across industries. Other recommendations produce more system-specific leading indicators, but start from system hazard analysis and thus are limited by the causes considered by the traditional hazard analysis techniques. Most rely on quantitative metrics, often based on probabilistic risk assessments. This paper describes a new and different approach to identifying system-specific leading indicators and provides guidance in designing a risk management structure to generate, monitor and use the results. The approach is based on the STAMP (System-Theoretic Accident Model and Processes) model of accident causation and tools that have been designed to build on that model. STAMP extends current accident causality to include more complex causes than simply component failures and chains of failure events or deviations from operational expectations. It incorporates basic principles of systems thinking and is based on systems theory rather than traditional reliability theory.
•Much effort has gone into developing leading indicators with only limited success.•A systems-theoretic, assumption-based approach may be more successful.•Leading indicators are warning signals of an assumption’s changing vulnerability.•Heuristic biases can be controlled by using plausibility rather than likelihood. The goal of leading indicators for safety is to identify the potential for an accident before it occurs. Past efforts have focused on identifying general leading indicators, such as maintenance backlog, that apply widely in an industry or even across industries. Other recommendations produce more system-specific leading indicators, but start from system hazard analysis and thus are limited by the causes considered by the traditional hazard analysis techniques. Most rely on quantitative metrics, often based on probabilistic risk assessments. This paper describes a new and different approach to identifying system-specific leading indicators and provides guidance in designing a risk management structure to generate, monitor and use the results. The approach is based on the STAMP (System-Theoretic Accident Model and Processes) model of accident causation and tools that have been designed to build on that model. STAMP extends current accident causality to include more complex causes than simply component failures and chains of failure events or deviations from operational expectations. It incorporates basic principles of systems thinking and is based on systems theory rather than traditional reliability theory. |
| Author | Leveson, Nancy |
| Author_xml | – sequence: 1 givenname: Nancy surname: Leveson fullname: Leveson, Nancy email: leveson@mit.edu organization: Aeronautics and Astronautics, Engineering Systems, MIT, Cambridge, MA, USA |
| BookMark | eNqNkE1rGzEQhkVJoU7SP9CTjr2sO1qttCvoJYR8FAK5JGcxlsa23F3JleSA_33WuKceQk8DL-8zzDyX7CKmSIx9E7AUIPSP3TJTKcsWRDcHS4DhE1uIoTcNDFJfsAUYJZpBtvCFXZayA4DOqH7BHm54OZZKU-G43-eEbstr4jmU33zCiBuaKFZetzkdNls-EvoQN7zgmuqRh-iDw5pyuWaf1zgW-vp3XrHX-7uX28fm6fnh1-3NU-M6qWujV9qhk8p4JX1LgwPANTijlOwMerNyvVa4kqio7Ve-9SBVb5xWGkmgA3nFvp_3zrf-OVCpdgrF0ThipHQoVui-N_PPRv5PVcpBy7abq8O56nIqJdPaulCxhhRrxjBaAfak2e7sSbM9aT5ls-YZbf9B9zlMmI8fQz_PEM2q3gJlW1yg6MiHTK5an8JH-Dsm4plu |
| CitedBy_id | crossref_primary_10_1080_00140139_2022_2107709 crossref_primary_10_1080_00140139_2025_2546521 crossref_primary_10_1016_j_ssci_2024_106433 crossref_primary_10_1007_s00521_022_08170_9 crossref_primary_10_1016_j_epsr_2025_111534 crossref_primary_10_1108_JRF_06_2021_0102 crossref_primary_10_1016_j_ssci_2020_104762 crossref_primary_10_1016_j_ssci_2015_10_005 crossref_primary_10_1016_j_psep_2023_10_062 crossref_primary_10_1108_JFM_11_2017_0058 crossref_primary_10_1108_JFC_02_2017_0011 crossref_primary_10_1016_j_jlp_2021_104392 crossref_primary_10_1016_j_ssci_2017_12_018 crossref_primary_10_1016_j_psep_2024_04_110 crossref_primary_10_1016_j_ssci_2022_105739 crossref_primary_10_1016_j_ress_2022_108397 crossref_primary_10_1016_j_ssci_2018_04_013 crossref_primary_10_1080_09617353_2019_1709289 crossref_primary_10_1016_j_ress_2020_107186 crossref_primary_10_1007_s10694_025_01745_7 crossref_primary_10_1007_s11948_016_9777_y crossref_primary_10_1007_s13198_021_01373_8 crossref_primary_10_1016_j_jsr_2022_10_013 crossref_primary_10_1051_matecconf_202031401001 crossref_primary_10_3390_jmse7040096 crossref_primary_10_1016_j_oceaneng_2022_111133 crossref_primary_10_1016_j_ssci_2020_104939 crossref_primary_10_3390_systems8030033 crossref_primary_10_1016_j_trpro_2017_03_005 crossref_primary_10_1111_risa_13803 crossref_primary_10_1177_0143831X251332174 crossref_primary_10_30657_pea_2017_17_04 crossref_primary_10_3390_su14094937 crossref_primary_10_1007_s11668_020_00830_z crossref_primary_10_1016_j_apergo_2018_04_012 crossref_primary_10_1016_j_forsciint_2015_10_007 crossref_primary_10_1016_j_ress_2017_08_003 crossref_primary_10_1016_j_psep_2022_02_050 crossref_primary_10_1016_j_ssci_2025_106817 crossref_primary_10_1016_j_ssci_2023_106139 crossref_primary_10_1080_00140139_2015_1075067 crossref_primary_10_1016_j_ssci_2021_105327 crossref_primary_10_7202_1059468ar crossref_primary_10_1016_j_ress_2019_03_038 crossref_primary_10_1016_j_ssci_2018_08_028 crossref_primary_10_1109_TAC_2019_2898167 crossref_primary_10_3390_buildings9040089 crossref_primary_10_1016_j_ssci_2019_07_002 crossref_primary_10_1177_1748006X18807785 crossref_primary_10_1016_j_psep_2019_11_027 crossref_primary_10_1007_s42461_021_00444_5 crossref_primary_10_1016_j_ssci_2020_104864 crossref_primary_10_3390_safety4020019 crossref_primary_10_1177_10711813251367368 crossref_primary_10_1016_j_ssci_2024_106530 crossref_primary_10_1016_j_ress_2018_10_009 crossref_primary_10_1061__ASCE_CF_1943_5509_0001406 crossref_primary_10_1016_j_drugpo_2023_104019 crossref_primary_10_1016_j_jlp_2023_105064 crossref_primary_10_1016_j_ssci_2016_09_017 crossref_primary_10_1177_0954410020953045 crossref_primary_10_1016_j_ssci_2018_06_001 crossref_primary_10_3390_pr7110849 crossref_primary_10_3390_w15213848 crossref_primary_10_3390_su16146024 crossref_primary_10_1016_j_ress_2016_11_024 crossref_primary_10_1016_j_ssci_2018_02_034 crossref_primary_10_1051_matecconf_201927302010 crossref_primary_10_1016_j_ress_2017_05_037 crossref_primary_10_1016_j_jlp_2024_105418 crossref_primary_10_3390_systems9020040 crossref_primary_10_1016_j_jlp_2022_104880 crossref_primary_10_1016_j_ssci_2021_105195 crossref_primary_10_1177_1748006X221099094 crossref_primary_10_3390_safety9030062 crossref_primary_10_1016_j_jlp_2018_05_019 crossref_primary_10_1016_j_ssci_2021_105596 crossref_primary_10_1016_j_jlp_2018_05_018 crossref_primary_10_1016_j_ssci_2021_105466 crossref_primary_10_1016_j_ress_2020_107352 crossref_primary_10_1080_00140139_2025_2473036 crossref_primary_10_1002_j_2334_5837_2017_00372_x crossref_primary_10_1016_j_oceaneng_2025_121000 crossref_primary_10_1002_j_2334_5837_2020_00816_x crossref_primary_10_3390_jmse13061058 crossref_primary_10_1016_j_jclepro_2021_130249 crossref_primary_10_1016_j_ress_2019_106626 crossref_primary_10_1016_j_ssci_2018_08_001 crossref_primary_10_1016_j_ress_2021_108062 crossref_primary_10_1016_j_ssci_2022_105929 crossref_primary_10_1002_prs_12002 crossref_primary_10_1016_j_apor_2019_04_020 crossref_primary_10_1016_j_ress_2017_05_002 crossref_primary_10_1016_j_egypro_2016_09_200 crossref_primary_10_3390_su14031550 crossref_primary_10_1177_03611981211062893 crossref_primary_10_1016_j_jlp_2021_104639 crossref_primary_10_1016_j_oceaneng_2022_111740 crossref_primary_10_1016_j_ress_2017_05_009 crossref_primary_10_3390_app132011132 crossref_primary_10_1016_j_nxener_2025_100372 crossref_primary_10_1061__ASCE_ME_1943_5479_0000546 crossref_primary_10_3390_buildings11110531 crossref_primary_10_1016_j_oceaneng_2023_116073 crossref_primary_10_1016_j_jsr_2024_08_015 crossref_primary_10_1016_j_ssci_2023_106235 crossref_primary_10_1027_2192_0923_a000204 crossref_primary_10_1016_j_ssci_2023_106234 crossref_primary_10_1016_j_ress_2023_109445 crossref_primary_10_1016_j_smrv_2018_08_006 crossref_primary_10_1016_j_apergo_2020_103190 crossref_primary_10_1016_j_jinse_2024_11_001 crossref_primary_10_1051_matecconf_201927302008 crossref_primary_10_1016_j_jsr_2018_11_006 crossref_primary_10_1080_00207543_2024_2381224 crossref_primary_10_1016_j_psep_2024_04_030 crossref_primary_10_1016_j_ress_2016_03_002 crossref_primary_10_1016_j_ress_2024_110569 crossref_primary_10_1016_j_psep_2015_02_003 crossref_primary_10_1088_1742_6596_2875_1_012023 crossref_primary_10_1016_j_jsr_2023_04_005 crossref_primary_10_1061__ASCE_CO_1943_7862_0001626 crossref_primary_10_1016_j_jlp_2020_104062 crossref_primary_10_3390_pr13020392 crossref_primary_10_3390_systems13060444 crossref_primary_10_1016_j_ssci_2017_01_009 crossref_primary_10_1016_j_ssci_2021_105250 crossref_primary_10_1371_journal_pone_0270529 crossref_primary_10_1016_j_ast_2024_109708 crossref_primary_10_3390_app15179802 crossref_primary_10_1016_j_aquaculture_2021_737143 crossref_primary_10_1016_j_jlp_2025_105731 crossref_primary_10_1016_j_psep_2023_03_076 crossref_primary_10_1016_j_ssci_2021_105255 crossref_primary_10_1108_IJBPA_05_2022_0072 crossref_primary_10_1016_j_psep_2019_05_047 crossref_primary_10_1016_j_psep_2024_11_117 crossref_primary_10_1016_j_jrtpm_2021_100238 crossref_primary_10_1051_matecconf_20166600004 crossref_primary_10_3390_su14106258 crossref_primary_10_1016_j_ress_2020_107255 crossref_primary_10_1080_09617353_2020_1712918 crossref_primary_10_1109_TITS_2024_3513717 crossref_primary_10_3390_jmse12071129 crossref_primary_10_1016_j_psep_2021_02_035 crossref_primary_10_31893_multirev_2025212 crossref_primary_10_1016_j_ress_2017_05_022 crossref_primary_10_1007_s42454_019_00001_y crossref_primary_10_1007_s12217_021_09871_x crossref_primary_10_1177_23998083221075639 crossref_primary_10_1016_j_tifs_2019_07_040 crossref_primary_10_1016_j_oceaneng_2023_114673 crossref_primary_10_1080_10803548_2022_2111893 crossref_primary_10_4028_www_scientific_net_JERA_34_139 crossref_primary_10_1016_j_ress_2025_111311 crossref_primary_10_1109_JSYST_2020_3019041 crossref_primary_10_1016_j_physa_2022_128404 crossref_primary_10_1080_1463922X_2018_1510061 crossref_primary_10_1021_acsestwater_5c00410 crossref_primary_10_1080_00140139_2019_1646925 crossref_primary_10_1016_j_oceaneng_2025_121213 crossref_primary_10_1016_j_robot_2020_103705 crossref_primary_10_1016_j_ssci_2017_12_036 crossref_primary_10_1016_j_ssci_2024_106603 crossref_primary_10_1080_00140139_2020_1823489 crossref_primary_10_1186_s13012_017_0695_4 crossref_primary_10_3390_su11092606 crossref_primary_10_60027_ijsasr_2025_7041 crossref_primary_10_1108_JMLC_02_2017_0006 crossref_primary_10_1016_j_ssci_2019_02_013 crossref_primary_10_1016_j_ress_2020_106909 crossref_primary_10_1016_j_ssci_2018_07_015 crossref_primary_10_1038_s41598_023_29795_3 crossref_primary_10_3390_pr7020073 crossref_primary_10_1109_ACCESS_2024_3429568 crossref_primary_10_1016_j_ssci_2021_105393 crossref_primary_10_1007_s10111_017_0437_z crossref_primary_10_1016_j_jlp_2015_12_020 crossref_primary_10_1016_j_ssci_2017_03_012 crossref_primary_10_1016_j_jsr_2019_04_002 crossref_primary_10_1016_j_ress_2016_08_004 crossref_primary_10_1016_j_ssci_2022_105850 crossref_primary_10_1016_j_ress_2021_107610 crossref_primary_10_1080_01446193_2022_2124527 crossref_primary_10_1111_risa_12867 crossref_primary_10_3846_aviation_2021_15660 crossref_primary_10_3390_su14105869 |
| Cites_doi | 10.1037/h0034747 10.1126/science.7455683 10.1007/978-1-4899-0445-4_9 10.1111/j.1539-6924.1996.tb01096.x 10.1016/S0925-7535(97)00052-0 10.1016/j.ress.2006.09.025 10.4043/15194-MS 10.1016/j.ssci.2013.03.013 10.1016/j.ssci.2010.05.012 10.1016/S0925-7535(03)00047-X 10.1016/j.ssci.2010.05.015 10.1504/IJRAM.2007.011990 10.1109/32.825764 10.1109/TNS.1979.4330198 10.1126/science.185.4157.1124 10.1016/j.ssci.2010.05.016 10.1111/j.1539-6924.1986.tb00210.x 10.1016/j.ssci.2008.07.037 10.1016/S0925-7535(00)00012-6 10.1149/MA2013-01/18/787 10.1016/0010-0285(73)90033-9 |
| ContentType | Journal Article |
| Copyright | 2014 Elsevier Ltd |
| Copyright_xml | – notice: 2014 Elsevier Ltd |
| DBID | AAYXX CITATION 7T2 7U1 C1K 7TB 8FD FR3 |
| DOI | 10.1016/j.ress.2014.10.008 |
| DatabaseName | CrossRef Health and Safety Science Abstracts (Full archive) Risk Abstracts Environmental Sciences and Pollution Management Mechanical & Transportation Engineering Abstracts Technology Research Database Engineering Research Database |
| DatabaseTitle | CrossRef Risk Abstracts Health & Safety Science Abstracts Environmental Sciences and Pollution Management Technology Research Database Mechanical & Transportation Engineering Abstracts Engineering Research Database |
| DatabaseTitleList | Technology Research Database Risk Abstracts |
| DeliveryMethod | fulltext_linktorsrc |
| Discipline | Engineering |
| EISSN | 1879-0836 |
| EndPage | 34 |
| ExternalDocumentID | 10_1016_j_ress_2014_10_008 S0951832014002488 |
| GroupedDBID | --K --M .~1 0R~ 123 1B1 1~. 1~5 29P 4.4 457 4G. 5VS 7-5 71M 8P~ 9JN 9JO AABNK AACTN AAEDT AAEDW AAFJI AAIAV AAIKJ AAKOC AALRI AAOAW AAQFI AAQXK AAXUO ABEFU ABFNM ABJNI ABMAC ABMMH ABTAH ABXDB ABYKQ ACDAQ ACGFS ACIWK ACNNM ACRLP ADBBV ADEZE ADMUD ADTZH AEBSH AECPX AEKER AENEX AFKWA AFRAH AFTJW AGHFR AGUBO AGYEJ AHHHB AHJVU AIEXJ AIKHN AITUG AJBFU AJOXV AKYCK ALMA_UNASSIGNED_HOLDINGS AMFUW AMRAJ AOMHK ASPBG AVARZ AVWKF AXJTR AZFZN BJAXD BKOJK BLXMC CS3 DU5 EBS EFJIC EFLBG EJD EO8 EO9 EP2 EP3 FDB FEDTE FGOYB FIRID FNPLU FYGXN G-2 G-Q GBLVA HVGLF HZ~ IHE J1W JJJVA KOM LY7 M41 MO0 N9A O-L O9- OAUVE OZT P-8 P-9 P2P PC. PRBVW Q38 R2- RIG ROL RPZ SDF SDG SES SET SEW SPC SPCBC SSB SSO SST SSZ T5K TN5 WUQ XPP ZMT ZY4 ~G- 9DU AATTM AAXKI AAYWO AAYXX ABWVN ACLOT ACRPL ACVFH ADCNI ADNMO AEIPS AEUPX AFJKZ AFPUW AGQPQ AIGII AIIUN AKBMS AKRWK AKYEP ANKPU APXCP CITATION EFKBS ~HD 7T2 7U1 C1K 7TB 8FD FR3 |
| ID | FETCH-LOGICAL-c436t-6b6cac359d53d2e8c00af0c955349ad9bc765ab3a5e27bd2d03579c656ae1ac03 |
| ISICitedReferencesCount | 217 |
| ISICitedReferencesURI | http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000349737800003&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| ISSN | 0951-8320 |
| IngestDate | Sat Sep 27 19:38:37 EDT 2025 Tue Oct 07 09:37:16 EDT 2025 Tue Nov 18 22:30:57 EST 2025 Sat Nov 29 01:49:47 EST 2025 Fri Feb 23 02:28:02 EST 2024 |
| IsDoiOpenAccess | false |
| IsOpenAccess | true |
| IsPeerReviewed | true |
| IsScholarly | true |
| Keywords | System safety Process safety STAMP Leading indicators Risk management STPA |
| Language | English |
| LinkModel | OpenURL |
| MergedId | FETCHMERGED-LOGICAL-c436t-6b6cac359d53d2e8c00af0c955349ad9bc765ab3a5e27bd2d03579c656ae1ac03 |
| Notes | ObjectType-Article-1 SourceType-Scholarly Journals-1 ObjectType-Feature-2 content type line 23 |
| PQID | 1673386324 |
| PQPubID | 23462 |
| PageCount | 18 |
| ParticipantIDs | proquest_miscellaneous_1677908393 proquest_miscellaneous_1673386324 crossref_citationtrail_10_1016_j_ress_2014_10_008 crossref_primary_10_1016_j_ress_2014_10_008 elsevier_sciencedirect_doi_10_1016_j_ress_2014_10_008 |
| PublicationCentury | 2000 |
| PublicationDate | 2015-04-01 |
| PublicationDateYYYYMMDD | 2015-04-01 |
| PublicationDate_xml | – month: 04 year: 2015 text: 2015-04-01 day: 01 |
| PublicationDecade | 2010 |
| PublicationTitle | Reliability engineering & system safety |
| PublicationYear | 2015 |
| Publisher | Elsevier Ltd |
| Publisher_xml | – name: Elsevier Ltd |
| References | Tversky, Kahneman (bib41) 1981 The BP Grangemouth Major Incident Investigation Report, UK Health and Safety Executive; August 2003. Georges, Stephanie. A system theoretic approach for determining causal factors of quality loss in complex system design. MIT SM thesis. Engineering Systems Division; February 2013. (bib6) 2012 Bundesstelle fur Flugunfalluntersuchung, investigation report, German Federal Bureau of Aircraft Accidents Investigation; May 2004. Leveson (bib4) 2012 Khawaji Ibrahim. Developing system-based leading indicators for proactive risk management in the chemical processing industry. SM thesis. MIT, 2012. American Bureau of Shipping, Safety culture and leading indicators of safety; January 2012, Houston TX. (bib8) 2001 (bib9) 2007 Nuclear Regulatory Commission, Glossary Andrew Rae, John McDermid, Rob Alexander. The science and superstition of quantitative risk assessment. In: Proceedings of probabilistic safety assessment and management (PSAM) conference 11, international association for probabilistic safety assessment and management (IAPSAM), Helsinki; June 2012. p. 2292–2301. Follensbee, Robert E. Six recent accidents/incidents where the probability of occurrence calculates to less than 10 Guide to report process safety incidents, the American Petroleum Institute; 2008. Tamuz (bib22) 2004 Bagian (bib20) 2004 Shanks, Earl, Andrew Dykes, Marc Quilici, John Pruitt, Deepwater BOP control systems—a look at reliability issues. In: Paper OTC 15194, offshore technology conference; 2003. Murphy, Patè-Cornell (bib28) 1996; 16 Leveson NG, Reese Jon D. TCAS intent specification Sattison (bib24) 2004 Oien, Utne, Tinmannsvik, Massaiu (bib27) 2011; 49 Leveson (bib45) 2007; vol. 2 Process safety performance indicators for the refining and petrochemical industries, the American Petroleum Institute, ANSI/API 754, First Edition; April 2010. Oien, Utne, Herrera (bib30) 2011; 49 Hale, Ale, Goossens, Heijer, Bellamy, Mud (bib29) 2007; 92 Samadi Jaleh. Development of a systematic risk management approach for CO , . Leveson (bib35) 1995 Leveson (bib3) 2004; 42 Corcoran (bib21) 2004 Retrieved 2013-01-2. Leveson (bib49) 2000; SE-26 (bib10) 2008 (bib13) 2008 Hudson (bib31) 2009; 47 Lewis, Budnitz, Rowe, Kouts, von Hippel, Loewenstein (bib34) 1979; 26 Dokas, Feehan, Syed (bib53) 2013; 58 CBS News, Oil blowout preventers known to fail Step-by-step guide to developing process safety performance indicators, UK Health and Safety Executive, HSG254; 2006. Dewar (bib44) 2002 Pate-Cornell ME. Warning systems in risk management, Risk Anal, 5(2): 223-234 Rasmussen (bib2) 1997; 27 Flin, Mearns, O’Connor, Bryden (bib26) 2000; 34 Kahneman, Tversky (bib38) 1973; 80 van der Schaaf, Kanse (bib52) 2004 Guidance on developing safety performance indicators, OECD working group on chemical accidents; 2003. 1993. May 8, 2010. Kahneman, Slovic, Tversky (bib42) 1982 Slovic, Fischhoff, Lichtenstein (bib43) 1980 Tversky, Kahneman (bib40) 1974; 185 Process safety management of highly hazardous chemicals regulation, The U.S. Occupational Safety and Health Administration (OSHA), Title 29 of CFR Section 1910.119; 1991. Leading performance indicators: a guide for effective use, step-change in safety; 2001. Kongvik, Almklov, Fenstad (bib25) 2010; 48 Matthew Wald, Jad Mouwad. Protracted fire inquiry keeping 787 on ground, New York Times. Leveson NG, Dulac N, Cutcher-Gershenfeld J, Barrett B, Carroll J, Zipkin, D, et al. Modeling, analyzing, and engineering safety culture. In: First international conference of the association for the advancement of space safety, Nice, Oct. 2005. 2014 capture, transport, and storage projects. Ph.D. dissertation. Ecole Nationale Superieure des Mines de Paris; December 2012. Functional safety: safety related systems, IEC 61511; 2008. 79. (bib11) 2010 Tversky, Kahneman (bib39) 1973 Manion (bib33) 2007; 7 Murphy (10.1016/j.ress.2014.10.008_bib28) 1996; 16 Leveson (10.1016/j.ress.2014.10.008_bib35) 1995 (10.1016/j.ress.2014.10.008_bib10) 2008 Tversky (10.1016/j.ress.2014.10.008_bib41) 1981 Slovic (10.1016/j.ress.2014.10.008_bib43) 1980 10.1016/j.ress.2014.10.008_bib23 Tversky (10.1016/j.ress.2014.10.008_bib40) 1974; 185 Flin (10.1016/j.ress.2014.10.008_bib26) 2000; 34 (10.1016/j.ress.2014.10.008_bib13) 2008 Leveson (10.1016/j.ress.2014.10.008_bib49) 2000; SE-26 Hale (10.1016/j.ress.2014.10.008_bib29) 2007; 92 (10.1016/j.ress.2014.10.008_bib9) 2007 Dewar (10.1016/j.ress.2014.10.008_bib44) 2002 Tversky (10.1016/j.ress.2014.10.008_bib39) 1973; 5 10.1016/j.ress.2014.10.008_bib32 Leveson (10.1016/j.ress.2014.10.008_bib4) 2012 Kongvik (10.1016/j.ress.2014.10.008_bib25) 2010; 48 (10.1016/j.ress.2014.10.008_bib8) 2001 Kahneman (10.1016/j.ress.2014.10.008_bib38) 1973; 80 10.1016/j.ress.2014.10.008_bib36 10.1016/j.ress.2014.10.008_bib37 (10.1016/j.ress.2014.10.008_bib11) 2010 10.1016/j.ress.2014.10.008_bib1 10.1016/j.ress.2014.10.008_bib5 Corcoran (10.1016/j.ress.2014.10.008_bib21) 2004 Leveson (10.1016/j.ress.2014.10.008_bib3) 2004; 42 10.1016/j.ress.2014.10.008_bib7 Lewis (10.1016/j.ress.2014.10.008_bib34) 1979; 26 Dokas (10.1016/j.ress.2014.10.008_bib53) 2013; 58 van der Schaaf (10.1016/j.ress.2014.10.008_bib52) 2004 10.1016/j.ress.2014.10.008_bib47 10.1016/j.ress.2014.10.008_bib48 Hudson (10.1016/j.ress.2014.10.008_bib31) 2009; 47 10.1016/j.ress.2014.10.008_bib46 Bagian (10.1016/j.ress.2014.10.008_bib20) 2004 10.1016/j.ress.2014.10.008_bib54 10.1016/j.ress.2014.10.008_bib55 Kahneman (10.1016/j.ress.2014.10.008_bib42) 1982 10.1016/j.ress.2014.10.008_bib50 10.1016/j.ress.2014.10.008_bib51 10.1016/j.ress.2014.10.008_bib18 10.1016/j.ress.2014.10.008_bib19 10.1016/j.ress.2014.10.008_bib16 10.1016/j.ress.2014.10.008_bib17 10.1016/j.ress.2014.10.008_bib14 10.1016/j.ress.2014.10.008_bib15 10.1016/j.ress.2014.10.008_bib12 10.1016/j.ress.2014.10.008_bib56 Rasmussen (10.1016/j.ress.2014.10.008_bib2) 1997; 27 Oien (10.1016/j.ress.2014.10.008_bib27) 2011; 49 Tamuz (10.1016/j.ress.2014.10.008_bib22) 2004 Manion (10.1016/j.ress.2014.10.008_bib33) 2007; 7 (10.1016/j.ress.2014.10.008_bib6) 2012 Sattison (10.1016/j.ress.2014.10.008_bib24) 2004 Leveson (10.1016/j.ress.2014.10.008_bib45) 2007; vol. 2 Oien (10.1016/j.ress.2014.10.008_bib30) 2011; 49 |
| References_xml | – reference: /; May 8, 2010. – volume: 185 start-page: 1124 year: 1974 end-page: 1131 ident: bib40 article-title: Judgment under uncertainty: heuristics and biases publication-title: Science – year: 2008 ident: bib13 article-title: Guidance on safety performance indicators – volume: 80 start-page: 237 year: 1973 end-page: 251 ident: bib38 article-title: On the psychology of prediction publication-title: Psychol Rev – reference: Georges, Stephanie. A system theoretic approach for determining causal factors of quality loss in complex system design. MIT SM thesis. Engineering Systems Division; February 2013. – reference: American Bureau of Shipping, Safety culture and leading indicators of safety; January 2012, Houston TX. – reference: , Retrieved 2013-01-2. – volume: 92 start-page: 1701 year: 2007 end-page: 1715 ident: bib29 article-title: Modeling accidents for prioritizing prevention publication-title: Reliab Eng Syst Saf – year: 2012 ident: bib4 article-title: Engineering a safer world: applying systems thinking to safety – start-page: 127 year: 2004 end-page: 136 ident: bib20 article-title: The opportunity of precursors publication-title: Accident precursor analysis and management: reducing technological risk through diligence – reference: capture, transport, and storage projects. Ph.D. dissertation. Ecole Nationale Superieure des Mines de Paris; December 2012. – start-page: 181 year: 1980 end-page: 216 ident: bib43 article-title: Facts and fears: understanding perceived risk publication-title: Soc Risk Assess – reference: CBS News, Oil blowout preventers known to fail, – year: 2007 ident: bib9 article-title: Center for chemical process safety center of chemical process safety, guidelines for risk based process safety – reference: Pate-Cornell ME. Warning systems in risk management, Risk Anal, 5(2): 223-234 – volume: 47 start-page: 483 year: 2009 end-page: 485 ident: bib31 article-title: Process indicators: managing safety by the numbers publication-title: Saf Sci – start-page: 127 year: 2004 end-page: 136 ident: bib22 article-title: Understanding accident precursors publication-title: Accident precursor analysis and management: reducing technological risk through diligence – volume: 27 start-page: 183 year: 1997 end-page: 213 ident: bib2 article-title: Risk management in a dynamic society: a modeling problem publication-title: Saf Sci – year: 1995 ident: bib35 article-title: Safeware – year: 2008 ident: bib10 article-title: Center for chemical process safety center of chemical process safety publication-title: Process Saf Lead Lagging Metrics – reference: Guide to report process safety incidents, the American Petroleum Institute; 2008. – start-page: 207 year: 1973 end-page: 232 ident: bib39 article-title: Availability: a heuristic for judging frequency and probability publication-title: Cogn Psychol – reference: Step-by-step guide to developing process safety performance indicators, UK Health and Safety Executive, HSG254; 2006. – year: 1982 ident: bib42 article-title: Judgment under uncertainty: heuristics and biases – reference: Process safety performance indicators for the refining and petrochemical industries, the American Petroleum Institute, ANSI/API 754, First Edition; April 2010. – reference: Follensbee, Robert E. Six recent accidents/incidents where the probability of occurrence calculates to less than 10 – start-page: 127 year: 2004 end-page: 136 ident: bib52 article-title: Checking for biases in incident reporting publication-title: Accident precursor analysis and management: Reducing technological risk through diligence – reference: Functional safety: safety related systems, IEC 61511; 2008. 79. – reference: Shanks, Earl, Andrew Dykes, Marc Quilici, John Pruitt, Deepwater BOP control systems—a look at reliability issues. In: Paper OTC 15194, offshore technology conference; 2003. – reference: Leveson NG, Dulac N, Cutcher-Gershenfeld J, Barrett B, Carroll J, Zipkin, D, et al. Modeling, analyzing, and engineering safety culture. In: First international conference of the association for the advancement of space safety, Nice, Oct. 2005. – reference: ; 2014 – year: 2001 ident: bib8 article-title: Center for chemical process safety center of chemical process safety, layer of protection analysis – volume: 42 year: 2004 ident: bib3 article-title: A new accident model for engineering safer systems publication-title: Saf Sci – year: 2002 ident: bib44 article-title: Assumption-based planning – volume: vol. 2 year: 2007 ident: bib45 article-title: Technical and managerial factors in the NASA Challenger and Columbia losses: looking forward to the future publication-title: Controversies in science and technology – reference: , – start-page: 127 year: 2004 end-page: 136 ident: bib24 article-title: Nuclear accident precursor assessment publication-title: Accident precursor analysis and management: reducing technological risk through diligence – year: 2012 ident: bib6 article-title: Leading indicators for occupational health and safety in mining – start-page: 127 year: 2004 end-page: 136 ident: bib21 article-title: Defining and analyzing precursors publication-title: Accident precursor analysis and management: reducing technological risk through diligence – volume: 16 start-page: 501 year: 1996 end-page: 515 ident: bib28 article-title: The SAM framework: modelling the effects of management factors on human behaviour in risk analysis publication-title: Risk Anal – reference: Matthew Wald, Jad Mouwad. Protracted fire inquiry keeping 787 on ground, New York Times. – volume: SE-26 year: 2000 ident: bib49 article-title: Intent specifications: an approach to building human-centered specifications publication-title: Trans Software Eng – volume: 34 start-page: 177 year: 2000 end-page: 192 ident: bib26 article-title: Measuring safety climate: identifying the common features publication-title: Saf Sci – volume: 26 start-page: 4686 year: 1979 end-page: 4690 ident: bib34 article-title: Risk assessment review group to the U.S. Nuclear Regulatory Commission publication-title: IEEE Trans Nucl Sci – reference: Process safety management of highly hazardous chemicals regulation, The U.S. Occupational Safety and Health Administration (OSHA), Title 29 of CFR Section 1910.119; 1991. – reference: ; 1993. – reference: Nuclear Regulatory Commission, Glossary, – reference: Bundesstelle fur Flugunfalluntersuchung, investigation report, German Federal Bureau of Aircraft Accidents Investigation; May 2004. – volume: 49 start-page: 148 year: 2011 end-page: 161 ident: bib30 article-title: Building safety indicators: Part 1—Theoretical foundation publication-title: Saf Sci – reference: Andrew Rae, John McDermid, Rob Alexander. The science and superstition of quantitative risk assessment. In: Proceedings of probabilistic safety assessment and management (PSAM) conference 11, international association for probabilistic safety assessment and management (IAPSAM), Helsinki; June 2012. p. 2292–2301. – volume: 48 start-page: 1402 year: 2010 end-page: 1411 ident: bib25 article-title: Organizational safety indicators: Some conceptual considerations and a supplementary qualitative approach publication-title: Saf Sci – reference: Leveson NG, Reese Jon D. TCAS intent specification, – year: 1981 ident: bib41 article-title: The framing of decisions and the psychology of choice publication-title: Science – volume: 58 start-page: 11 year: 2013 end-page: 26 ident: bib53 article-title: EWaSAP: an early warning sign identification approach based on a systemic hazard analysis publication-title: Saf Sci – reference: Samadi Jaleh. Development of a systematic risk management approach for CO – reference: . – reference: Guidance on developing safety performance indicators, OECD working group on chemical accidents; 2003. – reference: Khawaji Ibrahim. Developing system-based leading indicators for proactive risk management in the chemical processing industry. SM thesis. MIT, 2012. – reference: The BP Grangemouth Major Incident Investigation Report, UK Health and Safety Executive; August 2003. – reference: Leading performance indicators: a guide for effective use, step-change in safety; 2001. – year: 2010 ident: bib11 article-title: Center for chemical process safety center of chemical process safety, guidelines for process safety metrics – volume: 7 year: 2007 ident: bib33 article-title: The epistemology of fault tree analysis: an ethical critique publication-title: Int J Risk Assess Manage – volume: 49 start-page: 162 year: 2011 end-page: 171 ident: bib27 article-title: Building aafety indicators: Part 2—Application, practices, and results publication-title: Saf Sci – ident: 10.1016/j.ress.2014.10.008_bib15 – volume: 80 start-page: 237 issue: 4 year: 1973 ident: 10.1016/j.ress.2014.10.008_bib38 article-title: On the psychology of prediction publication-title: Psychol Rev doi: 10.1037/h0034747 – ident: 10.1016/j.ress.2014.10.008_bib1 – ident: 10.1016/j.ress.2014.10.008_bib47 – volume: vol. 2 year: 2007 ident: 10.1016/j.ress.2014.10.008_bib45 article-title: Technical and managerial factors in the NASA Challenger and Columbia losses: looking forward to the future – ident: 10.1016/j.ress.2014.10.008_bib19 – ident: 10.1016/j.ress.2014.10.008_bib5 – year: 1981 ident: 10.1016/j.ress.2014.10.008_bib41 article-title: The framing of decisions and the psychology of choice publication-title: Science doi: 10.1126/science.7455683 – year: 2012 ident: 10.1016/j.ress.2014.10.008_bib6 – year: 2002 ident: 10.1016/j.ress.2014.10.008_bib44 – ident: 10.1016/j.ress.2014.10.008_bib14 – start-page: 181 year: 1980 ident: 10.1016/j.ress.2014.10.008_bib43 article-title: Facts and fears: understanding perceived risk publication-title: Soc Risk Assess doi: 10.1007/978-1-4899-0445-4_9 – ident: 10.1016/j.ress.2014.10.008_bib56 – volume: 16 start-page: 501 year: 1996 ident: 10.1016/j.ress.2014.10.008_bib28 article-title: The SAM framework: modelling the effects of management factors on human behaviour in risk analysis publication-title: Risk Anal doi: 10.1111/j.1539-6924.1996.tb01096.x – ident: 10.1016/j.ress.2014.10.008_bib18 – ident: 10.1016/j.ress.2014.10.008_bib46 – volume: 27 start-page: 183 issue: 2/3 year: 1997 ident: 10.1016/j.ress.2014.10.008_bib2 article-title: Risk management in a dynamic society: a modeling problem publication-title: Saf Sci doi: 10.1016/S0925-7535(97)00052-0 – year: 2010 ident: 10.1016/j.ress.2014.10.008_bib11 – volume: 92 start-page: 1701 year: 2007 ident: 10.1016/j.ress.2014.10.008_bib29 article-title: Modeling accidents for prioritizing prevention publication-title: Reliab Eng Syst Saf doi: 10.1016/j.ress.2006.09.025 – ident: 10.1016/j.ress.2014.10.008_bib48 doi: 10.4043/15194-MS – volume: 58 start-page: 11 year: 2013 ident: 10.1016/j.ress.2014.10.008_bib53 article-title: EWaSAP: an early warning sign identification approach based on a systemic hazard analysis publication-title: Saf Sci doi: 10.1016/j.ssci.2013.03.013 – year: 2008 ident: 10.1016/j.ress.2014.10.008_bib10 article-title: Center for chemical process safety center of chemical process safety publication-title: Process Saf Lead Lagging Metrics – start-page: 127 year: 2004 ident: 10.1016/j.ress.2014.10.008_bib24 article-title: Nuclear accident precursor assessment – volume: 49 start-page: 148 year: 2011 ident: 10.1016/j.ress.2014.10.008_bib30 article-title: Building safety indicators: Part 1—Theoretical foundation publication-title: Saf Sci doi: 10.1016/j.ssci.2010.05.012 – year: 1982 ident: 10.1016/j.ress.2014.10.008_bib42 – year: 2007 ident: 10.1016/j.ress.2014.10.008_bib9 – start-page: 127 year: 2004 ident: 10.1016/j.ress.2014.10.008_bib22 article-title: Understanding accident precursors – start-page: 127 year: 2004 ident: 10.1016/j.ress.2014.10.008_bib20 article-title: The opportunity of precursors – volume: 42 issue: 4 year: 2004 ident: 10.1016/j.ress.2014.10.008_bib3 article-title: A new accident model for engineering safer systems publication-title: Saf Sci doi: 10.1016/S0925-7535(03)00047-X – start-page: 127 year: 2004 ident: 10.1016/j.ress.2014.10.008_bib52 article-title: Checking for biases in incident reporting – ident: 10.1016/j.ress.2014.10.008_bib32 – ident: 10.1016/j.ress.2014.10.008_bib55 – ident: 10.1016/j.ress.2014.10.008_bib36 – ident: 10.1016/j.ress.2014.10.008_bib17 – volume: 49 start-page: 162 year: 2011 ident: 10.1016/j.ress.2014.10.008_bib27 article-title: Building aafety indicators: Part 2—Application, practices, and results publication-title: Saf Sci doi: 10.1016/j.ssci.2010.05.015 – volume: 7 issue: 3 year: 2007 ident: 10.1016/j.ress.2014.10.008_bib33 article-title: The epistemology of fault tree analysis: an ethical critique publication-title: Int J Risk Assess Manage doi: 10.1504/IJRAM.2007.011990 – volume: SE-26 issue: 1 year: 2000 ident: 10.1016/j.ress.2014.10.008_bib49 article-title: Intent specifications: an approach to building human-centered specifications publication-title: Trans Software Eng doi: 10.1109/32.825764 – start-page: 127 year: 2004 ident: 10.1016/j.ress.2014.10.008_bib21 article-title: Defining and analyzing precursors – ident: 10.1016/j.ress.2014.10.008_bib51 – ident: 10.1016/j.ress.2014.10.008_bib7 – volume: 26 start-page: 4686 issue: 5 year: 1979 ident: 10.1016/j.ress.2014.10.008_bib34 article-title: Risk assessment review group to the U.S. Nuclear Regulatory Commission publication-title: IEEE Trans Nucl Sci doi: 10.1109/TNS.1979.4330198 – ident: 10.1016/j.ress.2014.10.008_bib12 – volume: 185 start-page: 1124 issue: 4157 year: 1974 ident: 10.1016/j.ress.2014.10.008_bib40 article-title: Judgment under uncertainty: heuristics and biases publication-title: Science doi: 10.1126/science.185.4157.1124 – year: 2001 ident: 10.1016/j.ress.2014.10.008_bib8 – ident: 10.1016/j.ress.2014.10.008_bib16 – year: 1995 ident: 10.1016/j.ress.2014.10.008_bib35 – volume: 48 start-page: 1402 year: 2010 ident: 10.1016/j.ress.2014.10.008_bib25 article-title: Organizational safety indicators: Some conceptual considerations and a supplementary qualitative approach publication-title: Saf Sci doi: 10.1016/j.ssci.2010.05.016 – ident: 10.1016/j.ress.2014.10.008_bib23 doi: 10.1111/j.1539-6924.1986.tb00210.x – volume: 47 start-page: 483 year: 2009 ident: 10.1016/j.ress.2014.10.008_bib31 article-title: Process indicators: managing safety by the numbers publication-title: Saf Sci doi: 10.1016/j.ssci.2008.07.037 – volume: 34 start-page: 177 year: 2000 ident: 10.1016/j.ress.2014.10.008_bib26 article-title: Measuring safety climate: identifying the common features publication-title: Saf Sci doi: 10.1016/S0925-7535(00)00012-6 – ident: 10.1016/j.ress.2014.10.008_bib37 doi: 10.1149/MA2013-01/18/787 – ident: 10.1016/j.ress.2014.10.008_bib50 – year: 2008 ident: 10.1016/j.ress.2014.10.008_bib13 – volume: 5 start-page: 207 issue: 2 year: 1973 ident: 10.1016/j.ress.2014.10.008_bib39 article-title: Availability: a heuristic for judging frequency and probability publication-title: Cogn Psychol doi: 10.1016/0010-0285(73)90033-9 – ident: 10.1016/j.ress.2014.10.008_bib54 – year: 2012 ident: 10.1016/j.ress.2014.10.008_bib4 |
| SSID | ssj0004957 |
| Score | 2.5701516 |
| Snippet | The goal of leading indicators for safety is to identify the potential for an accident before it occurs. Past efforts have focused on identifying general... |
| SourceID | proquest crossref elsevier |
| SourceType | Aggregation Database Enrichment Source Index Database Publisher |
| StartPage | 17 |
| SubjectTerms | Accidents Causation Deviation Failure Hazards Indicators Leading indicators Mathematical models Process safety Risk management Safety STAMP STPA System safety |
| Title | A systems approach to risk management through leading safety indicators |
| URI | https://dx.doi.org/10.1016/j.ress.2014.10.008 https://www.proquest.com/docview/1673386324 https://www.proquest.com/docview/1677908393 |
| Volume | 136 |
| WOSCitedRecordID | wos000349737800003&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| journalDatabaseRights | – providerCode: PRVESC databaseName: Elsevier SD Freedom Collection Journals 2021 customDbUrl: eissn: 1879-0836 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0004957 issn: 0951-8320 databaseCode: AIEXJ dateStart: 19950101 isFulltext: true titleUrlDefault: https://www.sciencedirect.com providerName: Elsevier |
| link | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwtV1La9wwEBYl20NzKG3TkEdbVOhtcbAty5KOS0lflNBDEvYmZEmGhMS7xJuw_fcZWZK93ZAlOfRiFmFpbX_SaGb0zQxCX_Ka0UJpdz7IwUAxqU5UndGkyDW3iiqTd7UOz3-zkxM-nYo_odBl25UTYE3Dl0sx_69QQxuA7UJnnwF3Pyg0wG8AHa4AO1yfBPwkZGdu-3zhTr_sKOTXPdelr89z5Un041bVjrzpTrC1s8PbVa3V8ZZ9Pu-_YzskMOymjf-z0H-g99zZGMrlxPeqbwEgGigp0UmYJbDm03_kJVmVeD7yMuyd3i_5QCp7B8HlkXMgODZdcdQR6viwB8Vz97WtqScMRi7apXRjSDcGNMguzHuUMypAoI0mP4-nv4agWOHTvMZXCBFTnty3_iSPaSVr-3OndJy-Qa-DtYAnHuW36IVt3qHtlRySO-j7BAe8ccQbL2bY4Y0HvHHAGwe8sccLD3i_R2ffjk-__khCdYxEF6RcJGVValhkVBhKTG65TlNVp1pQSgqhjKg0K6mqiKI2Z5XJTUooExr0d2UzpVOyi7aaWWP3EFZ1JUzNuS0MWJeprXQFulNuNVWW1Ezsoyx-HalD6nhXweRKPo7LPhr3feY-ccrGu2n86DKofl6lkzCHNvb7HBGSIBfdYZdq7Oy2lVnJCOGuGMHGe5gAG0SQg2c97SF6NayWD2hrcXNrP6KX-m5x0d58ChPxHlXrlcs |
| linkProvider | Elsevier |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=A+systems+approach+to+risk+management+through+leading+safety+indicators&rft.jtitle=Reliability+engineering+%26+system+safety&rft.au=Leveson%2C+Nancy&rft.date=2015-04-01&rft.issn=0951-8320&rft.volume=136&rft.spage=17&rft.epage=34&rft_id=info:doi/10.1016%2Fj.ress.2014.10.008&rft.externalDBID=n%2Fa&rft.externalDocID=10_1016_j_ress_2014_10_008 |
| thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=0951-8320&client=summon |
| thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=0951-8320&client=summon |
| thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=0951-8320&client=summon |