Stability and reproducibility of semi-quantitative risk assessment methods within the occupational health and safety scope
In many enterprises the semi-quantitative approach turns out to be the available and most suitable technique to perform a risk assessment. Despite its advantages, we cannot disregard the existing gap in terms of validation of this type of applications. This paper reports a study about risk assessmen...
Gespeichert in:
| Veröffentlicht in: | Work (Reading, Mass.) Jg. 51; H. 3; S. 591 |
|---|---|
| Hauptverfasser: | , |
| Format: | Journal Article |
| Sprache: | Englisch |
| Veröffentlicht: |
Netherlands
15.07.2015
|
| Schlagworte: | |
| ISSN: | 1875-9270, 1875-9270 |
| Online-Zugang: | Weitere Angaben |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| Abstract | In many enterprises the semi-quantitative approach turns out to be the available and most suitable technique to perform a risk assessment. Despite its advantages, we cannot disregard the existing gap in terms of validation of this type of applications.
This paper reports a study about risk assessments' reliability, namely both inter-coder (reproducibility) and intra-coder (stability) reliability of the semi-quantitative approach.
This study comprised 4 fundamental stages. Data collection relied on free and systematized observations and made use of video recording, documental research, analysis grids and questionnaires specifically developed for this purpose. A set of different analysts were asked to use four semi-quantitative risk assessment methods (in two different moments) to estimate and assess six risks identified in two tasks accomplished to produce Airbags. The Krippendorff's Alpha Coefficient (α K) was the agreement measure selected to evaluate both inter-coder and intra-coder consensus.
The preliminary results revealed a general low concordance (α K < 0.6) for both reliability evaluations. Apparently there are no relevant differences between the risk assessment results obtained by individuals with different levels of experience or expertise.
This study revealed that the use of the semi-quantitative approach should be done with caution. |
|---|---|
| AbstractList | In many enterprises the semi-quantitative approach turns out to be the available and most suitable technique to perform a risk assessment. Despite its advantages, we cannot disregard the existing gap in terms of validation of this type of applications.
This paper reports a study about risk assessments' reliability, namely both inter-coder (reproducibility) and intra-coder (stability) reliability of the semi-quantitative approach.
This study comprised 4 fundamental stages. Data collection relied on free and systematized observations and made use of video recording, documental research, analysis grids and questionnaires specifically developed for this purpose. A set of different analysts were asked to use four semi-quantitative risk assessment methods (in two different moments) to estimate and assess six risks identified in two tasks accomplished to produce Airbags. The Krippendorff's Alpha Coefficient (α K) was the agreement measure selected to evaluate both inter-coder and intra-coder consensus.
The preliminary results revealed a general low concordance (α K < 0.6) for both reliability evaluations. Apparently there are no relevant differences between the risk assessment results obtained by individuals with different levels of experience or expertise.
This study revealed that the use of the semi-quantitative approach should be done with caution. In many enterprises the semi-quantitative approach turns out to be the available and most suitable technique to perform a risk assessment. Despite its advantages, we cannot disregard the existing gap in terms of validation of this type of applications.BACKGROUNDIn many enterprises the semi-quantitative approach turns out to be the available and most suitable technique to perform a risk assessment. Despite its advantages, we cannot disregard the existing gap in terms of validation of this type of applications.This paper reports a study about risk assessments' reliability, namely both inter-coder (reproducibility) and intra-coder (stability) reliability of the semi-quantitative approach.OBJECTIVEThis paper reports a study about risk assessments' reliability, namely both inter-coder (reproducibility) and intra-coder (stability) reliability of the semi-quantitative approach.This study comprised 4 fundamental stages. Data collection relied on free and systematized observations and made use of video recording, documental research, analysis grids and questionnaires specifically developed for this purpose. A set of different analysts were asked to use four semi-quantitative risk assessment methods (in two different moments) to estimate and assess six risks identified in two tasks accomplished to produce Airbags. The Krippendorff's Alpha Coefficient (α K) was the agreement measure selected to evaluate both inter-coder and intra-coder consensus.METHODSThis study comprised 4 fundamental stages. Data collection relied on free and systematized observations and made use of video recording, documental research, analysis grids and questionnaires specifically developed for this purpose. A set of different analysts were asked to use four semi-quantitative risk assessment methods (in two different moments) to estimate and assess six risks identified in two tasks accomplished to produce Airbags. The Krippendorff's Alpha Coefficient (α K) was the agreement measure selected to evaluate both inter-coder and intra-coder consensus.The preliminary results revealed a general low concordance (α K < 0.6) for both reliability evaluations. Apparently there are no relevant differences between the risk assessment results obtained by individuals with different levels of experience or expertise.RESULTSThe preliminary results revealed a general low concordance (α K < 0.6) for both reliability evaluations. Apparently there are no relevant differences between the risk assessment results obtained by individuals with different levels of experience or expertise.This study revealed that the use of the semi-quantitative approach should be done with caution.CONCLUSIONSThis study revealed that the use of the semi-quantitative approach should be done with caution. |
| Author | Carvalho, F Melo, R B |
| Author_xml | – sequence: 1 givenname: F surname: Carvalho fullname: Carvalho, F – sequence: 2 givenname: R B surname: Melo fullname: Melo, R B |
| BackLink | https://www.ncbi.nlm.nih.gov/pubmed/24939116$$D View this record in MEDLINE/PubMed |
| BookMark | eNpNkMtKxEAQRRsZcR668QOkl26i_UjSyVIGXzAg-MBlqCTVpDXpzqQ7yvj1Bh3BTd2iOByouyQz6ywScsrZhRRSXr4-PEY85pnKDshiiiTKhWKzf_ucLL1_Y4wJwfIjMhdxLnPO0wX5egpQmtaEHQVb0wH7wdVjZfY3p6nHzkTbEWwwAYL5QDoY_07Be_S-Qxtoh6FxtaefJjTG0tAgdVU19hPtLLS0QWhD8-P3oHHS-sr1eEwONbQeT_a5Ii8318_ru2jzcHu_vtpElYxViDRyDRKQ5UxBAhkvIY11nCLT-TSYkpAJlsRJrYFlWinBE16qVMuq0qzUYkXOf73Ta9sRfSg64ytsW7DoRl9wxVWsRJ6qCT3bo2PZYV30g-lg2BV_fYlvNZBw9A |
| CitedBy_id | crossref_primary_10_3233_WOR_220077 crossref_primary_10_1177_1535676019831915 |
| ContentType | Journal Article |
| DBID | CGR CUY CVF ECM EIF NPM 7X8 |
| DOI | 10.3233/WOR-141878 |
| DatabaseName | Medline MEDLINE MEDLINE (Ovid) MEDLINE MEDLINE PubMed MEDLINE - Academic |
| DatabaseTitle | MEDLINE Medline Complete MEDLINE with Full Text PubMed MEDLINE (Ovid) MEDLINE - Academic |
| DatabaseTitleList | MEDLINE MEDLINE - Academic |
| Database_xml | – sequence: 1 dbid: NPM name: PubMed url: http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed sourceTypes: Index Database – sequence: 2 dbid: 7X8 name: MEDLINE - Academic url: https://search.proquest.com/medline sourceTypes: Aggregation Database |
| DeliveryMethod | no_fulltext_linktorsrc |
| Discipline | Occupational Therapy & Rehabilitation |
| EISSN | 1875-9270 |
| ExternalDocumentID | 24939116 |
| Genre | Journal Article |
| GroupedDBID | --- --K 04C 0R~ 123 1B1 1KJ 29R 36B 4.4 53G 6PF 8V8 AAOTM AAQXI AAWTL ABUBZ ABUJY ACGFS ACPQW ADBBV ADOJX ADZMO AEMOZ AFRAH AFRHK AHDMH AHQJS AJNRN AKVCP ALMA_UNASSIGNED_HOLDINGS BMSDO CAG CGR COF CS3 CUY CVF EBA EBD EBO EBR EBS EBU ECF ECM ECT EDH EIF EIHBH EJD EMK EPL F5P HZ~ IHE IL9 IOS J8X K1G M41 MET MIO MV1 NGNOM NPM NQ- O9- P2P PQQKQ Q1R RIG ROL RPZ SAUOL SFC SKT TH9 WH7 WQ9 YCJ 7X8 AAPII AAZCK ACCVC AFYTF AJGYC AMNSR ARTOV SCNPE |
| ID | FETCH-LOGICAL-c347t-fe1fa3ae0907a5a81ba64f46e0f96e0073a820545dfa08f772151b76f3ccf0bf2 |
| IEDL.DBID | 7X8 |
| ISICitedReferencesCount | 2 |
| ISICitedReferencesURI | http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000359751100019&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| ISSN | 1875-9270 |
| IngestDate | Sat Sep 27 22:10:26 EDT 2025 Thu Apr 03 07:02:05 EDT 2025 |
| IsPeerReviewed | true |
| IsScholarly | true |
| Issue | 3 |
| Keywords | Krippendorff's alpha coefficient intra-coder assessment Reliability inter-coder assessment |
| Language | English |
| LinkModel | DirectLink |
| MergedId | FETCHMERGED-LOGICAL-c347t-fe1fa3ae0907a5a81ba64f46e0f96e0073a820545dfa08f772151b76f3ccf0bf2 |
| Notes | ObjectType-Article-1 SourceType-Scholarly Journals-1 ObjectType-Feature-2 content type line 23 |
| PMID | 24939116 |
| PQID | 1717472967 |
| PQPubID | 23479 |
| ParticipantIDs | proquest_miscellaneous_1717472967 pubmed_primary_24939116 |
| PublicationCentury | 2000 |
| PublicationDate | 2015-07-15 |
| PublicationDateYYYYMMDD | 2015-07-15 |
| PublicationDate_xml | – month: 07 year: 2015 text: 2015-07-15 day: 15 |
| PublicationDecade | 2010 |
| PublicationPlace | Netherlands |
| PublicationPlace_xml | – name: Netherlands |
| PublicationTitle | Work (Reading, Mass.) |
| PublicationTitleAlternate | Work |
| PublicationYear | 2015 |
| SSID | ssj0002209 |
| Score | 2.039601 |
| Snippet | In many enterprises the semi-quantitative approach turns out to be the available and most suitable technique to perform a risk assessment. Despite its... |
| SourceID | proquest pubmed |
| SourceType | Aggregation Database Index Database |
| StartPage | 591 |
| SubjectTerms | Female Humans Male Observer Variation Occupational Health Reproducibility of Results Risk Assessment - methods Safety |
| Title | Stability and reproducibility of semi-quantitative risk assessment methods within the occupational health and safety scope |
| URI | https://www.ncbi.nlm.nih.gov/pubmed/24939116 https://www.proquest.com/docview/1717472967 |
| Volume | 51 |
| WOSCitedRecordID | wos000359751100019&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| hasFullText | |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| link | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwpV3NS8MwFA_qPHjx-2N-EUG9BZumbdqTiDg86Bxj4m4lTRPowXazm6B_vS9J5-ZBELwEmtI0pC-vv_fy3u8hdM4kSAWXGWGS5iRQoSJCSdhXWmSMJXGWSEuZ_8C73Xg4THqNw61uwipnOtEq6rySxkd-RcHuCAAJRvx6NCamapQ5XW1KaCyjFgMoY0K6-HDOFu67EA8KmJwkPvccPSnzGbt6eeoTGsCd-HdoaX8xnY3_Tm4TrTfgEt84adhCS6rcRheLRMJ44FgE8CXu_-Do3kGfgDvt9QcWZY4N26Uhgy2avkrjWr0WZDwVpU1MAzWJTWA6Ft_kntjVo66x8e4WJQZwiavFt7usSzt-LbSCYW1WzC567twNbu9JU5mBSBbwCdGKasGE8sC0FqEA6CuiQAeR8nQCDagNAcgCwFmuhRdrQPAALDIeaSal9jLt76GVsirVAcJUeiwXzIoGDMFNKmyYw2LGFHql10ZnsyVPQfLNcYYoVTWt0_mit9G--27pyFF0pGBUMlDj0eEfnj5Ca4CCQuOwpeExamnY9-oErcr3SVG_nVqRgrbbe_wCWODbcA |
| linkProvider | ProQuest |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Stability+and+reproducibility+of+semi-quantitative+risk+assessment+methods+within+the+occupational+health+and+safety+scope&rft.jtitle=Work+%28Reading%2C+Mass.%29&rft.au=Carvalho%2C+F&rft.au=Melo%2C+R+B&rft.date=2015-07-15&rft.eissn=1875-9270&rft.volume=51&rft.issue=3&rft.spage=591&rft_id=info:doi/10.3233%2FWOR-141878&rft_id=info%3Apmid%2F24939116&rft_id=info%3Apmid%2F24939116&rft.externalDocID=24939116 |
| thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1875-9270&client=summon |
| thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1875-9270&client=summon |
| thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1875-9270&client=summon |