Coding ATC incident data using HFACS: Inter-coder consensus

► A reliability study was conducted on HFACS in the context of military air traffic control. ► The study tested inter-coder consensus in a real-world, small organisation environment. ► Two groups were tested on coding consensus: air traffic controllers and human factors specialists. ► Low consensus...

Celý popis

Uloženo v:
Podrobná bibliografie
Vydáno v:Safety science Ročník 49; číslo 10; s. 1365 - 1370
Hlavní autor: Olsen, Nikki S.
Médium: Journal Article
Jazyk:angličtina
Vydáno: Kidlington Elsevier India Pvt Ltd 01.12.2011
Elsevier
Témata:
ISSN:0925-7535, 1879-1042
On-line přístup:Získat plný text
Tagy: Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
Abstract ► A reliability study was conducted on HFACS in the context of military air traffic control. ► The study tested inter-coder consensus in a real-world, small organisation environment. ► Two groups were tested on coding consensus: air traffic controllers and human factors specialists. ► Low consensus was found at the category level of HFACS for both groups of participants. ► Doubt exists as to the reliability of HFACS taxonomic coding in real world small organisations. Reliability studies for coding contributing factors of incident reports in high hazard industries are rarely conducted and reported. Although the Human Factors Analysis and Classification System (HFACS) appears to have a larger number of such studies completed than most other systems doubt exists as the accuracy and comparability of results between studies due to aspects of methodology and reporting. This paper reports on a trial conducted on HFACS to determine its reliability in the context of military air traffic control (ATC). Two groups participated in the trial: one group comprised of specialists in the field of human factors and the other group comprised air traffic controllers. All participants were given standardised training via a self-paced workbook and then read 14 incident reports and coded the associated findings. The results show similarly low consensus for both groups of participants. Several reasons for the results are proposed associated with the HFACS model, the context within which incident reporting occurs in real organisations and the conduct of the studies.
AbstractList ► A reliability study was conducted on HFACS in the context of military air traffic control. ► The study tested inter-coder consensus in a real-world, small organisation environment. ► Two groups were tested on coding consensus: air traffic controllers and human factors specialists. ► Low consensus was found at the category level of HFACS for both groups of participants. ► Doubt exists as to the reliability of HFACS taxonomic coding in real world small organisations. Reliability studies for coding contributing factors of incident reports in high hazard industries are rarely conducted and reported. Although the Human Factors Analysis and Classification System (HFACS) appears to have a larger number of such studies completed than most other systems doubt exists as the accuracy and comparability of results between studies due to aspects of methodology and reporting. This paper reports on a trial conducted on HFACS to determine its reliability in the context of military air traffic control (ATC). Two groups participated in the trial: one group comprised of specialists in the field of human factors and the other group comprised air traffic controllers. All participants were given standardised training via a self-paced workbook and then read 14 incident reports and coded the associated findings. The results show similarly low consensus for both groups of participants. Several reasons for the results are proposed associated with the HFACS model, the context within which incident reporting occurs in real organisations and the conduct of the studies.
Reliability studies for coding contributing factors of incident reports in high hazard industries are rarely conducted and reported. Although the Human Factors Analysis and Classification System (HFACS) appears to have a larger number of such studies completed than most other systems doubt exists as the accuracy and comparability of results between studies due to aspects of methodology and reporting. This paper reports on a trial conducted on HFACS to determine its reliability in the context of military air traffic control (ATC). Two groups participated in the trial: one group comprised of specialists in the field of human factors and the other group comprised air traffic controllers. All participants were given standardised training via a self-paced workbook and then read 14 incident reports and coded the associated findings. The results show similarly low consensus for both groups of participants. Several reasons for the results are proposed associated with the HFACS model, the context within which incident reporting occurs in real organisations and the conduct of the studies.
Author Olsen, Nikki S.
Author_xml – sequence: 1
  givenname: Nikki S.
  surname: Olsen
  fullname: Olsen, Nikki S.
  email: Nikki.Olsen@defence.gov.au
  organization: Department of Aviation, The University of New South Wales, Kensington, Sydney, NSW 2052, Australia
BackLink http://pascal-francis.inist.fr/vibad/index.php?action=getRecordDetail&idt=24481241$$DView record in Pascal Francis
BookMark eNp9kD1LBDEQQIMoeH78AattxGrXfO9FbY7FU0GwUOsQZ2clx5pokhP89-5x2lhYDQzvDcw7ILshBiTkhNGGUabPV03O4BtOGWuoaihtd8iMzVtTMyr5LplRw1XdKqH2yUHOK0opE5rNyGUXex9eq8VTV_kAvsdQqt4VV63zZn-7XHSPF9VdKJhqiD2mCmLIGPI6H5G9wY0Zj3_mIXleXj91t_X9w81dt7ivQWheakeF4WwwRqB4cRJaIwbeS4UDIgUJ1AkNUgkjBGihUSAiONDMKSdkO4hDcra9-57ixxpzsW8-A46jCxjX2c6NYUpLoSfy9Id0Gdw4JDe9lO178m8ufVku5ZxxySZuvuUgxZwTDhZ8ccXHUJLzo2XUbrLald1ktZuslio7ZZ1U_kf9vf6vdLWVcMr06THZicAA2PuEUGwf_X_6N5PCkbA
CitedBy_id crossref_primary_10_1016_j_apergo_2017_03_014
crossref_primary_10_1016_j_aap_2016_08_023
crossref_primary_10_1080_10803548_2019_1693167
crossref_primary_10_1016_j_jlp_2021_104517
crossref_primary_10_3390_app9235049
crossref_primary_10_1016_j_apergo_2015_04_015
crossref_primary_10_1007_s40747_022_00657_1
crossref_primary_10_1016_j_apergo_2012_06_009
crossref_primary_10_1016_j_apergo_2017_04_014
crossref_primary_10_1080_19439962_2019_1583297
crossref_primary_10_3390_su151512065
crossref_primary_10_1080_00140139_2019_1694707
crossref_primary_10_1177_0018720816644872
crossref_primary_10_1007_s10111_017_0433_3
crossref_primary_10_1016_j_oceaneng_2018_04_086
crossref_primary_10_1080_1463922X_2021_1881653
crossref_primary_10_1016_j_ress_2025_111164
crossref_primary_10_1080_24721840_2023_2232387
crossref_primary_10_1016_j_ssci_2014_07_014
crossref_primary_10_1080_10803548_2022_2095778
crossref_primary_10_1016_j_ress_2022_108806
crossref_primary_10_1016_j_ssci_2015_09_028
crossref_primary_10_1016_j_ssci_2017_12_027
crossref_primary_10_1016_j_jairtraman_2023_102374
crossref_primary_10_1016_j_ssci_2021_105303
crossref_primary_10_1080_10803548_2017_1387400
crossref_primary_10_1080_1463922X_2016_1155240
crossref_primary_10_1002_hfm_20948
crossref_primary_10_3390_ijerph17114114
crossref_primary_10_3846_jcem_2018_1647
crossref_primary_10_1016_j_oceaneng_2021_110512
crossref_primary_10_1007_s10111_025_00834_5
crossref_primary_10_1016_j_oceaneng_2020_107992
crossref_primary_10_1016_j_jsr_2018_09_008
crossref_primary_10_1016_j_ergon_2021_103228
crossref_primary_10_3390_pr11041055
crossref_primary_10_1016_j_ress_2020_107395
Cites_doi 10.1016/j.amj.2006.03.003
10.1016/j.aap.2009.09.005
10.1518/001872007X312469
10.1037/0021-9010.77.2.161
10.3357/ASEM.2228.2008
10.1016/j.aap.2010.02.018
10.1016/j.ssci.2003.10.004
10.1192/bjp.130.1.79
10.1001/archpsyc.1981.01780290042004
10.1037/0021-9010.69.1.85
10.1016/j.ssci.2009.12.022
10.1016/j.athoracsur.2006.11.002
10.1016/S0003-6870(02)00010-8
10.1177/001316446002000104
10.1037/e427202005-001
10.1001/archpsyc.1985.01790300093012
10.1016/j.ssci.2008.09.012
10.1016/j.aap.2005.10.013
10.1016/j.aap.2008.09.004
10.1080/001401398186162
10.1007/s101110200000
ContentType Journal Article
Copyright 2011 Elsevier Ltd
2015 INIST-CNRS
Copyright_xml – notice: 2011 Elsevier Ltd
– notice: 2015 INIST-CNRS
DBID AAYXX
CITATION
IQODW
7T2
C1K
DOI 10.1016/j.ssci.2011.05.007
DatabaseName CrossRef
Pascal-Francis
Health and Safety Science Abstracts (Full archive)
Environmental Sciences and Pollution Management
DatabaseTitle CrossRef
Health & Safety Science Abstracts
Environmental Sciences and Pollution Management
DatabaseTitleList
Health & Safety Science Abstracts
DeliveryMethod fulltext_linktorsrc
Discipline Economics
Public Health
EISSN 1879-1042
EndPage 1370
ExternalDocumentID 24481241
10_1016_j_ssci_2011_05_007
S0925753511001184
GeographicLocations Australia
Oceania
GroupedDBID ---
--K
--M
.~1
0R~
123
13V
1B1
1RT
1~.
1~5
29P
4.4
457
4G.
53G
5VS
7-5
71M
8P~
9JM
9JN
9JO
AABNK
AACTN
AAEDT
AAEDW
AAFJI
AAIAV
AAIKJ
AAKOC
AALRI
AAOAW
AAQFI
AAQXK
AAXUO
ABBQC
ABFNM
ABIVO
ABJNI
ABKBG
ABLVK
ABMAC
ABMMH
ABMVD
ABMZM
ABNUV
ABXDB
ABYKQ
ACDAQ
ACGFS
ACHRH
ACIWK
ACJTP
ACNNM
ACNTT
ACPRK
ACRLP
ADBBV
ADEWK
ADEZE
ADMUD
ADTZH
AEBSH
AECPX
AEKER
AENEX
AFKWA
AFRAH
AFTJW
AFXBA
AFXIZ
AGHFR
AGJBL
AGUBO
AGUMN
AGYEJ
AHHHB
AHJVU
AHPOS
AIEXJ
AIKHN
AISVY
AITUG
AJBFU
AJOXV
AJRQY
AKURH
AKYCK
ALEQD
ALMA_UNASSIGNED_HOLDINGS
AMFUW
AMRAJ
ANZVX
AOMHK
ASPBG
AVARZ
AVWKF
AXJTR
AZFZN
BJAXD
BKOJK
BLXMC
BNPGV
BNSAS
CS3
DU5
EBS
EFJIC
EFLBG
EJD
ENUVR
EO8
EO9
EP2
EP3
F3I
F5P
FDB
FEDTE
FGOYB
FIRID
FNPLU
FYGXN
G-2
G-Q
GBLVA
HEH
HMK
HMO
HMY
HVGLF
HZ~
IHE
J1W
JJJVA
KOM
LCYCR
M29
M3W
M3Y
M41
MO0
N9A
NAHTW
O-L
O9-
OAUVE
OZT
P-8
P-9
P2P
PC.
PQQKQ
PRBVW
Q38
R2-
RIG
ROL
RPZ
SAE
SDF
SDG
SES
SEW
SNG
SPC
SPCBC
SSB
SSG
SSH
SSL
SSO
SSS
SST
SSZ
T5K
UHS
WH7
WUQ
YHZ
~02
~G-
9DU
AATTM
AAXKI
AAYWO
AAYXX
ABWVN
ACIEU
ACLOT
ACRPL
ACVFH
ADCNI
ADNMO
AEIPS
AEUPX
AFJKZ
AFPUW
AGQPQ
AIGII
AIIUN
AKBMS
AKRWK
AKYEP
ANKPU
APXCP
CITATION
EFKBS
~HD
AGCQF
AGRNS
IQODW
7T2
C1K
ID FETCH-LOGICAL-c362t-a03921f993e3ba4c793f2d45efee0c4c0a36c453933c636e3eeecac61a5a347f3
ISICitedReferencesCount 44
ISICitedReferencesURI http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000295188800009&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
ISSN 0925-7535
IngestDate Tue Oct 07 09:45:42 EDT 2025
Mon Jul 21 09:14:45 EDT 2025
Sat Nov 29 07:19:43 EST 2025
Tue Nov 18 21:39:29 EST 2025
Fri Feb 23 02:27:16 EST 2024
IsPeerReviewed true
IsScholarly true
Issue 10
Keywords Human error
Incident classification
Inter-coder consensus
HFACS
Air traffic control
Mishap
Methodology
Traffic controller
Accident
Coding
Air traffic
Classification
Traffic safety
Language English
License CC BY 4.0
LinkModel OpenURL
MergedId FETCHMERGED-LOGICAL-c362t-a03921f993e3ba4c793f2d45efee0c4c0a36c453933c636e3eeecac61a5a347f3
Notes ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 23
PQID 899156436
PQPubID 23462
PageCount 6
ParticipantIDs proquest_miscellaneous_899156436
pascalfrancis_primary_24481241
crossref_citationtrail_10_1016_j_ssci_2011_05_007
crossref_primary_10_1016_j_ssci_2011_05_007
elsevier_sciencedirect_doi_10_1016_j_ssci_2011_05_007
PublicationCentury 2000
PublicationDate 2011-12-01
PublicationDateYYYYMMDD 2011-12-01
PublicationDate_xml – month: 12
  year: 2011
  text: 2011-12-01
  day: 01
PublicationDecade 2010
PublicationPlace Kidlington
PublicationPlace_xml – name: Kidlington
PublicationTitle Safety science
PublicationYear 2011
Publisher Elsevier India Pvt Ltd
Elsevier
Publisher_xml – name: Elsevier India Pvt Ltd
– name: Elsevier
References ElBardissi, Wiegmann, Dearani, Daly, Sundt (b0045) 2007; 83
Pape, A., Wiegmann, D., Shappell, S., 2001. Air Traffic Control (ATC) Related Accidents and Incidents: A Human Factors Analysis. Presented at the 11th International Symposium on Aviation Psychology. The Ohio State University, Columbus, OH.
Kozlowski, Hattrup (b0080) 1992; 77
Reinach, Viale (b0145) 2006; 38
Maxwell (b0100) 1977; 130
O’Connor (b0105) 2008; 79
Wiegmann, Shappell (b0220) 2003
AlWardi, Y., 2006. Applying Human Factors Analysis and Classification System (HFACS) to Aviation Accidents in the Royal Air Force of Oman (RAFO): A Cross Cultural Comparison. Masters Thesis, Cranfield University, UK, 2006.
Davies, Ross, Wallace, Wright (b0040) 2003
Celik, Cebi (b0025) 2009; 41
Krulak (b0085) 2004; 75
Beaubien, Baker (b0020) 2002; 2
Martin, Bateson (b0095) 1993
Ross, Wallace, Davies (b0150) 2004; 42
Li, Harris (b0090) 2005; 5
Spitznagel, Helzer (b0180) 1985; 42
Wallén-Warner, Sandin (b0210) 2010; 48
Scarborough, A., Pounds, J., 2001. Retrospective human factors analysis of ATC operational errors.Paper presented at the 11th International Symposium on Aviation Psychology, Columbus, OH.
Johnson, W., 1997. Classifying Pilot Human Error Causes in A-10 Class a Mishaps. Graduate Research Project, Embrey-Riddle Aeronautical University, 1997.
Stanton, Steverage (b0185) 1998; 41
Shorrock, Kirwan (b0175) 2002; 33
Wallace, Ross (b0200) 2006
Patterson, Shappell (b0125) 2010; 42
Dambier, Hinkelbein (b0035) 2006; 25
Shappell, Wiegmann (b0155) 2001; 1
Shappell, S., Wiegmann, D., 2003. A Human Error Analysis of General Aviation Controlled Flight into Terrain Accidents Occurring between 1990-1998. Department of Transportation, FAA Report, DOT/FAA/AM-03/4).
Grove, Andreasen, MacDonald-Scott, Keller, Shapiro (b0050) 1981; 38
James, Demaree, Wolf (b0060) 1984; 69
Wallace, Ross, Davies, Wright, White (b0205) 2002; 4
Isaac, A., Lyons, M., Bove, T., Van Damme, D., 2003. Validation of the Human Error in ATM (HERA-JANUS) Technique. EUROCONTROL, HRA/HSP-002-REP-04.
Walker, D., 2007. Applying the Human Factors Analysis and Classification System (HFACS) to Incidents in the UK Construction Industry. Graduate Research Project, Cranfield University, 2007.
Reason (b0140) 1990
Cohen (b0030) 1960; 20
Shappell, Detwiler, Holcomb, Hackworth, Boquet, Wiegmann (b0170) 2007; 49
Wiegmann, D., Faaborg, T., Boquet, A., Detwiler, C., Halcomb, K., Shappell, S., 2005. Human Error and General Aviation Accidents: A Comprehensive, Fine-grained Analysis using HFACS. Department of Transportation, FAA Report, DOT/FAA/AM-05/24).
Pounds, Scarborough, Shappell (b0130) 2000; 71
Bird (b0230) 1974
Baysari, Caponecchia, McIntosh, Wilson (b0015) 2009; 47
Olsen, Shorrock (b0110) 2010; 42
Beaubien (10.1016/j.ssci.2011.05.007_b0020) 2002; 2
Wallén-Warner (10.1016/j.ssci.2011.05.007_b0210) 2010; 48
Maxwell (10.1016/j.ssci.2011.05.007_b0100) 1977; 130
Shappell (10.1016/j.ssci.2011.05.007_b0170) 2007; 49
Ross (10.1016/j.ssci.2011.05.007_b0150) 2004; 42
Bird (10.1016/j.ssci.2011.05.007_b0230) 1974
Li (10.1016/j.ssci.2011.05.007_b0090) 2005; 5
James (10.1016/j.ssci.2011.05.007_b0060) 1984; 69
10.1016/j.ssci.2011.05.007_b0160
Krulak (10.1016/j.ssci.2011.05.007_b0085) 2004; 75
Reason (10.1016/j.ssci.2011.05.007_b0140) 1990
10.1016/j.ssci.2011.05.007_b0065
10.1016/j.ssci.2011.05.007_b0120
Wallace (10.1016/j.ssci.2011.05.007_b0205) 2002; 4
Shappell (10.1016/j.ssci.2011.05.007_b0155) 2001; 1
Martin (10.1016/j.ssci.2011.05.007_b0095) 1993
Baysari (10.1016/j.ssci.2011.05.007_b0015) 2009; 47
Cohen (10.1016/j.ssci.2011.05.007_b0030) 1960; 20
Pounds (10.1016/j.ssci.2011.05.007_b0130) 2000; 71
10.1016/j.ssci.2011.05.007_b0005
Wiegmann (10.1016/j.ssci.2011.05.007_b0220) 2003
10.1016/j.ssci.2011.05.007_b0225
Patterson (10.1016/j.ssci.2011.05.007_b0125) 2010; 42
Spitznagel (10.1016/j.ssci.2011.05.007_b0180) 1985; 42
Olsen (10.1016/j.ssci.2011.05.007_b0110) 2010; 42
Wallace (10.1016/j.ssci.2011.05.007_b0200) 2006
Reinach (10.1016/j.ssci.2011.05.007_b0145) 2006; 38
Davies (10.1016/j.ssci.2011.05.007_b0040) 2003
ElBardissi (10.1016/j.ssci.2011.05.007_b0045) 2007; 83
Dambier (10.1016/j.ssci.2011.05.007_b0035) 2006; 25
10.1016/j.ssci.2011.05.007_b0195
Grove (10.1016/j.ssci.2011.05.007_b0050) 1981; 38
10.1016/j.ssci.2011.05.007_b0055
10.1016/j.ssci.2011.05.007_b0235
Shorrock (10.1016/j.ssci.2011.05.007_b0175) 2002; 33
Kozlowski (10.1016/j.ssci.2011.05.007_b0080) 1992; 77
O’Connor (10.1016/j.ssci.2011.05.007_b0105) 2008; 79
Celik (10.1016/j.ssci.2011.05.007_b0025) 2009; 41
Stanton (10.1016/j.ssci.2011.05.007_b0185) 1998; 41
References_xml – volume: 38
  start-page: 396
  year: 2006
  end-page: 406
  ident: b0145
  article-title: Application of a human error framework to conduct train accident/incident investigations
  publication-title: Accident Analysis and Prevention
– volume: 42
  start-page: 771
  year: 2004
  end-page: 778
  ident: b0150
  article-title: Technical note: measurement issues in taxonomic reliability
  publication-title: Safety Science
– year: 1990
  ident: b0140
  article-title: Human Error
– reference: Wiegmann, D., Faaborg, T., Boquet, A., Detwiler, C., Halcomb, K., Shappell, S., 2005. Human Error and General Aviation Accidents: A Comprehensive, Fine-grained Analysis using HFACS. Department of Transportation, FAA Report, DOT/FAA/AM-05/24).
– volume: 20
  start-page: 37
  year: 1960
  end-page: 46
  ident: b0030
  article-title: A coefficient of agreement for nominal scales
  publication-title: Educational and Psychological Measurement
– volume: 2
  start-page: 11
  year: 2002
  end-page: 36
  ident: b0020
  article-title: A review of selected aviation human factors taxonomies, accident/incident reporting systems and data reporting tools
  publication-title: International Journal of Applied Aviation Studies
– volume: 130
  start-page: 79
  year: 1977
  end-page: 83
  ident: b0100
  article-title: Coefficients of agreement between observers and their interpretation
  publication-title: British Journal of Psychiatry
– year: 2003
  ident: b0040
  article-title: Safety Management: A Qualitative Systems Approach
– reference: Isaac, A., Lyons, M., Bove, T., Van Damme, D., 2003. Validation of the Human Error in ATM (HERA-JANUS) Technique. EUROCONTROL, HRA/HSP-002-REP-04.
– volume: 75
  start-page: 429
  year: 2004
  end-page: 432
  ident: b0085
  article-title: Human factors in maintenance: impact on aircraft mishap frequency and severity
  publication-title: Aviation, Space and Environmental Medicine
– volume: 47
  start-page: 948
  year: 2009
  end-page: 957
  ident: b0015
  article-title: Classification of errors contributing to rail incidents and accidents: a comparison of two human error identification techniques
  publication-title: Safety Science
– reference: Walker, D., 2007. Applying the Human Factors Analysis and Classification System (HFACS) to Incidents in the UK Construction Industry. Graduate Research Project, Cranfield University, 2007.
– volume: 38
  start-page: 408
  year: 1981
  end-page: 413
  ident: b0050
  article-title: Reliability studies of psychiatric diagnosis. Theory and practice
  publication-title: Archives of General Psychiatry
– volume: 48
  start-page: 527
  year: 2010
  end-page: 536
  ident: b0210
  article-title: Intercoder agreement when using the driving reliability and error analysis method in road traffic accident investigations
  publication-title: Safety Science
– volume: 79
  start-page: 599
  year: 2008
  end-page: 606
  ident: b0105
  article-title: HFACS with an additional layer of granularity: validity and utility in accident analysis
  publication-title: Aviation, Space and Environmental Medicine
– volume: 83
  start-page: 1412
  year: 2007
  end-page: 1419
  ident: b0045
  article-title: Application of the human factors analysis and classification system methodology to the cardiovascular surgery operating room
  publication-title: The Annals of Thoracic Surgery
– volume: 1
  start-page: 59
  year: 2001
  end-page: 86
  ident: b0155
  article-title: Applying reason: the human factors analysis and classification system (HFACS)
  publication-title: Human Factors and Aerospace Safety
– volume: 33
  start-page: 319
  year: 2002
  end-page: 336
  ident: b0175
  article-title: Development and application of a human error identification tool for ATC
  publication-title: Applied Ergonomics
– reference: Scarborough, A., Pounds, J., 2001. Retrospective human factors analysis of ATC operational errors.Paper presented at the 11th International Symposium on Aviation Psychology, Columbus, OH.
– reference: Shappell, S., Wiegmann, D., 2003. A Human Error Analysis of General Aviation Controlled Flight into Terrain Accidents Occurring between 1990-1998. Department of Transportation, FAA Report, DOT/FAA/AM-03/4).
– volume: 69
  start-page: 85
  year: 1984
  end-page: 98
  ident: b0060
  article-title: Estimating within-group interrater reliability with and without response bias
  publication-title: Journal of Applied Psychology
– volume: 77
  start-page: 161
  year: 1992
  end-page: 167
  ident: b0080
  article-title: A disagreement about within-group agreement: disentangling issues of consistency vs consensus
  publication-title: Journal of Applied Psychology
– volume: 25
  start-page: 265
  year: 2006
  end-page: 269
  ident: b0035
  article-title: Analysis of 2004 German general aviation aircraft accidents according to the HFACS model
  publication-title: Air Medical Journal
– volume: 41
  start-page: 66
  year: 2009
  end-page: 75
  ident: b0025
  article-title: Analytical HFACS for investigating human errors in shipping accidents
  publication-title: Accident Analysis and Prevention
– volume: 5
  start-page: 65
  year: 2005
  end-page: 72
  ident: b0090
  article-title: HFACS analysis of ROC air force aviation accidents: reliability analysis and cross-cultural comparison
  publication-title: International Journal of Applied Aviation Studies
– reference: Pape, A., Wiegmann, D., Shappell, S., 2001. Air Traffic Control (ATC) Related Accidents and Incidents: A Human Factors Analysis. Presented at the 11th International Symposium on Aviation Psychology. The Ohio State University, Columbus, OH.
– volume: 42
  start-page: 725
  year: 1985
  end-page: 728
  ident: b0180
  article-title: A proposed solution to the base rate problem in the kappa statistic
  publication-title: Archives of General Psychiatry
– reference: AlWardi, Y., 2006. Applying Human Factors Analysis and Classification System (HFACS) to Aviation Accidents in the Royal Air Force of Oman (RAFO): A Cross Cultural Comparison. Masters Thesis, Cranfield University, UK, 2006.
– year: 2006
  ident: b0200
  article-title: Beyond Human Error: Taxonomies and Safety Science
– volume: 4
  start-page: 1
  year: 2002
  end-page: 8
  ident: b0205
  article-title: The creation of a new minor event coding system
  publication-title: Cognition, Technology and Work
– volume: 49
  start-page: 227
  year: 2007
  end-page: 242
  ident: b0170
  article-title: Human error and commercial aviation accidents: an analysis using the human factors analysis and classification system
  publication-title: Human Factors
– year: 1974
  ident: b0230
  article-title: Management Guide to Loss Control
– year: 1993
  ident: b0095
  article-title: Measuring Behaviour: An Introductory Guide
– volume: 41
  start-page: 1737
  year: 1998
  end-page: 1756
  ident: b0185
  article-title: Learning to predict human error: issues of acceptability, reliability and validity
  publication-title: Ergonomics
– volume: 42
  start-page: 437
  year: 2010
  end-page: 444
  ident: b0110
  article-title: Evaluation of the HFACS-ADF safety classification system: inter-coder consensus and intra-coder consistency
  publication-title: Accident Analysis and Prevention
– year: 2003
  ident: b0220
  article-title: A Human Error Approach to Aviation Accident Analysis: The Human Factors Analysis and Classification System
– reference: Johnson, W., 1997. Classifying Pilot Human Error Causes in A-10 Class a Mishaps. Graduate Research Project, Embrey-Riddle Aeronautical University, 1997.
– volume: 71
  start-page: 329
  year: 2000
  ident: b0130
  article-title: A human factors analysis of air traffic control operational errors
  publication-title: Aviation Space and Environmental Medicine
– volume: 42
  start-page: 1379
  year: 2010
  end-page: 1385
  ident: b0125
  article-title: Operator error and system deficiencies: analysis of 508 mining incidents and accidents from Queensland, Australia using HFACS
  publication-title: Accident Analysis and Prevention
– volume: 71
  start-page: 329
  year: 2000
  ident: 10.1016/j.ssci.2011.05.007_b0130
  article-title: A human factors analysis of air traffic control operational errors
  publication-title: Aviation Space and Environmental Medicine
– volume: 25
  start-page: 265
  issue: 6
  year: 2006
  ident: 10.1016/j.ssci.2011.05.007_b0035
  article-title: Analysis of 2004 German general aviation aircraft accidents according to the HFACS model
  publication-title: Air Medical Journal
  doi: 10.1016/j.amj.2006.03.003
– volume: 42
  start-page: 437
  issue: 2
  year: 2010
  ident: 10.1016/j.ssci.2011.05.007_b0110
  article-title: Evaluation of the HFACS-ADF safety classification system: inter-coder consensus and intra-coder consistency
  publication-title: Accident Analysis and Prevention
  doi: 10.1016/j.aap.2009.09.005
– volume: 49
  start-page: 227
  issue: 2
  year: 2007
  ident: 10.1016/j.ssci.2011.05.007_b0170
  article-title: Human error and commercial aviation accidents: an analysis using the human factors analysis and classification system
  publication-title: Human Factors
  doi: 10.1518/001872007X312469
– volume: 5
  start-page: 65
  issue: 1
  year: 2005
  ident: 10.1016/j.ssci.2011.05.007_b0090
  article-title: HFACS analysis of ROC air force aviation accidents: reliability analysis and cross-cultural comparison
  publication-title: International Journal of Applied Aviation Studies
– volume: 77
  start-page: 161
  issue: 2
  year: 1992
  ident: 10.1016/j.ssci.2011.05.007_b0080
  article-title: A disagreement about within-group agreement: disentangling issues of consistency vs consensus
  publication-title: Journal of Applied Psychology
  doi: 10.1037/0021-9010.77.2.161
– volume: 79
  start-page: 599
  issue: 6
  year: 2008
  ident: 10.1016/j.ssci.2011.05.007_b0105
  article-title: HFACS with an additional layer of granularity: validity and utility in accident analysis
  publication-title: Aviation, Space and Environmental Medicine
  doi: 10.3357/ASEM.2228.2008
– volume: 42
  start-page: 1379
  issue: 4
  year: 2010
  ident: 10.1016/j.ssci.2011.05.007_b0125
  article-title: Operator error and system deficiencies: analysis of 508 mining incidents and accidents from Queensland, Australia using HFACS
  publication-title: Accident Analysis and Prevention
  doi: 10.1016/j.aap.2010.02.018
– year: 2006
  ident: 10.1016/j.ssci.2011.05.007_b0200
– ident: 10.1016/j.ssci.2011.05.007_b0055
– volume: 42
  start-page: 771
  issue: 8
  year: 2004
  ident: 10.1016/j.ssci.2011.05.007_b0150
  article-title: Technical note: measurement issues in taxonomic reliability
  publication-title: Safety Science
  doi: 10.1016/j.ssci.2003.10.004
– ident: 10.1016/j.ssci.2011.05.007_b0195
– ident: 10.1016/j.ssci.2011.05.007_b0065
– volume: 75
  start-page: 429
  issue: 5
  year: 2004
  ident: 10.1016/j.ssci.2011.05.007_b0085
  article-title: Human factors in maintenance: impact on aircraft mishap frequency and severity
  publication-title: Aviation, Space and Environmental Medicine
– ident: 10.1016/j.ssci.2011.05.007_b0120
– ident: 10.1016/j.ssci.2011.05.007_b0235
– volume: 130
  start-page: 79
  year: 1977
  ident: 10.1016/j.ssci.2011.05.007_b0100
  article-title: Coefficients of agreement between observers and their interpretation
  publication-title: British Journal of Psychiatry
  doi: 10.1192/bjp.130.1.79
– year: 1993
  ident: 10.1016/j.ssci.2011.05.007_b0095
– year: 1990
  ident: 10.1016/j.ssci.2011.05.007_b0140
– volume: 38
  start-page: 408
  issue: 4
  year: 1981
  ident: 10.1016/j.ssci.2011.05.007_b0050
  article-title: Reliability studies of psychiatric diagnosis. Theory and practice
  publication-title: Archives of General Psychiatry
  doi: 10.1001/archpsyc.1981.01780290042004
– volume: 69
  start-page: 85
  issue: 1
  year: 1984
  ident: 10.1016/j.ssci.2011.05.007_b0060
  article-title: Estimating within-group interrater reliability with and without response bias
  publication-title: Journal of Applied Psychology
  doi: 10.1037/0021-9010.69.1.85
– volume: 48
  start-page: 527
  issue: 5
  year: 2010
  ident: 10.1016/j.ssci.2011.05.007_b0210
  article-title: Intercoder agreement when using the driving reliability and error analysis method in road traffic accident investigations
  publication-title: Safety Science
  doi: 10.1016/j.ssci.2009.12.022
– volume: 83
  start-page: 1412
  issue: 4
  year: 2007
  ident: 10.1016/j.ssci.2011.05.007_b0045
  article-title: Application of the human factors analysis and classification system methodology to the cardiovascular surgery operating room
  publication-title: The Annals of Thoracic Surgery
  doi: 10.1016/j.athoracsur.2006.11.002
– volume: 33
  start-page: 319
  issue: 4
  year: 2002
  ident: 10.1016/j.ssci.2011.05.007_b0175
  article-title: Development and application of a human error identification tool for ATC
  publication-title: Applied Ergonomics
  doi: 10.1016/S0003-6870(02)00010-8
– volume: 20
  start-page: 37
  issue: 1
  year: 1960
  ident: 10.1016/j.ssci.2011.05.007_b0030
  article-title: A coefficient of agreement for nominal scales
  publication-title: Educational and Psychological Measurement
  doi: 10.1177/001316446002000104
– ident: 10.1016/j.ssci.2011.05.007_b0160
  doi: 10.1037/e427202005-001
– ident: 10.1016/j.ssci.2011.05.007_b0225
– year: 2003
  ident: 10.1016/j.ssci.2011.05.007_b0220
– ident: 10.1016/j.ssci.2011.05.007_b0005
– volume: 1
  start-page: 59
  issue: 1
  year: 2001
  ident: 10.1016/j.ssci.2011.05.007_b0155
  article-title: Applying reason: the human factors analysis and classification system (HFACS)
  publication-title: Human Factors and Aerospace Safety
– volume: 42
  start-page: 725
  issue: 7
  year: 1985
  ident: 10.1016/j.ssci.2011.05.007_b0180
  article-title: A proposed solution to the base rate problem in the kappa statistic
  publication-title: Archives of General Psychiatry
  doi: 10.1001/archpsyc.1985.01790300093012
– year: 1974
  ident: 10.1016/j.ssci.2011.05.007_b0230
– volume: 2
  start-page: 11
  issue: 2
  year: 2002
  ident: 10.1016/j.ssci.2011.05.007_b0020
  article-title: A review of selected aviation human factors taxonomies, accident/incident reporting systems and data reporting tools
  publication-title: International Journal of Applied Aviation Studies
– year: 2003
  ident: 10.1016/j.ssci.2011.05.007_b0040
– volume: 47
  start-page: 948
  issue: 7
  year: 2009
  ident: 10.1016/j.ssci.2011.05.007_b0015
  article-title: Classification of errors contributing to rail incidents and accidents: a comparison of two human error identification techniques
  publication-title: Safety Science
  doi: 10.1016/j.ssci.2008.09.012
– volume: 38
  start-page: 396
  issue: 2
  year: 2006
  ident: 10.1016/j.ssci.2011.05.007_b0145
  article-title: Application of a human error framework to conduct train accident/incident investigations
  publication-title: Accident Analysis and Prevention
  doi: 10.1016/j.aap.2005.10.013
– volume: 41
  start-page: 66
  issue: 1
  year: 2009
  ident: 10.1016/j.ssci.2011.05.007_b0025
  article-title: Analytical HFACS for investigating human errors in shipping accidents
  publication-title: Accident Analysis and Prevention
  doi: 10.1016/j.aap.2008.09.004
– volume: 41
  start-page: 1737
  issue: 11
  year: 1998
  ident: 10.1016/j.ssci.2011.05.007_b0185
  article-title: Learning to predict human error: issues of acceptability, reliability and validity
  publication-title: Ergonomics
  doi: 10.1080/001401398186162
– volume: 4
  start-page: 1
  issue: 1
  year: 2002
  ident: 10.1016/j.ssci.2011.05.007_b0205
  article-title: The creation of a new minor event coding system
  publication-title: Cognition, Technology and Work
  doi: 10.1007/s101110200000
SSID ssj0001361
Score 2.1740189
Snippet ► A reliability study was conducted on HFACS in the context of military air traffic control. ► The study tested inter-coder consensus in a real-world, small...
Reliability studies for coding contributing factors of incident reports in high hazard industries are rarely conducted and reported. Although the Human Factors...
SourceID proquest
pascalfrancis
crossref
elsevier
SourceType Aggregation Database
Index Database
Enrichment Source
Publisher
StartPage 1365
SubjectTerms Air traffic control
Biological and medical sciences
HFACS
Human error
Incident classification
Inter-coder consensus
Medical sciences
Miscellaneous
Public health. Hygiene
Public health. Hygiene-occupational medicine
Title Coding ATC incident data using HFACS: Inter-coder consensus
URI https://dx.doi.org/10.1016/j.ssci.2011.05.007
https://www.proquest.com/docview/899156436
Volume 49
WOSCitedRecordID wos000295188800009&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
journalDatabaseRights – providerCode: PRVESC
  databaseName: Elsevier SD Freedom Collection Journals 2021
  customDbUrl:
  eissn: 1879-1042
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0001361
  issn: 0925-7535
  databaseCode: AIEXJ
  dateStart: 19950101
  isFulltext: true
  titleUrlDefault: https://www.sciencedirect.com
  providerName: Elsevier
link http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwtV3fa9swEBZbOtigjK3bWLa16GFvxsGOJFvenkJoafcQCskgb0JRZEhbnBAnpX_-7iTbcVZWukJfjDG2Zes-350-3w9CvmvNZv1ZakID9izkGbNhlug05LkG8ybB4vfnrtlEOhrJ6TS7rLr0la6dQFoU8u4uWz2rqOEYCBtTZ_9D3M1N4QDsg9BhC2KH7aMEP1y6PJXBZBggj46JuAHGgQZbRwucnw2GY-QBHBcYYkr7GmPPS-x5UbZ91bHOMZ6zspE7NrbibEaL6-tFMO61eQMMXNuLwWgSWi4KAGJwebtpxRE5fhD73ApfS6RnvXaUaQZ6m--pT19xtIZJ1FKGGEHXMqwx8y1C7iltzx9c9Up4oaqoKhJd6c5ENYGDY3wsfCqsdAdrI_6SHPRTkckOORhcnE5_NVYYBnfdEuvXqBKmfGzf3yP9yyk5XOkSPpXc9zi5Z66dDzJ5R95Wiwc68EJ_T17Y4oi8rnPLyyNy6FlY6pPLPpCfHgwUwEBrMFAEA3VgoA4MP2gLCrSBwkfy--x0MjwPq3YZoQEvZBPqCHzdOAeH07KZ5gY0b96fc2FzayPDTaRZYrhgGWMmYYll1lqjTRJroRlPc_aJdIplYT8Tankk52AL8kRLLkUu05lguZAxN4JFc9MlcT1fylS15LGlyY2qgwavFM6xwjlWkVAwx10SNNesfCWVB88WtRhUhXPv4ylAzYPXnezJrBkK3Fj0ZeMuobUQFWhS_D2mC7vclkrCUkmAg558eeLYX8mb3Yf2jXQ26609Jq_M7WZRrk8qgP4BXweUCg
linkProvider Elsevier
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Coding+ATC+incident+data+using+HFACS%3A+Inter-coder+consensus&rft.jtitle=Safety+science&rft.au=Olsen%2C+Nikki+S.&rft.date=2011-12-01&rft.pub=Elsevier+India+Pvt+Ltd&rft.issn=0925-7535&rft.eissn=1879-1042&rft.volume=49&rft.issue=10&rft.spage=1365&rft.epage=1370&rft_id=info:doi/10.1016%2Fj.ssci.2011.05.007&rft.externalDocID=S0925753511001184
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=0925-7535&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=0925-7535&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=0925-7535&client=summon