Neural mechanisms underlying catastrophic failure in human-machine interaction during aerial navigation
Objective. We investigated the neural correlates of workload buildup in a fine visuomotor task called the boundary avoidance task (BAT). The BAT has been known to induce naturally occurring failures of human-machine coupling in high performance aircraft that can potentially lead to a crash-these fai...
Uloženo v:
| Vydáno v: | Journal of neural engineering Ročník 13; číslo 6; s. 066005 - 66015 |
|---|---|
| Hlavní autoři: | , , , |
| Médium: | Journal Article |
| Jazyk: | angličtina |
| Vydáno: |
England
IOP Publishing
01.12.2016
|
| Témata: | |
| ISSN: | 1741-2560, 1741-2552, 1741-2552 |
| On-line přístup: | Získat plný text |
| Tagy: |
Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
|
| Abstract | Objective. We investigated the neural correlates of workload buildup in a fine visuomotor task called the boundary avoidance task (BAT). The BAT has been known to induce naturally occurring failures of human-machine coupling in high performance aircraft that can potentially lead to a crash-these failures are termed pilot induced oscillations (PIOs). Approach. We recorded EEG and pupillometry data from human subjects engaged in a flight BAT simulated within a virtual 3D environment. Main results. We find that workload buildup in a BAT can be successfully decoded from oscillatory features in the electroencephalogram (EEG). Information in delta, theta, alpha, beta, and gamma spectral bands of the EEG all contribute to successful decoding, however gamma band activity with a lateralized somatosensory topography has the highest contribution, while theta band activity with a fronto-central topography has the most robust contribution in terms of real-world usability. We show that the output of the spectral decoder can be used to predict PIO susceptibility. We also find that workload buildup in the task induces pupil dilation, the magnitude of which is significantly correlated with the magnitude of the decoded EEG signals. These results suggest that PIOs may result from the dysregulation of cortical networks such as the locus coeruleus (LC)-anterior cingulate cortex (ACC) circuit. Significance. Our findings may generalize to similar control failures in other cases of tight man-machine coupling where gains and latencies in the control system must be inferred and compensated for by the human operators. A closed-loop intervention using neurophysiological decoding of workload buildup that targets the LC-ACC circuit may positively impact operator performance in such situations. |
|---|---|
| AbstractList | We investigated the neural correlates of workload buildup in a fine visuomotor task called the boundary avoidance task (BAT). The BAT has been known to induce naturally occurring failures of human-machine coupling in high performance aircraft that can potentially lead to a crash-these failures are termed pilot induced oscillations (PIOs).
We recorded EEG and pupillometry data from human subjects engaged in a flight BAT simulated within a virtual 3D environment.
We find that workload buildup in a BAT can be successfully decoded from oscillatory features in the electroencephalogram (EEG). Information in delta, theta, alpha, beta, and gamma spectral bands of the EEG all contribute to successful decoding, however gamma band activity with a lateralized somatosensory topography has the highest contribution, while theta band activity with a fronto-central topography has the most robust contribution in terms of real-world usability. We show that the output of the spectral decoder can be used to predict PIO susceptibility. We also find that workload buildup in the task induces pupil dilation, the magnitude of which is significantly correlated with the magnitude of the decoded EEG signals. These results suggest that PIOs may result from the dysregulation of cortical networks such as the locus coeruleus (LC)-anterior cingulate cortex (ACC) circuit.
Our findings may generalize to similar control failures in other cases of tight man-machine coupling where gains and latencies in the control system must be inferred and compensated for by the human operators. A closed-loop intervention using neurophysiological decoding of workload buildup that targets the LC-ACC circuit may positively impact operator performance in such situations. Objective. We investigated the neural correlates of workload buildup in a fine visuomotor task called the boundary avoidance task (BAT). The BAT has been known to induce naturally occurring failures of human-machine coupling in high performance aircraft that can potentially lead to a crash-these failures are termed pilot induced oscillations (PIOs). Approach. We recorded EEG and pupillometry data from human subjects engaged in a flight BAT simulated within a virtual 3D environment. Main results. We find that workload buildup in a BAT can be successfully decoded from oscillatory features in the electroencephalogram (EEG). Information in delta, theta, alpha, beta, and gamma spectral bands of the EEG all contribute to successful decoding, however gamma band activity with a lateralized somatosensory topography has the highest contribution, while theta band activity with a fronto-central topography has the most robust contribution in terms of real-world usability. We show that the output of the spectral decoder can be used to predict PIO susceptibility. We also find that workload buildup in the task induces pupil dilation, the magnitude of which is significantly correlated with the magnitude of the decoded EEG signals. These results suggest that PIOs may result from the dysregulation of cortical networks such as the locus coeruleus (LC)-anterior cingulate cortex (ACC) circuit. Significance. Our findings may generalize to similar control failures in other cases of tight man-machine coupling where gains and latencies in the control system must be inferred and compensated for by the human operators. A closed-loop intervention using neurophysiological decoding of workload buildup that targets the LC-ACC circuit may positively impact operator performance in such situations. We investigated the neural correlates of workload buildup in a fine visuomotor task called the boundary avoidance task (BAT). The BAT has been known to induce naturally occurring failures of human-machine coupling in high performance aircraft that can potentially lead to a crash-these failures are termed pilot induced oscillations (PIOs).OBJECTIVEWe investigated the neural correlates of workload buildup in a fine visuomotor task called the boundary avoidance task (BAT). The BAT has been known to induce naturally occurring failures of human-machine coupling in high performance aircraft that can potentially lead to a crash-these failures are termed pilot induced oscillations (PIOs).We recorded EEG and pupillometry data from human subjects engaged in a flight BAT simulated within a virtual 3D environment.APPROACHWe recorded EEG and pupillometry data from human subjects engaged in a flight BAT simulated within a virtual 3D environment.We find that workload buildup in a BAT can be successfully decoded from oscillatory features in the electroencephalogram (EEG). Information in delta, theta, alpha, beta, and gamma spectral bands of the EEG all contribute to successful decoding, however gamma band activity with a lateralized somatosensory topography has the highest contribution, while theta band activity with a fronto-central topography has the most robust contribution in terms of real-world usability. We show that the output of the spectral decoder can be used to predict PIO susceptibility. We also find that workload buildup in the task induces pupil dilation, the magnitude of which is significantly correlated with the magnitude of the decoded EEG signals. These results suggest that PIOs may result from the dysregulation of cortical networks such as the locus coeruleus (LC)-anterior cingulate cortex (ACC) circuit.MAIN RESULTSWe find that workload buildup in a BAT can be successfully decoded from oscillatory features in the electroencephalogram (EEG). Information in delta, theta, alpha, beta, and gamma spectral bands of the EEG all contribute to successful decoding, however gamma band activity with a lateralized somatosensory topography has the highest contribution, while theta band activity with a fronto-central topography has the most robust contribution in terms of real-world usability. We show that the output of the spectral decoder can be used to predict PIO susceptibility. We also find that workload buildup in the task induces pupil dilation, the magnitude of which is significantly correlated with the magnitude of the decoded EEG signals. These results suggest that PIOs may result from the dysregulation of cortical networks such as the locus coeruleus (LC)-anterior cingulate cortex (ACC) circuit.Our findings may generalize to similar control failures in other cases of tight man-machine coupling where gains and latencies in the control system must be inferred and compensated for by the human operators. A closed-loop intervention using neurophysiological decoding of workload buildup that targets the LC-ACC circuit may positively impact operator performance in such situations.SIGNIFICANCEOur findings may generalize to similar control failures in other cases of tight man-machine coupling where gains and latencies in the control system must be inferred and compensated for by the human operators. A closed-loop intervention using neurophysiological decoding of workload buildup that targets the LC-ACC circuit may positively impact operator performance in such situations. |
| Author | Sajda, Paul Jangraw, David C Saproo, Sameer Shih, Victor |
| Author_xml | – sequence: 1 givenname: Sameer surname: Saproo fullname: Saproo, Sameer email: sameer.saproo@columbia.edu organization: Columbia University Department of Biomedical Engineering, New York, USA – sequence: 2 givenname: Victor surname: Shih fullname: Shih, Victor organization: Columbia University Department of Biomedical Engineering, New York, USA – sequence: 3 givenname: David C surname: Jangraw fullname: Jangraw, David C organization: National Institutes of Health, Bethesda, Maryland, USA – sequence: 4 givenname: Paul orcidid: 0000-0002-9738-1342 surname: Sajda fullname: Sajda, Paul email: psajda@columbia.edu organization: Columbia University Department of Biomedical Engineering, New York, USA |
| BackLink | https://www.ncbi.nlm.nih.gov/pubmed/27705959$$D View this record in MEDLINE/PubMed |
| BookMark | eNptkU1LxDAQhoMofv8EpTe91J00bdIeRfwC0Yuew5hOd7O0aU0awX9vy67iwdMM7zzzMsx7xHZd74ixMw5XHMpywVXO06yQsOBiIRcgJUCxww63epHt_vYSDthRCGsAwVUF--wgUwqKqqgO2fKZosc26cis0NnQhSS6mnz7Zd0yMThiGH0_rKxJGrRt9JRYl6xihy7t0Kysm4WRPJrR9i6po58XkbydXB1-2iXOgxO212Ab6HRbj9nb3e3rzUP69HL_eHP9lJpcwJjmmchqgxkow6t3VWWSTCmNVIZkU6lKlKikUMgFyQIa4gIb3hiJFYAqchTH7HLjO_j-I1IYdWeDobZFR30MmpeiEEqpMp_Q8y0a3zuq9eBth_5L_zxnAi42gO0Hve6jd9Pleu1Ic6Gl3rxcD3UzkfwfkoOeo9JzDHqO4e-e-AaJL4ZL |
| CODEN | JNEIEZ |
| CitedBy_id | crossref_primary_10_1016_j_cogsys_2024_101282 crossref_primary_10_3389_fnhum_2017_00388 crossref_primary_10_1155_2017_6076913 crossref_primary_10_3917_rdna_hs10_0129 crossref_primary_10_1073_pnas_1817207116 crossref_primary_10_7717_peerj_10520 crossref_primary_10_1007_s41315_018_0060_z crossref_primary_10_1016_j_apergo_2022_103838 |
| ContentType | Journal Article |
| Copyright | 2016 IOP Publishing Ltd |
| Copyright_xml | – notice: 2016 IOP Publishing Ltd |
| DBID | O3W TSCCA CGR CUY CVF ECM EIF NPM 7X8 |
| DOI | 10.1088/1741-2560/13/6/066005 |
| DatabaseName | Institute of Physics Open Access Journal Titles IOPscience (Open Access) Medline MEDLINE MEDLINE (Ovid) MEDLINE MEDLINE PubMed MEDLINE - Academic |
| DatabaseTitle | MEDLINE Medline Complete MEDLINE with Full Text PubMed MEDLINE (Ovid) MEDLINE - Academic |
| DatabaseTitleList | MEDLINE MEDLINE - Academic |
| Database_xml | – sequence: 1 dbid: NPM name: PubMed url: http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed sourceTypes: Index Database – sequence: 2 dbid: O3W name: Institute of Physics Open Access Journal Titles url: http://iopscience.iop.org/ sourceTypes: Enrichment Source Publisher – sequence: 3 dbid: 7X8 name: MEDLINE - Academic url: https://search.proquest.com/medline sourceTypes: Aggregation Database |
| DeliveryMethod | fulltext_linktorsrc |
| Discipline | Anatomy & Physiology |
| DocumentTitleAlternate | Neural mechanisms underlying catastrophic failure in human-machine interaction during aerial navigation |
| EISSN | 1741-2552 |
| ExternalDocumentID | 27705959 jneaa394e |
| Genre | Research Support, U.S. Gov't, Non-P.H.S Research Support, Non-U.S. Gov't Journal Article |
| GrantInformation_xml | – fundername: Defense Advanced Research Projects Agency grantid: W911NF-11-1-0219 funderid: http://dx.doi.org/10.13039/100000185 – fundername: U.K. economic and social research council grantid: ES/L012995/1 – fundername: U.S. Army Research Laboratory grantid: W911NF-10-2-0022 funderid: http://dx.doi.org/10.13039/100006754 |
| GroupedDBID | --- 1JI 4.4 53G 5B3 5GY 5VS 5ZH 7.M 7.Q AAGCD AAJIO AAJKP AALHV AATNI ABHWH ABJNI ABQJV ABVAM ACAFW ACGFS ACHIP AEFHF AENEX AFYNE AKPSB ALMA_UNASSIGNED_HOLDINGS AOAED ASPBG ATQHT AVWKF AZFZN CEBXE CJUJL CRLBU CS3 DU5 EBS EDWGO EJD EMSAF EPQRW EQZZN F5P HAK IHE IJHAN IOP IZVLO KOT LAP M45 N5L N9A NT- NT. O3W P2P PJBAE RIN RO9 ROL RPA SY9 TSCCA W28 XPP 02O 1WK AERVB AHSEE ARNYC BBWZM CGR CUY CVF ECM EIF FEDTE HVGLF JCGBZ NPM Q02 RNS S3P 7X8 ADEQX AEINN |
| ID | FETCH-LOGICAL-c430t-4232dca207c19b7926ec86c67ce6f97938a7637a13e650fe13af1fc6a900754a3 |
| IEDL.DBID | O3W |
| ISICitedReferencesCount | 12 |
| ISICitedReferencesURI | http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000385934600005&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| ISSN | 1741-2560 1741-2552 |
| IngestDate | Fri Sep 05 12:08:35 EDT 2025 Wed Feb 19 02:42:19 EST 2025 Wed Aug 21 03:33:55 EDT 2024 Fri Jan 08 09:41:23 EST 2021 |
| IsDoiOpenAccess | true |
| IsOpenAccess | true |
| IsPeerReviewed | true |
| IsScholarly | true |
| Issue | 6 |
| Language | English |
| License | Original content from this work may be used under the terms of the Creative Commons Attribution 3.0 licence. Any further distribution of this work must maintain attribution to the author(s) and the title of the work, journal citation and DOI. |
| LinkModel | DirectLink |
| MergedId | FETCHMERGED-LOGICAL-c430t-4232dca207c19b7926ec86c67ce6f97938a7637a13e650fe13af1fc6a900754a3 |
| Notes | JNE-101247.R3 ObjectType-Article-1 SourceType-Scholarly Journals-1 ObjectType-Feature-2 content type line 23 |
| ORCID | 0000-0002-9738-1342 |
| OpenAccessLink | https://iopscience.iop.org/article/10.1088/1741-2560/13/6/066005 |
| PMID | 27705959 |
| PQID | 1835377784 |
| PQPubID | 23479 |
| PageCount | 11 |
| ParticipantIDs | iop_journals_10_1088_1741_2560_13_6_066005 pubmed_primary_27705959 proquest_miscellaneous_1835377784 |
| PublicationCentury | 2000 |
| PublicationDate | 2016-12-01 |
| PublicationDateYYYYMMDD | 2016-12-01 |
| PublicationDate_xml | – month: 12 year: 2016 text: 2016-12-01 day: 01 |
| PublicationDecade | 2010 |
| PublicationPlace | England |
| PublicationPlace_xml | – name: England |
| PublicationTitle | Journal of neural engineering |
| PublicationTitleAbbrev | JNE |
| PublicationTitleAlternate | J. Neural Eng |
| PublicationYear | 2016 |
| Publisher | IOP Publishing |
| Publisher_xml | – name: IOP Publishing |
| SSID | ssj0031790 |
| Score | 2.2213893 |
| Snippet | Objective. We investigated the neural correlates of workload buildup in a fine visuomotor task called the boundary avoidance task (BAT). The BAT has been known... We investigated the neural correlates of workload buildup in a fine visuomotor task called the boundary avoidance task (BAT). The BAT has been known to induce... |
| SourceID | proquest pubmed iop |
| SourceType | Aggregation Database Index Database Enrichment Source Publisher |
| StartPage | 066005 |
| SubjectTerms | Adult Aircraft Algorithms Aviation boundary avoidance task Decision Making - physiology EEG Electroencephalography Female flight Gyrus Cinguli - physiology Humans Locus Coeruleus - physiology Male Man-Machine Systems motor control Nerve Net - physiology pilot induced oscillations Pilots Psychomotor Performance - physiology pupillometry rapid decision making Reflex, Pupillary - physiology Somatosensory Cortex - physiology Virtual Reality Workload Young Adult |
| Title | Neural mechanisms underlying catastrophic failure in human-machine interaction during aerial navigation |
| URI | https://iopscience.iop.org/article/10.1088/1741-2560/13/6/066005 https://www.ncbi.nlm.nih.gov/pubmed/27705959 https://www.proquest.com/docview/1835377784 |
| Volume | 13 |
| WOSCitedRecordID | wos000385934600005&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| link | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwpV1LT9wwEB61tIdeKIWWbh_ISKgHpHQ38a7tHFEF6qFdOPDYm-U4NgR1ndVmQeLfd8bOSnDgUPUSRYmTWOPHfPHM9xngwNdGVZNKZNYkUe0yUwjzM1ePrOJc1kVcyr78JadTNZuVZ49Y_E276Kf-73iahIKTCfuEODVEDJ1n5KmHOR-KIfrMKGL6iquJoJ5-yq_WczEn_alEiUyPrDk8z70GPQx-9nm0Gb3Oydv_r-8WbPaIkx2l8u_ghQvbsHMU8G97_sC-sZgDGhfXd-CatDqw8NwRIbjp5h0jktnyD5GhGC31dKtlu7hpLPOmoYx21gQW9_nL5jEtky4QqTnSJVgiQTITuzkL5j4KerThPVycHJ__-Jn1WzFkdsxHq4zCubU1xUjavKxkWQhnlbBCWid8iWNcGZyopMm5Q8jnXc6Nz70VpiRMMjb8A2yENriPwLwTti6lzwva7ZoQq60qiubVlHJq1AAO0ZK6H0qdjlFypTSZUZMZdc610MmMA2BPCt8G9_i2XtR-APvrxtQ4dCgeYoJr7_DNiD65lFKNB7CbWlkvksaHLqRE4DkpP_1LbT7DG8RTImW7fIGN1fLOfYXX9n7VdMs9eClnCo_Ts997sZf-BX5W4XA |
| linkProvider | IOP Publishing |
| linkToPdf | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwrV1Lb9QwEB6VFiEuUCiPBQpGQhyQQjbxru0cK9pVEdXSA4_eLMexIYh1Vpttpf57ZuwsoocekHqLEtuxxo_57JlvBuCNb4yqp7XIrElBtatMIczPXDO2inPZlPEq-9uJnM_V2Vl1ugWHf7kw3XLY-t_jYwoUnEQ4OMSpHDF0kZGmzgueixx1Js6kfNn4W7Az5VNOCRw-8--b_ZhTDKpEi0zVNjye65pCLYO_vh5xRs0zu38zfd6FewPyZAepzgPYcuEh7B0EPHUvLtlbFn1B4yX7HvygmB1YeOGIGNz2i54R2Wz1m0hRjK58-vWqW_5sLfOmJc921gYW8_1li-ieSS-I3BxpEyyRIZmJ050FcxEDe3ThEXydHX35cJwNKRkyO-HjdUZm3caacixtUdWyKoWzSlghrRO-wrWuDG5Y0hTcIfTzruDGF94KUxE2mRj-GLZDF9xTYN4J21TSFyVlvSbkauuarHoNuZ4aNYJ3KE09LKleR2u5UppEqUmUuuBa6CTKEbArhX8F9-9njZIewevNgGpcQmQXMcF159gyolAupVSTETxJI62XKdaHLqVEADqtnv1Pb17BndPDmT75OP_0HO4ixBLJAeYFbK9X524fbtuLdduvXsaJ-gfut-Tb |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Neural+mechanisms+underlying+catastrophic+failure+in+human-machine+interaction+during+aerial+navigation&rft.jtitle=Journal+of+neural+engineering&rft.au=Saproo%2C+Sameer&rft.au=Shih%2C+Victor&rft.au=Jangraw%2C+David+C&rft.au=Sajda%2C+Paul&rft.date=2016-12-01&rft.pub=IOP+Publishing&rft.issn=1741-2560&rft.eissn=1741-2552&rft.volume=13&rft.issue=6&rft_id=info:doi/10.1088%2F1741-2560%2F13%2F6%2F066005&rft.externalDocID=jneaa394e |
| thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1741-2560&client=summon |
| thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1741-2560&client=summon |
| thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1741-2560&client=summon |