Meaningful Human Control over Autonomous Systems: A Philosophical Account

Debates on lethal autonomous weapon systems have proliferated in the past 5 years. Ethical concerns have been voiced about a possible raise in the number of wrongs and crimes in military operations and about the creation of a "responsibility gap" for harms caused by these systems. To addre...

Celý popis

Uložené v:

Podrobná bibliografia
Vydané v:	Frontiers in robotics and AI Ročník 5; s. 15
Hlavní autori:	Santoni de Sio, Filippo, van den Hoven, Jeroen
Médium:	Journal Article
Jazyk:	English
Vydavateľské údaje:	Switzerland Frontiers Media S.A 28.02.2018
Predmet:	autonomous weapon systems ethics of robotics meaningful human control responsibility gap responsible innovation in robotics Robotics and AI value-sensitive design in robotics autonomous weapon systems AI ethics ethics of robotics responsible innovation in robotics ethics of autonomous systems meaningful human control value-sensitive design in robotics responsibility gap
ISSN:	2296-9144, 2296-9144
On-line prístup:	Získať plný text
Tagy:	Pridať tag Žiadne tagy, Buďte prvý, kto otaguje tento záznam!

Abstract	Debates on lethal autonomous weapon systems have proliferated in the past 5 years. Ethical concerns have been voiced about a possible raise in the number of wrongs and crimes in military operations and about the creation of a "responsibility gap" for harms caused by these systems. To address these concerns, the principle of "meaningful human control" has been introduced in the legal-political debate; according to this principle, humans not computers and their algorithms should ultimately remain in control of, and thus morally responsible for, relevant decisions about (lethal) military operations. However, policy-makers and technical designers lack a detailed theory of what "meaningful human control" exactly means. In this paper, we lay the foundation of a philosophical account of meaningful human control, based on the concept of "guidance control" as elaborated in the philosophical debate on free will and moral responsibility. Following the ideals of "Responsible Innovation" and "Value-sensitive Design," our account of meaningful human control is cast in the form of design requirements. We identify two general necessary conditions to be satisfied for an autonomous system to remain under meaningful human control: first, a "tracking" condition, according to which the system should be able to respond to both the relevant moral reasons of the humans designing and deploying the system and the relevant facts in the environment in which the system operates; second, a "tracing" condition, according to which the system should be designed in such a way as to grant the possibility to always trace back the outcome of its operations to at least one human along the chain of design and operation. As we think that meaningful human control can be one of the central notions in ethics of robotics and AI, in the last part of the paper, we start exploring the implications of our account for the design and use of non-military autonomous systems, for instance, self-driving cars.
AbstractList	Debates on lethal autonomous weapon systems have proliferated in the past 5 years. Ethical concerns have been voiced about a possible raise in the number of wrongs and crimes in military operations and about the creation of a "responsibility gap" for harms caused by these systems. To address these concerns, the principle of "meaningful human control" has been introduced in the legal-political debate; according to this principle, humans not computers and their algorithms should ultimately remain in control of, and thus morally responsible for, relevant decisions about (lethal) military operations. However, policy-makers and technical designers lack a detailed theory of what "meaningful human control" exactly means. In this paper, we lay the foundation of a philosophical account of meaningful human control, based on the concept of "guidance control" as elaborated in the philosophical debate on free will and moral responsibility. Following the ideals of "Responsible Innovation" and "Value-sensitive Design," our account of meaningful human control is cast in the form of design requirements. We identify two general necessary conditions to be satisfied for an autonomous system to remain under meaningful human control: first, a "tracking" condition, according to which the system should be able to respond to both the relevant moral reasons of the humans designing and deploying the system and the relevant facts in the environment in which the system operates; second, a "tracing" condition, according to which the system should be designed in such a way as to grant the possibility to always trace back the outcome of its operations to at least one human along the chain of design and operation. As we think that meaningful human control can be one of the central notions in ethics of robotics and AI, in the last part of the paper, we start exploring the implications of our account for the design and use of non-military autonomous systems, for instance, self-driving cars. Debates on lethal autonomous weapon systems have proliferated in the past 5 years. Ethical concerns have been voiced about a possible raise in the number of wrongs and crimes in military operations and about the creation of a "responsibility gap" for harms caused by these systems. To address these concerns, the principle of "meaningful human control" has been introduced in the legal-political debate; according to this principle, humans not computers and their algorithms should ultimately remain in control of, and thus morally responsible for, relevant decisions about (lethal) military operations. However, policy-makers and technical designers lack a detailed theory of what "meaningful human control" exactly means. In this paper, we lay the foundation of a philosophical account of meaningful human control, based on the concept of "guidance control" as elaborated in the philosophical debate on free will and moral responsibility. Following the ideals of "Responsible Innovation" and "Value-sensitive Design," our account of meaningful human control is cast in the form of design requirements. We identify two general necessary conditions to be satisfied for an autonomous system to remain under meaningful human control: first, a "tracking" condition, according to which the system should be able to respond to both the relevant moral reasons of the humans designing and deploying the system and the relevant facts in the environment in which the system operates; second, a "tracing" condition, according to which the system should be designed in such a way as to grant the possibility to always trace back the outcome of its operations to at least one human along the chain of design and operation. As we think that meaningful human control can be one of the central notions in ethics of robotics and AI, in the last part of the paper, we start exploring the implications of our account for the design and use of non-military autonomous systems, for instance, self-driving cars.Debates on lethal autonomous weapon systems have proliferated in the past 5 years. Ethical concerns have been voiced about a possible raise in the number of wrongs and crimes in military operations and about the creation of a "responsibility gap" for harms caused by these systems. To address these concerns, the principle of "meaningful human control" has been introduced in the legal-political debate; according to this principle, humans not computers and their algorithms should ultimately remain in control of, and thus morally responsible for, relevant decisions about (lethal) military operations. However, policy-makers and technical designers lack a detailed theory of what "meaningful human control" exactly means. In this paper, we lay the foundation of a philosophical account of meaningful human control, based on the concept of "guidance control" as elaborated in the philosophical debate on free will and moral responsibility. Following the ideals of "Responsible Innovation" and "Value-sensitive Design," our account of meaningful human control is cast in the form of design requirements. We identify two general necessary conditions to be satisfied for an autonomous system to remain under meaningful human control: first, a "tracking" condition, according to which the system should be able to respond to both the relevant moral reasons of the humans designing and deploying the system and the relevant facts in the environment in which the system operates; second, a "tracing" condition, according to which the system should be designed in such a way as to grant the possibility to always trace back the outcome of its operations to at least one human along the chain of design and operation. As we think that meaningful human control can be one of the central notions in ethics of robotics and AI, in the last part of the paper, we start exploring the implications of our account for the design and use of non-military autonomous systems, for instance, self-driving cars.
Author	van den Hoven, Jeroen Santoni de Sio, Filippo
AuthorAffiliation	1 Section Ethics/Philosophy of Technology, Faculty Technology Policy and Management, Delft University of Technology , Delft , Netherlands
AuthorAffiliation_xml	– name: 1 Section Ethics/Philosophy of Technology, Faculty Technology Policy and Management, Delft University of Technology , Delft , Netherlands
Author_xml	– sequence: 1 givenname: Filippo surname: Santoni de Sio fullname: Santoni de Sio, Filippo – sequence: 2 givenname: Jeroen surname: van den Hoven fullname: van den Hoven, Jeroen
BackLink	https://www.ncbi.nlm.nih.gov/pubmed/33500902$$D View this record in MEDLINE/PubMed
BookMark	eNp1kU1rXCEUhqWkNB_Nvqtyl93M1M-rdlEYhjQZSGmh7VrU8c4YvDpVbyD_vs5MGpJCV4rnPc_h-JyDk5iiA-AdgnNChPw45GTqHEMk5hBCxF6BM4xlP5OI0pNn91NwWcrdISIo4fwNOCWEQSghPgOrr05HHzfDFLqbadSxW6ZYcwpdune5W0w1xTSmqXQ_Hkp1Y_nULbrvWx9SSbuttzp0C2vTFOtb8HrQobjLx_MC_Ppy9XN5M7v9dr1aLm5nlva4zghlGBnuBJXGDQivjeQcDj2hUpreSuycptxYKRnH1AzcwMFxtjYWygaw5AKsjtx10ndql_2o84NK2qvDQ8obpXP1NjjlBBGCa9pWlRRTaLCBglMmCUO9ZKyxPh9Zu8mMbm1dW12HF9CXlei3apPuFRewh1I0wIdHQE6_J1eqGn2xLgQdXfs0halAPcGS4RZ9_3zW05C_LloAHgM2p1KyG54iCKq9cXUwrvbG1UFna-n_abG-6ur3CrUP_2_8A6-SsBU
CitedBy_id	crossref_primary_10_1145_3419633 crossref_primary_10_1007_s43681_023_00297_2 crossref_primary_10_3389_fpsyg_2025_1536667 crossref_primary_10_1007_s40685_020_00138_6 crossref_primary_10_1007_s10676_023_09690_1 crossref_primary_10_1007_s44206_025_00174_x crossref_primary_10_1109_MC_2023_3241071 crossref_primary_10_3390_laws12010005 crossref_primary_10_1007_s10676_021_09588_w crossref_primary_10_1080_21507740_2020_1740353 crossref_primary_10_1007_s00146_020_01012_z crossref_primary_10_1007_s43681_023_00274_9 crossref_primary_10_1016_j_scitotenv_2020_142561 crossref_primary_10_2478_ebtj_2025_0019 crossref_primary_10_1007_s12369_019_00592_1 crossref_primary_10_1007_s13347_022_00519_1 crossref_primary_10_1007_s10677_019_10007_9 crossref_primary_10_1080_16544951_2025_2540131 crossref_primary_10_1007_s10676_022_09654_x crossref_primary_10_1007_s13347_024_00808_x crossref_primary_10_1007_s43681_025_00803_8 crossref_primary_10_1109_MITS_2019_2926278 crossref_primary_10_1007_s10676_025_09820_x crossref_primary_10_1007_s10676_025_09823_8 crossref_primary_10_1145_3419764 crossref_primary_10_1007_s10676_024_09762_w crossref_primary_10_1109_ACCESS_2021_3069902 crossref_primary_10_1007_s11948_021_00323_8 crossref_primary_10_1109_TITS_2025_3530143 crossref_primary_10_3390_bdcc3010005 crossref_primary_10_1080_23736992_2024_2418053 crossref_primary_10_1186_s42854_021_00023_3 crossref_primary_10_3389_frobt_2021_744590 crossref_primary_10_1007_s11948_020_00233_1 crossref_primary_10_1007_s10676_021_09609_8 crossref_primary_10_1080_0144929X_2024_2431631 crossref_primary_10_1007_s11023_019_09509_3 crossref_primary_10_3389_frobt_2022_842213 crossref_primary_10_37055_nsz_183866 crossref_primary_10_1007_s43681_024_00500_y crossref_primary_10_1080_13600826_2024_2436966 crossref_primary_10_1038_s41598_022_19876_0 crossref_primary_10_1007_s13347_022_00565_9 crossref_primary_10_1007_s13347_022_00569_5 crossref_primary_10_1007_s10845_021_01796_x crossref_primary_10_1007_s00146_025_02335_5 crossref_primary_10_1007_s11016_023_00902_4 crossref_primary_10_1111_1758_5899_12665 crossref_primary_10_1016_j_sftr_2025_101152 crossref_primary_10_1007_s11948_024_00501_4 crossref_primary_10_1038_s41585_020_0375_z crossref_primary_10_1080_10447318_2022_2041900 crossref_primary_10_1109_THMS_2025_3553015 crossref_primary_10_1007_s43681_024_00528_0 crossref_primary_10_23104_ME_2023_10_2_2_12 crossref_primary_10_1007_s00146_025_02588_0 crossref_primary_10_3390_su132011162 crossref_primary_10_3389_fpos_2025_1504520 crossref_primary_10_1007_s10703_024_00445_2 crossref_primary_10_1007_s11023_022_09608_8 crossref_primary_10_1007_s10462_025_11352_1 crossref_primary_10_1007_s10676_019_09519_w crossref_primary_10_1002_hast_1207 crossref_primary_10_1007_s43681_022_00167_3 crossref_primary_10_1016_j_artint_2019_103201 crossref_primary_10_1111_tops_12682 crossref_primary_10_1007_s13347_022_00602_7 crossref_primary_10_1007_s43681_024_00647_8 crossref_primary_10_35292_ropj_v17i23_1066 crossref_primary_10_1007_s11846_024_00748_y crossref_primary_10_1007_s00146_024_02000_3 crossref_primary_10_1080_21550085_2024_2430151 crossref_primary_10_3389_fpsyg_2022_954444 crossref_primary_10_1007_s10806_019_09775_2 crossref_primary_10_1007_s00194_025_00742_y crossref_primary_10_4018_IJT_291553 crossref_primary_10_1080_1463922X_2019_1574931 crossref_primary_10_1007_s10676_022_09675_6 crossref_primary_10_1111_dmj_12070 crossref_primary_10_1007_s11229_022_04001_5 crossref_primary_10_3389_frobt_2021_640647 crossref_primary_10_1145_3618001 crossref_primary_10_1080_10447318_2019_1619259 crossref_primary_10_1136_jme_2023_109095 crossref_primary_10_1007_s11948_019_00142_y crossref_primary_10_1007_s13347_021_00450_x crossref_primary_10_1109_MTS_2019_2948439 crossref_primary_10_3389_frai_2021_737072 crossref_primary_10_3390_ai6050101 crossref_primary_10_1007_s10677_024_10459_8 crossref_primary_10_1017_S0963180122000718 crossref_primary_10_1177_1071181320641065 crossref_primary_10_1007_s11572_023_09710_7 crossref_primary_10_1007_s10892_024_09493_6 crossref_primary_10_1007_s10676_024_09811_4 crossref_primary_10_1007_s10676_022_09645_y crossref_primary_10_3389_frobt_2024_1323980 crossref_primary_10_1007_s10111_023_00742_6 crossref_primary_10_3389_frobt_2021_656385 crossref_primary_10_1016_j_matpr_2020_09_611 crossref_primary_10_1515_humaff_2020_0042 crossref_primary_10_1145_3631611 crossref_primary_10_1007_s00146_024_01869_4 crossref_primary_10_1007_s43681_022_00168_2 crossref_primary_10_1007_s12369_024_01184_4 crossref_primary_10_1007_s10676_020_09564_w crossref_primary_10_2298_THEO2403177B crossref_primary_10_3390_s23187974 crossref_primary_10_1007_s43681_024_00444_3 crossref_primary_10_1007_s10676_021_09619_6 crossref_primary_10_3390_info12050216 crossref_primary_10_1007_s13347_022_00510_w crossref_primary_10_3389_fmed_2024_1324963 crossref_primary_10_1007_s00146_024_01941_z crossref_primary_10_1007_s11948_020_00190_9 crossref_primary_10_1016_j_ijinfomgt_2020_102170 crossref_primary_10_1007_s10676_023_09696_9 crossref_primary_10_1007_s11019_024_10241_8 crossref_primary_10_1007_s12369_023_01049_2 crossref_primary_10_1007_s43681_023_00320_6 crossref_primary_10_1007_s11229_025_04983_y crossref_primary_10_1016_j_futures_2022_103046 crossref_primary_10_1186_s12910_022_00787_8 crossref_primary_10_1007_s11023_020_09537_4 crossref_primary_10_1007_s43681_024_00592_6 crossref_primary_10_1016_j_aei_2025_103660 crossref_primary_10_31617_3_2025_140_02 crossref_primary_10_1007_s43681_022_00135_x crossref_primary_10_1007_s12599_023_00789_9 crossref_primary_10_3390_philosophies6020029 crossref_primary_10_4018_IJT_2020010105 crossref_primary_10_1016_j_jrt_2024_100104 crossref_primary_10_3389_fdata_2022_1038507 crossref_primary_10_3389_frai_2024_1398395 crossref_primary_10_1007_s00146_022_01607_8 crossref_primary_10_1016_j_jrt_2025_100124 crossref_primary_10_3389_frobt_2022_977303 crossref_primary_10_1007_s12369_021_00790_w crossref_primary_10_1136_jme_2024_110552 crossref_primary_10_1007_s00146_019_00891_1 crossref_primary_10_1007_s44206_023_00073_z crossref_primary_10_1007_s11948_024_00485_1 crossref_primary_10_1080_1463922X_2019_1697390 crossref_primary_10_3389_fdata_2022_999293 crossref_primary_10_1007_s00146_024_02169_7 crossref_primary_10_1007_s10676_022_09624_3 crossref_primary_10_1007_s13347_022_00542_2 crossref_primary_10_1080_01441647_2020_1862355 crossref_primary_10_1017_cfl_2025_10010 crossref_primary_10_1016_j_artmed_2024_102933 crossref_primary_10_1007_s00146_025_02604_3 crossref_primary_10_1136_medethics_2019_105860 crossref_primary_10_2139_ssrn_5343244 crossref_primary_10_1016_j_techfore_2024_123923 crossref_primary_10_1080_13600869_2025_2506312 crossref_primary_10_1007_s43681_024_00489_4 crossref_primary_10_1111_rego_12358 crossref_primary_10_1007_s11023_019_09513_7 crossref_primary_10_1007_s43681_025_00657_0 crossref_primary_10_1016_j_techsoc_2023_102325 crossref_primary_10_1007_s43681_022_00231_y crossref_primary_10_1177_1071181320641018 crossref_primary_10_3390_laws14040054 crossref_primary_10_1007_s42454_021_00036_0 crossref_primary_10_1016_j_techsoc_2024_102685 crossref_primary_10_3389_fdgth_2024_1474692 crossref_primary_10_1016_j_eswa_2025_129259 crossref_primary_10_1007_s43154_020_00024_3 crossref_primary_10_1016_j_trf_2025_04_026 crossref_primary_10_1007_s00146_022_01605_w crossref_primary_10_1007_s43545_021_00236_0 crossref_primary_10_1007_s10676_022_09673_8 crossref_primary_10_1007_s11023_020_09532_9 crossref_primary_10_1080_0144929X_2024_2448719 crossref_primary_10_1007_s00146_025_02401_y crossref_primary_10_1145_3645090 crossref_primary_10_26907_2541_7738_2025_1_139_157 crossref_primary_10_1007_s13347_021_00448_5 crossref_primary_10_1007_s10677_019_10030_w crossref_primary_10_1007_s10676_023_09682_1 crossref_primary_10_1007_s00521_025_11288_1 crossref_primary_10_1080_15027570_2022_2063103 crossref_primary_10_1007_s10676_023_09687_w
Cites_doi	10.4324/9781315578187-7 10.1111/j.1467-9973.1985.tb00176.x 10.1007/s10676-013-9313-6 10.1007/s00146-007-0155-9 10.1109/MC.2007.372 10.1111/j.1475-4975.2005.00117.x 10.1007/978-0-387-72381-5_8 10.2307/2024717 10.1093/analys/23.6.121 10.1111/j.1468-5930.2007.00346.x 10.1017/CBO9780511498824 10.4324/9781315578187 10.1093/acprof:oso/9780199845309.001.0001 10.1007/s10676-013-9318-1 10.1093/acprof:oso/9780199926121.001.0001 10.1007/978-3-662-45854-9 10.1007/978-94-007-6970-0_8 10.1080/14702436.2016.1220806 10.1002/9781118551424.ch4 10.1017/CBO9781139208536 10.4324/9781315578187-2 10.1007/s10676-004-3422-1 10.1023/B:JOET.0000018773.97209.84 10.1007/s10676-005-4585-0 10.1093/acprof:oso/9780195189698.001.0001 10.1017/CBO9780511840852 10.1145/175222.175228 10.1080/03071840308446924 10.4324/9781315578187-10 10.1093/acprof:oso/9780199601387.001.0001 10.5840/schoolman2011881/22 10.1017/CBO9780511814594 10.3868/s050-004-015-0003-8 10.1201/9781420085952 10.1023/A:1010087500508 10.1017/S1816383112000768 10.1609/aimag.v36i4.2577 10.21061/jots.v32i1.a.4 10.1093/jcsl/krw029 10.1111/1467-8284.00096 10.5235/175799611798204914 10.1093/acprof:oso/9780199925605.001.0001
ContentType	Journal Article
Copyright	Copyright © 2018 Santoni de Sio and van den Hoven. Copyright © 2018 Santoni de Sio and van den Hoven. 2018 Santoni de Sio and van den Hoven
Copyright_xml	– notice: Copyright © 2018 Santoni de Sio and van den Hoven. – notice: Copyright © 2018 Santoni de Sio and van den Hoven. 2018 Santoni de Sio and van den Hoven
DBID	AAYXX CITATION NPM 7X8 5PM DOA
DOI	10.3389/frobt.2018.00015
DatabaseName	CrossRef PubMed MEDLINE - Academic PubMed Central (Full Participant titles) DOAJ Directory of Open Access Journals
DatabaseTitle	CrossRef PubMed MEDLINE - Academic
DatabaseTitleList	PubMed MEDLINE - Academic
Database_xml	– sequence: 1 dbid: DOA name: DOAJ: Directory of Open Access Journals url: https://www.doaj.org/ sourceTypes: Open Website – sequence: 2 dbid: NPM name: PubMed url: http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed sourceTypes: Index Database – sequence: 3 dbid: 7X8 name: MEDLINE - Academic url: https://search.proquest.com/medline sourceTypes: Aggregation Database
DeliveryMethod	fulltext_linktorsrc
Discipline	Engineering
EISSN	2296-9144
ExternalDocumentID	oai_doaj_org_article_e83887a409094240b2b0874593516955 PMC7806098 33500902 10_3389_frobt_2018_00015
Genre	Journal Article
GroupedDBID	53G 5VS 9T4 AAFWJ AAYXX ACGFS ADBBV AFPKN ALMA_UNASSIGNED_HOLDINGS BCNDV CITATION GROUPED_DOAJ KQ8 M~E OK1 PGMZT RPM ACXDI IAO ICD IEA IPNFZ ISR NPM RIG 7X8 5PM
ID	FETCH-LOGICAL-c462t-34521b7e849bef12db9770f63499b6c92eea47bc995724bf7b0fe75dbc09462c3
IEDL.DBID	DOA
ISICitedReferencesCount	216
ISICitedReferencesURI	http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000426255300001&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
ISSN	2296-9144
IngestDate	Fri Oct 03 12:44:24 EDT 2025 Thu Aug 21 14:30:52 EDT 2025 Sun Nov 09 14:06:23 EST 2025 Thu Jan 02 22:32:53 EST 2025 Tue Nov 18 21:26:01 EST 2025 Sat Nov 29 02:58:24 EST 2025
IsDoiOpenAccess	true
IsOpenAccess	true
IsPeerReviewed	true
IsScholarly	true
Keywords	autonomous weapon systems AI ethics ethics of robotics responsible innovation in robotics ethics of autonomous systems meaningful human control value-sensitive design in robotics responsibility gap
Language	English
License	Copyright © 2018 Santoni de Sio and van den Hoven. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
LinkModel	DirectLink
MergedId	FETCHMERGED-LOGICAL-c462t-34521b7e849bef12db9770f63499b6c92eea47bc995724bf7b0fe75dbc09462c3
Notes	ObjectType-Article-1 SourceType-Scholarly Journals-1 ObjectType-Feature-2 content type line 23 Edited by: Ugo Pagallo, Università degli Studi di Torino, Italy Reviewed by: Giovanni Sartor, EUI, Italy; Thomas Burri, University of St. Gallen, Switzerland Specialty section: This article was submitted to Ethics in Robotics and Artificial Intelligence, a section of the journal Frontiers in Robotics and AI
OpenAccessLink	https://doaj.org/article/e83887a409094240b2b0874593516955
PMID	33500902
PQID	2481632952
PQPubID	23479
ParticipantIDs	doaj_primary_oai_doaj_org_article_e83887a409094240b2b0874593516955 pubmedcentral_primary_oai_pubmedcentral_nih_gov_7806098 proquest_miscellaneous_2481632952 pubmed_primary_33500902 crossref_primary_10_3389_frobt_2018_00015 crossref_citationtrail_10_3389_frobt_2018_00015
PublicationCentury	2000
PublicationDate	2018-02-28
PublicationDateYYYYMMDD	2018-02-28
PublicationDate_xml	– month: 02 year: 2018 text: 2018-02-28 day: 28
PublicationDecade	2010
PublicationPlace	Switzerland
PublicationPlace_xml	– name: Switzerland
PublicationTitle	Frontiers in robotics and AI
PublicationTitleAlternate	Front Robot AI
PublicationYear	2018
Publisher	Frontiers Media S.A
Publisher_xml	– name: Frontiers Media S.A
References	Wallach (B83) 2013 Fischer (B22) 2004; 8 Saxon (B63) 2016 Franssen (B24) 2015 Yudowsky (B84) 2006 Dancy (B15) 1985 Mindell (B49) 2015 Arkin (B3) 2009 Asaro (B7) 2012; 94 Guarini (B31) 2012 Sharkey (B64) 2007; 40 Kuflik (B42) 1999; 1 Matthias (B47) 2004; 6 Ribeiro (B56) 2016 Sparrow (B69) 2007; 24 Nissenbaum (B51) 1994; 37 Coeckelbergh (B12) 2013; 15 Kane (B38) 1996 Altmann (B2) 2013; 15 Gibbs (B30) 2017 B32 Ekelhof (B20) 2017; 22 B34 van den Hoven (B74) 2007 B35 Santoro (B62) 2008; 22 B79 Johnson (B36) 2005; 7 Timpe (B71) 2011; 88 Morse (B50) 1994; 142 Galliott (B28) 2016; 16 Sharkey (B66) 2012 Cummings (B14) 2006; 32 Nozick (B53) 1981 Tomasi (B72) 2013 Dennett (B16) 1984 B4 B5 Kamm (B37) 2007 Smart (B68) 1973 Pereboom (B55) 2001 Frankfurt (B23) 1971; 68 Bechtel (B8) 1985; 16 Levy (B45) 2011 B80 Ladd (B43) 1991 Vincent (B81) 2013 B40 Burridge (B9) 2003; 148 Wagner (B82) 2014; 47 Kasher (B39) 2016 Di Nucci (B19) 2016 Sharkey (B65) 2011; 3 van den Hoven (B73) 1998 Singer (B67) 2009 Santoni de Sio (B61) 2016 Vargas (B78) 2005; 29 van Wynsberghe (B77) 2015 Alfano (B1) 2013 Leveringhaus (B44) 2016 Friedman (B25) 1990 Hodgson (B33) 2012 van Inwagen (B76) 1983 Krishnan (B41) 2009 B13 Di Nucci (B18) 2014 B57 B59 van den Hoven (B75) 2013 Clark (B11) 1998; 58 Noorman (B52) 2014 Caruso (B10) 2012 Gettier (B29) 1963; 23 Maurer (B48) 2015 Friedman (B26) 2003 Markoff (B46) 2014 Strawser (B70) 2013 Roorda (B58) 2016 Asaro (B6) 2008 (B27) 2015 O’Connell (B54) 2014 Dennett (B17) 2004 Fischer (B21) 1998 Santoni de Sio (B60) 2016
References_xml	– start-page: 119 volume-title: Drones and Responsibility: Legal, Philosophical, and Socio-Technical Perspectives on the Use of Remotely Controlled Weapons year: 2016 ident: B39 article-title: “The threshold of killing drones: the modular turing imitation game,” doi: 10.4324/9781315578187-7 – ident: B35 – volume: 16 start-page: 296 year: 1985 ident: B8 article-title: Attributing responsibility to computer systems publication-title: Metaphilosophy doi: 10.1111/j.1467-9973.1985.tb00176.x – volume: 15 start-page: 87 year: 2013 ident: B12 article-title: Drones, information technology, and distance: mapping the moral epistemology of remote fighting publication-title: Ethics Info. Technol. doi: 10.1007/s10676-013-9313-6 – volume: 22 start-page: 301 year: 2008 ident: B62 article-title: Learning robots interacting with humans: from epistemic risk to responsibility publication-title: AI Soc. doi: 10.1007/s00146-007-0155-9 – volume: 40 start-page: 122 year: 2007 ident: B64 article-title: Automated killers and the computing profession publication-title: Computer doi: 10.1109/MC.2007.372 – start-page: 1277 volume-title: The Human-Computer Interaction Handbook year: 2003 ident: B26 article-title: “Human values, ethics, and design,” – start-page: 1 volume-title: Drones and Responsibility: Legal, Philosophical, and Socio-Technical Perspectives on the Use of Remotely Controlled Weapons year: 2016 ident: B61 article-title: “Drones and responsibility: mapping the field,” – volume: 29 start-page: 269 year: 2005 ident: B78 article-title: The trouble with tracing publication-title: Midwest Stud. Philos. doi: 10.1111/j.1475-4975.2005.00117.x – start-page: 205 year: 2008 ident: B6 article-title: “How just could a robot war be?” – volume-title: The Significance of Free Will year: 1996 ident: B38 – start-page: 67 volume-title: The Information Society: Innovation, Legitimacy, Ethics and Democracy In Honor of Professor Jacques Berleur S.j year: 2007 ident: B74 article-title: “ICT and value sensitive design,” doi: 10.1007/978-0-387-72381-5_8 – volume-title: Healthcare Robots: Ethics, Design and Implementation. Healthcare Robots: Ethics, Design and Implementation year: 2015 ident: B77 – volume-title: Elbow Room: The Varieties of Free Will Worth Wanting year: 1984 ident: B16 – start-page: 207 volume-title: Computerization and Controversy: Value Conflicts and Social Choices year: 1991 ident: B43 article-title: “Computers and moral responsibility. A framework for an ethical analysis,” – volume: 68 start-page: 5 year: 1971 ident: B23 article-title: Freedom of the will and the concept of a person publication-title: J. Phil. doi: 10.2307/2024717 – volume: 23 start-page: 121 year: 1963 ident: B29 article-title: Is justified true belief knowledge? publication-title: Analysis doi: 10.1093/analys/23.6.121 – volume-title: An Essay on Free Will year: 1983 ident: B76 – volume-title: Philosophical Explanations year: 1981 ident: B53 – volume: 24 start-page: 62 year: 2007 ident: B69 article-title: Killer robots publication-title: J. Appl. Philos. doi: 10.1111/j.1468-5930.2007.00346.x – volume-title: Living Without Free Will year: 2001 ident: B55 doi: 10.1017/CBO9780511498824 – volume-title: Drones and Responsibility: Legal, Philosophical and Socio-Technical Perspectives on Remotely Controlled Weapons. Emerging Technologies, Ethics and International Affairs year: 2016 ident: B19 doi: 10.4324/9781315578187 – volume-title: Rationality + Consciousness = Free Will year: 2012 ident: B33 doi: 10.1093/acprof:oso/9780199845309.001.0001 – volume: 15 start-page: 73 year: 2013 ident: B2 article-title: Armed military robots: editorial publication-title: Ethics Info. Technol. doi: 10.1007/s10676-013-9318-1 – volume-title: Terminating the Terminator year: 2013 ident: B83 – start-page: 127 volume-title: Roboethics in Film year: 2014 ident: B18 article-title: “Who’s afraid of robots? Fear of automation and the ideal of direct control,” – volume-title: Freedom Evolves year: 2004 ident: B17 – ident: B13 – volume: 47 start-page: 54 year: 2014 ident: B82 article-title: The dehumanization of international humanitarian law: legal, ethical, and political implications of autonomous weapon systems publication-title: Vand. J. Trans. Law – volume-title: Fearing Bombs That Can Pick Whom to Kill year: 2014 ident: B46 – volume-title: Killing by Remote Control: The Ethics of an Unmanned Military year: 2013 ident: B70 doi: 10.1093/acprof:oso/9780199926121.001.0001 – year: 1990 ident: B25 article-title: “Moral responsibility and computer technology,” – volume-title: Autonomes Fahren year: 2015 ident: B48 article-title: “Autonomes Fahren Technische, Rechtliche Und Gesellschaftliche Aspekte,” doi: 10.1007/978-3-662-45854-9 – volume-title: Wired for War: The Robotics Revolution and Conflict in the Twenty-First Century year: 2009 ident: B67 – ident: B40 – start-page: 118 volume-title: Handbook of Ethics, Values, and Technological Design: Sources, Theory, Values and Application Domains year: 2015 ident: B24 article-title: “Design for values and operator roles in sociotechnical systems,” doi: 10.1007/978-94-007-6970-0_8 – volume-title: Autonomous Systems: Íssues for Defence Policymakers year: 2016 ident: B58 article-title: “NATO’s targeting process: ensuring human control over (and lawful use of) “autonomous” weapons,” – volume: 16 start-page: 450 year: 2016 ident: B28 article-title: Military robots: mapping the moral landscape publication-title: Def. Stud. doi: 10.1080/14702436.2016.1220806 – start-page: 75 volume-title: Responsible Innovation year: 2013 ident: B75 article-title: “Value sensitive design and responsible innovation,” doi: 10.1002/9781118551424.ch4 – volume-title: An Introduction to Contemporary Epistemology. B year: 1985 ident: B15 – ident: B34 – start-page: 308 volume-title: Global Catastrophic Risks year: 2006 ident: B84 article-title: “Artificial intelligence as a positive and negative factor in global risk,” – volume-title: Character as Moral Fiction year: 2013 ident: B1 doi: 10.1017/CBO9781139208536 – start-page: 17 volume-title: Drones and Responsibility: Legal, Philosophical, and Socio-Technical Perspectives on the Use of Remotely Controlled Weapons year: 2016 ident: B63 article-title: “Autonomous drones and individual criminal responsibility,” doi: 10.4324/9781315578187-2 – volume-title: Free Will and Consciousness: A Determinist Account of the Illusion of Free Will year: 2012 ident: B10 – volume-title: Autonomous Weapons: An Open Letter from AI & Robotics Researchers year: 2015 ident: B27 – volume: 6 start-page: 175 year: 2004 ident: B47 article-title: The responsibility gap: ascribing responsibility for the actions of learning automata publication-title: Ethics Info. Technol. doi: 10.1007/s10676-004-3422-1 – ident: B5 – volume: 8 start-page: 145 year: 2004 ident: B22 article-title: Responsibility and manipulation publication-title: J. Ethics doi: 10.1023/B:JOET.0000018773.97209.84 – volume-title: Ethics and Self-Driving Cars: A White Paper on Responsible Innovation in Automated Driving Systems year: 2016 ident: B60 – volume: 7 start-page: 99 year: 2005 ident: B36 article-title: Computer systems and responsibility: a normative look at technological complexity publication-title: Ethics Info. Technol. doi: 10.1007/s10676-005-4585-0 – start-page: 315 volume-title: The American Way of Bombing: Changing Ethical and Legal Norms, from Flying Fortresses to Drones year: 2014 ident: B54 article-title: “Banning autonomous killing-the legal and ethical requirement that humans make near-time lethal decisions,” – volume-title: Intricate Ethics: Rights, Responsibilities, and Permissible Harm year: 2007 ident: B37 doi: 10.1093/acprof:oso/9780195189698.001.0001 – volume-title: Utilitarianism: For and Against year: 1973 ident: B68 doi: 10.1017/CBO9780511840852 – volume: 37 start-page: 72 year: 1994 ident: B51 article-title: Computing and accountability publication-title: Commun. ACM doi: 10.1145/175222.175228 – start-page: 1135 year: 2016 ident: B56 article-title: “Why should I trust you?’ Explaining the predictions of any classifier,” – ident: B79 – volume: 148 start-page: 18 year: 2003 ident: B9 article-title: UAVs and the dawn of post-modern warfare: a perspective on recent operations publication-title: RUSI J. doi: 10.1080/03071840308446924 – start-page: 169 volume-title: Drones and Responsibility: Legal, Philosophical, and Socio-Technical Perspectives on the Use of Remotely Controlled Weapons year: 2016 ident: B44 article-title: “Drones, automated targeting, and moral responsibility,” doi: 10.4324/9781315578187-10 – volume-title: Elon Musk Leads 116 Experts Calling for Outright Ban of Killer Robots year: 2017 ident: B30 – volume-title: Hard Luck: How Luck Undermines Free Will and Moral Responsibility year: 2011 ident: B45 doi: 10.1093/acprof:oso/9780199601387.001.0001 – volume: 88 start-page: 5 year: 2011 ident: B71 article-title: Tracing and the epistemic condition on moral responsibility publication-title: Mod. Schoolman. doi: 10.5840/schoolman2011881/22 – volume-title: Responsibility and Control: A Theory of Moral Responsibility year: 1998 ident: B21 doi: 10.1017/CBO9780511814594 – volume-title: Killer Robots: Legality and Ethicality of Autonomous Weapons year: 2009 ident: B41 – volume: 142 start-page: 1587 year: 1994 ident: B50 article-title: Culpability and control publication-title: Univ. PA. Law Rev. doi: 10.3868/s050-004-015-0003-8 – volume-title: Annual Meeting of the High Contracting Parties to the Convention on Prohibitions or Restrictions on the Use of Certain Conventional Weapons Which May Be Deemed to Be Excessively Injurious or to Have Indiscriminate Effects year: 2013 ident: B72 – volume-title: Governing Lethal Behavior in Autonomous Robots year: 2009 ident: B3 doi: 10.1201/9781420085952 – ident: B4 – volume-title: Our Robots, Ourselves: Robotics and the Myths of Autonomy year: 2015 ident: B49 – volume-title: The Stanford Encyclopedia of Philosophy year: 2014 ident: B52 article-title: “Computing and moral responsibility,” – ident: B80 – start-page: 386 volume-title: Robot Ethics: The Ethical and Social Implications of Robotics year: 2012 ident: B31 article-title: “Robotic warfare: some challenges in moving from noncivilian to civilian theaters,” – volume: 1 start-page: 173 year: 1999 ident: B42 article-title: Computers in control: rational transfer of authority or irresponsible abdication of autonomy? publication-title: Ethics Info. Technol. doi: 10.1023/A:1010087500508 – volume: 94 start-page: 687 year: 2012 ident: B7 article-title: On banning autonomous weapon systems: human rights, automation, and the dehumanization of lethal decision-making publication-title: Int. Rev. Red Cross doi: 10.1017/S1816383112000768 – ident: B59 doi: 10.1609/aimag.v36i4.2577 – volume: 32 start-page: 23 year: 2006 ident: B14 article-title: Automation and accountability in decision support system interface design publication-title: J. Technol. Stud. doi: 10.21061/jots.v32i1.a.4 – volume: 22 start-page: 311 year: 2017 ident: B20 article-title: Complications of a common language: why it is so hard to talk about autonomous weapons publication-title: J. Conflict Secur. Law doi: 10.1093/jcsl/krw029 – ident: B32 – volume: 58 start-page: 7 year: 1998 ident: B11 article-title: The extended mind publication-title: Analysis doi: 10.1111/1467-8284.00096 – volume: 3 start-page: 229 year: 2011 ident: B65 article-title: The automation and proliferation of military drones and the protection of civilians publication-title: Law Innov. Technol. doi: 10.5235/175799611798204914 – ident: B57 – start-page: 111 volume-title: Robot Ethics: The Ethical and Social Implications of Robotics year: 2012 ident: B66 article-title: “Killing made easy,” – start-page: 579 volume-title: Public Administration in an Information Age: A Handbook year: 1998 ident: B73 article-title: “Moral responsibility, public office and information technology,” – volume-title: Neuroscience and Legal Responsibility year: 2013 ident: B81 doi: 10.1093/acprof:oso/9780199925605.001.0001
SSID	ssj0001584377
Score	2.547123
Snippet	Debates on lethal autonomous weapon systems have proliferated in the past 5 years. Ethical concerns have been voiced about a possible raise in the number of...
SourceID	doaj pubmedcentral proquest pubmed crossref
SourceType	Open Website Open Access Repository Aggregation Database Index Database Enrichment Source
StartPage	15
SubjectTerms	autonomous weapon systems ethics of robotics meaningful human control responsibility gap responsible innovation in robotics Robotics and AI value-sensitive design in robotics
Title	Meaningful Human Control over Autonomous Systems: A Philosophical Account
URI	https://www.ncbi.nlm.nih.gov/pubmed/33500902 https://www.proquest.com/docview/2481632952 https://pubmed.ncbi.nlm.nih.gov/PMC7806098 https://doaj.org/article/e83887a409094240b2b0874593516955
Volume	5
WOSCitedRecordID	wos000426255300001&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
hasFullText	1
inHoldings	1
isFullTextHit
isPrint
journalDatabaseRights	– providerCode: PRVAON databaseName: DOAJ: Directory of Open Access Journals customDbUrl: eissn: 2296-9144 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0001584377 issn: 2296-9144 databaseCode: DOA dateStart: 20140101 isFulltext: true titleUrlDefault: https://www.doaj.org/ providerName: Directory of Open Access Journals – providerCode: PRVHPJ databaseName: ROAD: Directory of Open Access Scholarly Resources customDbUrl: eissn: 2296-9144 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0001584377 issn: 2296-9144 databaseCode: M~E dateStart: 20140101 isFulltext: true titleUrlDefault: https://road.issn.org providerName: ISSN International Centre
link	http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwrV07T8MwED4BYoAB8Sa8ZCQWhqip7cQ2W0EgGEAMIHWLYtcRSChFpWXkt3MXp1WKECwsGRJHse6huy93_g7gtHADLkpTxHwg01hq72OTcBeXVnR513ohRRg2oe7vdb9vHlqjvqgnLNADB8F1vBboBwXCEAQiGH4stwlRtBtBFZ60Zi_FrKcFpsL5YC2FUqEuiSjMdMrR0FLvZJd6JxOagtuKQzVd_0855vdWyVbsuV6HtSZpZL2w2Q1Y8NUmrLaoBLfg9s4X9IujnLyy-sc8uwxN6Ix6NFlvMqbTCwjzWcNRfs567GE6x4A0xZrBEdvwdH31eHkTN2MSYiczPo6FxBBsldfSWF92-cBiTpeUmUAwYzNnuPeFVNYZkyoubalsUnqVDqxDiWbciR1YqoaV3wOG2Z3NLEE2js4tvEbMiviG8wIdVesigs5UaLlrOMRplMVrjliCxJzXYs5JzHVZO43gbPbGW-DP-GXtBelhto6Yr-sbaA95Yw_5X_YQwclUizl6CpU_isqjeHMuNSaf3KQ8gt2g1dmnhEgT6lCNQM3pe24v80-ql-eajVvpJEuM3v-PzR_ACokjHJk_hKXxaOKPYNl9jF_eR8ewqPr6uDZ0vN59Xn0BOa7-_g
linkProvider	Directory of Open Access Journals
openUrl	ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Meaningful+Human+Control+over+Autonomous+Systems%3A+A+Philosophical+Account&rft.jtitle=Frontiers+in+robotics+and+AI&rft.au=Filippo+Santoni+de+Sio&rft.au=Jeroen+van+den+Hoven&rft.date=2018-02-28&rft.pub=Frontiers+Media+S.A&rft.eissn=2296-9144&rft.volume=5&rft_id=info:doi/10.3389%2Ffrobt.2018.00015&rft.externalDBID=DOA&rft.externalDocID=oai_doaj_org_article_e83887a409094240b2b0874593516955
thumbnail_l	http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=2296-9144&client=summon
thumbnail_m	http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=2296-9144&client=summon
thumbnail_s	http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=2296-9144&client=summon