Co-designing algorithms for governance: Ensuring responsible and accountable algorithmic management of refugee camp supplies
There is increasing criticism on the use of big data and algorithms in public governance. Studies revealed that algorithms may reinforce existing biases and defy scrutiny by public officials using them and citizens subject to algorithmic decisions and services. In response, scholars have called for...
Uloženo v:
| Vydáno v: | Big data & society Ročník 9; číslo 1 |
|---|---|
| Hlavní autoři: | , , , |
| Médium: | Journal Article |
| Jazyk: | angličtina |
| Vydáno: |
London, England
SAGE Publications
01.01.2022
Sage Publications Ltd SAGE Publishing |
| Témata: | |
| ISSN: | 2053-9517, 2053-9517 |
| On-line přístup: | Získat plný text |
| Tagy: |
Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
|
| Abstract | There is increasing criticism on the use of big data and algorithms in public governance. Studies revealed that algorithms may reinforce existing biases and defy scrutiny by public officials using them and citizens subject to algorithmic decisions and services. In response, scholars have called for more algorithmic transparency and regulation. These are useful, but ex post solutions in which the development of algorithms remains a rather autonomous process. This paper argues that co-design of algorithms with relevant stakeholders from government and society is another means to achieve responsible and accountable algorithms that is largely overlooked in the literature. We present a case study of the development of an algorithmic tool to estimate the populations of refugee camps to manage the delivery of emergency supplies. This case study demonstrates how in different stages of development of the tool—data selection and pre-processing, training of the algorithm and post-processing and adoption—inclusion of knowledge from the field led to changes to the algorithm. Co-design supported responsibility of the algorithm in the selection of big data sources and in preventing reinforcement of biases. It contributed to accountability of the algorithm by making the estimations transparent and explicable to its users. They were able to use the tool for fitting purposes and used their discretion in the interpretation of the results. It is yet unclear whether this eventually led to better servicing of refugee camps. |
|---|---|
| AbstractList | There is increasing criticism on the use of big data and algorithms in public governance. Studies revealed that algorithms may reinforce existing biases and defy scrutiny by public officials using them and citizens subject to algorithmic decisions and services. In response, scholars have called for more algorithmic transparency and regulation. These are useful, but ex post solutions in which the development of algorithms remains a rather autonomous process. This paper argues that co-design of algorithms with relevant stakeholders from government and society is another means to achieve responsible and accountable algorithms that is largely overlooked in the literature. We present a case study of the development of an algorithmic tool to estimate the populations of refugee camps to manage the delivery of emergency supplies. This case study demonstrates how in different stages of development of the tool—data selection and pre-processing, training of the algorithm and post-processing and adoption—inclusion of knowledge from the field led to changes to the algorithm. Co-design supported responsibility of the algorithm in the selection of big data sources and in preventing reinforcement of biases. It contributed to accountability of the algorithm by making the estimations transparent and explicable to its users. They were able to use the tool for fitting purposes and used their discretion in the interpretation of the results. It is yet unclear whether this eventually led to better servicing of refugee camps. |
| Author | Birbil, S. Ilker van Embden Andres, Mark Koot, Paul Dekker, Rianne |
| Author_xml | – sequence: 1 givenname: Rianne orcidid: 0000-0001-6460-4223 surname: Dekker fullname: Dekker, Rianne email: r.dekker1@uu.nl – sequence: 2 givenname: Paul orcidid: 0000-0002-5016-7891 surname: Koot fullname: Koot, Paul – sequence: 3 givenname: S. Ilker orcidid: 0000-0001-7472-7032 surname: Birbil fullname: Birbil, S. Ilker – sequence: 4 givenname: Mark surname: van Embden Andres fullname: van Embden Andres, Mark |
| BookMark | eNp9kc1q3TAQhUVJoGmaB8hO0LXTkfwjubtySdNAIJvshSyNHF1syZXkQqEPX9_chJaUdjWaw_kOo5l35CTEgIRcMrhiTIiPHNq6b5ngnIEUsm3fkLODVh3Ekz_eb8lFznsAYI1s60aekZ-7WFnMfgw-jFRPY0y-PM6ZupjoGL9jCjoY_ESvQ17TwZMwLzFkP0xIdbBUGxPXUPRT_8J7Q2cd9IgzhkKj2yi3jojU6HmheV2WyWN-T06dnjJePNdz8vDl-mH3tbq7v7ndfb6rTCOgVALcYNHJbmAccLCstwhGG4G8AduagaPhmksnmkYMbW0Ed30_dLXsOtaY-pzcHmNt1Hu1JD_r9ENF7dWTENOodCreTKjA9Q6cE9hx0TABfesAtLWC11yKWm5ZH45ZS4rfVsxF7eO67WjKineSi5p3wDeXOLpMijlvf1fGF118DCVpPykG6nA49dfhNpK9Il_m_R9zdWTytvDf8_wb-AU05qp5 |
| CitedBy_id | crossref_primary_10_1007_s44163_024_00137_0 crossref_primary_10_12660_cgpc_v30_92811 crossref_primary_10_1177_10778012241309362 crossref_primary_10_5209_cgap_97604 crossref_primary_10_1080_14719037_2025_2561109 crossref_primary_10_1177_20539517241232631 crossref_primary_10_1007_s43681_022_00249_2 crossref_primary_10_1080_2474736X_2025_2508374 crossref_primary_10_1177_20539517231163171 crossref_primary_10_1093_ips_olad014 crossref_primary_10_1007_s11301_023_00345_5 crossref_primary_10_1186_s40711_024_00212_0 crossref_primary_10_1002_hrm_22204 crossref_primary_10_1016_j_chb_2024_108403 |
| Cites_doi | 10.1177/2056305118764439 10.1016/j.giq.2017.11.002 10.1177/2053951717718854 10.1111/puar.12625 10.1177/2053951715622512 10.1145/3274463 10.1126/science.aax2342 10.1214/21-SS133 10.1016/j.giq.2018.10.011 10.1111/puar.12136 10.1111/puar.12260 10.1111/1467-8500.12310 10.1080/1369118X.2016.1154087 10.1080/014311600210786 10.1017/CBO9781316105337.002 10.3233/IP-160012 10.1007/978-3-030-12554-7 10.1111/puar.13293 10.1007/s10109-018-0278-1 10.1016/j.giq.2017.06.003 10.1111/padm.12534 10.1080/01431161.2016.1266059 10.1007/s11077-018-9315-7 10.1016/j.jag.2014.11.013 10.1177/2053951717726554 10.4324/9780429261404-5 10.1080/1369118X.2016.1186713 10.18574/nyu/9781479854608.001.0001 10.3233/IDA-2000-43-413 10.3233/IP-200223 10.1177/0952076714529139 10.1186/s41018-020-00069-1 10.1080/0143116021000035021 10.1080/1369118X.2012.678878 10.1017/CBO9780511973000 10.1080/1369118X.2020.1739731 10.1111/1540-6210.00247 10.1177/2053951716679679 10.1332/030557319X15613696433190 10.4159/harvard.9780674736061 10.1007/s10796-016-9686-2 10.3390/rs6042912 10.1177/2053951716662054 10.1093/oso/9780198838494.003.0001 10.4324/9781315756400-13 10.1136/amiajnl-2011-000089 10.1080/01900692.2019.1575664 10.1038/543032a 10.1093/migration/mnaa003 10.1177/0095399714555751 10.1371/journal.pone.0230264 10.1126/science.aaf6545 10.1111/j.1540-6210.2007.00778.x 10.1332/030557303765371726 10.1109/TPAMI.2016.2577031 10.1332/030557319X15579230420081 10.1177/2053951720949566 10.7551/mitpress/7585.001.0001 10.1332/030557319X15579230420126 10.1007/s13347-017-0279-x |
| ContentType | Journal Article |
| Copyright | The Author(s) 2022 The Author(s) 2022. This work is licensed under the Creative Commons Attribution License https://creativecommons.org/licenses/by/4.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License. |
| Copyright_xml | – notice: The Author(s) 2022 – notice: The Author(s) 2022. This work is licensed under the Creative Commons Attribution License https://creativecommons.org/licenses/by/4.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License. |
| DBID | AFRWT AAYXX CITATION 3V. 7SC 7U4 7WY 7WZ 7XB 87Z 8FD 8FK 8FL 8G5 ABUWG AFKRA AZQEC BENPR BEZIV BHHNA CCPQU DWI DWQXO FRNLG F~G GNUQQ GUQSH JQ2 K60 K6~ L.- L7M L~C L~D M0C M2O MBDVC PHGZM PHGZT PIMPY PKEHL PQBIZ PQBZA PQEST PQQKQ PQUKI PRINS Q9U WZK DOA |
| DOI | 10.1177/20539517221087855 |
| DatabaseName | Sage Journals GOLD Open Access 2024 CrossRef ProQuest Central (Corporate) Computer and Information Systems Abstracts Sociological Abstracts (pre-2017) ABI/INFORM Collection ABI/INFORM Global (PDF only) ProQuest Central (purchase pre-March 2016) ABI/INFORM Collection Technology Research Database ProQuest Central (Alumni) (purchase pre-March 2016) ABI/INFORM Collection (Alumni) Research Library (Alumni) ProQuest Central (Alumni) ProQuest Central UK/Ireland ProQuest Central Essentials - QC ProQuest Central Business Premium Collection Sociological Abstracts ProQuest One Community College Sociological Abstracts ProQuest Central Korea Business Premium Collection (Alumni) ABI/INFORM Global (Corporate) ProQuest Central Student ProQuest Research Library ProQuest Computer Science Collection ProQuest Business Collection (Alumni Edition) ProQuest Business Collection ABI/INFORM Professional Advanced Advanced Technologies Database with Aerospace Computer and Information Systems Abstracts Academic Computer and Information Systems Abstracts Professional ABI/INFORM Global Research Library Research Library (Corporate) ProQuest Central Premium ProQuest One Academic ProQuest Publicly Available Content Database ProQuest One Academic Middle East (New) ProQuest One Business (UW System Shared) ProQuest One Business (Alumni) ProQuest One Academic Eastern Edition (DO NOT USE) ProQuest One Academic (retired) ProQuest One Academic UKI Edition ProQuest Central China ProQuest Central Basic Sociological Abstracts (Ovid) Directory of Open Access Journals |
| DatabaseTitle | CrossRef Publicly Available Content Database ABI/INFORM Global (Corporate) ProQuest Business Collection (Alumni Edition) ProQuest One Business Research Library Prep ProQuest Central Student Technology Research Database Computer and Information Systems Abstracts – Academic ProQuest One Academic Middle East (New) ProQuest Central Essentials ProQuest Computer Science Collection Computer and Information Systems Abstracts ProQuest Central (Alumni Edition) ProQuest One Community College Research Library (Alumni Edition) ProQuest Central China ABI/INFORM Complete ProQuest Central ABI/INFORM Professional Advanced ProQuest Central Korea ProQuest Research Library ProQuest Central (New) Advanced Technologies Database with Aerospace ABI/INFORM Complete (Alumni Edition) Business Premium Collection ABI/INFORM Global ABI/INFORM Global (Alumni Edition) ProQuest Central Basic ProQuest One Academic Eastern Edition ProQuest Business Collection Computer and Information Systems Abstracts Professional Sociological Abstracts (pre-2017) ProQuest One Academic UKI Edition Sociological Abstracts ProQuest One Business (Alumni) ProQuest One Academic ProQuest One Academic (New) ProQuest Central (Alumni) Business Premium Collection (Alumni) |
| DatabaseTitleList | CrossRef Publicly Available Content Database |
| Database_xml | – sequence: 1 dbid: DOA name: DOAJ Directory of Open Access Journals url: https://www.doaj.org/ sourceTypes: Open Website – sequence: 2 dbid: PIMPY name: Publicly Available Content Database url: http://search.proquest.com/publiccontent sourceTypes: Aggregation Database |
| DeliveryMethod | fulltext_linktorsrc |
| Discipline | Computer Science |
| EISSN | 2053-9517 |
| ExternalDocumentID | oai_doaj_org_article_0f9f0ff7e627417095f00add72328738 10_1177_20539517221087855 10.1177_20539517221087855 |
| GrantInformation_xml | – fundername: City of The Hague Humanitarian Action Challenge grantid: 18.238 – fundername: Grand Challenges Canada grantid: R-HGC-POC-2007-34904 funderid: https://doi.org/10.13039/501100004828 |
| GroupedDBID | 0R~ 54M 5VS 7WY 8FL 8G5 AAFWJ AAJPV AASGM ABAWP ABQXT ABUWG ACGFS ACROE ADBBV ADOGD AEUHG AEWDL AFCOW AFKRA AFKRG AFPKN AFRWT AJUZI ALMA_UNASSIGNED_HOLDINGS ARBYP AUTPY AZQEC BCNDV BDZRT BENPR BEZIV BPHCQ CCPQU CNVQW DWQXO EBS EJD FRNLG GNUQQ GROUPED_DOAJ GROUPED_SAGE_PREMIER_JOURNAL_COLLECTION GUQSH H13 HMHOC HVGLF IPNFZ J8X K60 K6~ KQ8 M0C M2O M~E O9- OK1 PHGZM PHGZT PIMPY PQBIZ PQBZA PQQKQ RIG SAUOL SCDPB SCNPE SFC AAYXX ACHEB AFFHD CITATION 3V. 7SC 7U4 7XB 8FD 8FK BHHNA DWI JQ2 L.- L7M L~C L~D MBDVC PKEHL PQEST PQUKI PRINS Q9U WZK |
| ID | FETCH-LOGICAL-c470t-70fbdef86b120ebd19de0cac7e240d5cb2ec2a28f7447b53c72f99b6386614c3 |
| IEDL.DBID | DOA |
| ISICitedReferencesCount | 15 |
| ISICitedReferencesURI | http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000780879700001&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| ISSN | 2053-9517 |
| IngestDate | Tue Oct 14 19:03:20 EDT 2025 Thu Nov 20 01:09:46 EST 2025 Sat Nov 29 08:17:09 EST 2025 Tue Nov 18 22:14:28 EST 2025 Tue Jun 17 22:28:29 EDT 2025 |
| IsDoiOpenAccess | true |
| IsOpenAccess | true |
| IsPeerReviewed | true |
| IsScholarly | true |
| Issue | 1 |
| Keywords | Algorithmic governance co-design refugee migration big data public service delivery algorithm design |
| Language | English |
| License | This article is distributed under the terms of the Creative Commons Attribution 4.0 License (https://creativecommons.org/licenses/by/4.0/) which permits any use, reproduction and distribution of the work without further permission provided the original work is attributed as specified on the SAGE and Open Access page (https://us.sagepub.com/en-us/nam/open-access-at-sage). |
| LinkModel | DirectLink |
| MergedId | FETCHMERGED-LOGICAL-c470t-70fbdef86b120ebd19de0cac7e240d5cb2ec2a28f7447b53c72f99b6386614c3 |
| Notes | ObjectType-Article-1 SourceType-Scholarly Journals-1 ObjectType-Feature-2 content type line 14 |
| ORCID | 0000-0001-7472-7032 0000-0001-6460-4223 0000-0002-5016-7891 |
| OpenAccessLink | https://doaj.org/article/0f9f0ff7e627417095f00add72328738 |
| PQID | 2682732602 |
| PQPubID | 4450820 |
| ParticipantIDs | doaj_primary_oai_doaj_org_article_0f9f0ff7e627417095f00add72328738 proquest_journals_2682732602 crossref_citationtrail_10_1177_20539517221087855 crossref_primary_10_1177_20539517221087855 sage_journals_10_1177_20539517221087855 |
| PublicationCentury | 2000 |
| PublicationDate | 20220100 2022-01-00 20220101 2022-01-01 |
| PublicationDateYYYYMMDD | 2022-01-01 |
| PublicationDate_xml | – month: 1 year: 2022 text: 20220100 |
| PublicationDecade | 2020 |
| PublicationPlace | London, England |
| PublicationPlace_xml | – name: London, England – name: London |
| PublicationTitle | Big data & society |
| PublicationYear | 2022 |
| Publisher | SAGE Publications Sage Publications Ltd SAGE Publishing |
| Publisher_xml | – name: SAGE Publications – name: Sage Publications Ltd – name: SAGE Publishing |
| References | Piotrowski, Rosenbloom 2002; 62 Mazzoli, Diechtiareff, Tugores, Wives, Adler, Colet, Ramasco 2020; 15 Bjorgo 2000; 21 Hartley, Sørensen, Torfing 2013; 73 Baumer 2017; 4 Dijstelbloem 2017; 543 Huxham 2003; 31 Yeung 2017; 20 Danaher, Hogan, Noone, Kennedy, Beha, De Paor, Murphy 2017; 4 Han, Zhong, Zhao, Zhang 2017; 38 Klievink, Romijn, Cunningham, De Bruijn 2017; 19 Raymond, Davies, Card, Achkar, Baker 2013; 14 Kuchai, Shepherd, Calabria-Holley, Copping, Matard, Coley 2020; 5 Curry, Croitoru, Crooks, Stefanidis 2019; 21 Van Bekkum, Borgesius 2021 Williamson 2014; 29 Masso, Kasapoglu 2020; 23 Westley, Antadze 2010; 15 Mergel, Rethemeyer, Isett 2016; 76 Dekker, Geuijen, Oliver 2021 Ruijer, Grimmelikhuijsen, Hogan, Enzerink, Ojo, Meijer 2017; 34 Mittelstadt, Allo, Taddeo, Wachter, Floridi 2016; 3 McGann, Blomkamp, Lewis 2018; 51 Bryson, Crosby, Seo 2020; 48 Hermus, Van Buuren, Bekkers 2020; 48 Zhu, Yu, Halfaker, Terveen 2018; 2 Kitchin 2017; 20 Goldfinch 2007; 67 Giest, Grimmelikhuijsen 2020 Dekker, Engbersen, Klaver, Vonk 2018; 4 Wang, So, Smith 2015; 36 Van der Voort, Klievink, Arnaboldi, Meijer 2019; 36 Blomkamp 2018; 77 Burrell 2016; 3 Wieland, Pittore 2014; 6 Chatfield, Reddick 2018; 35 Whitman, Hsiang, Roark 2018; 2 Bruha 2000; 4 Gritsenko, Wood 2020 Giada, De Groeve, Ehrlich, Soille 2003; 24 Willekens, Massey, Raymer, Beauchemin 2016; 352 Lewis, McGann, Blomkamp 2020; 48 Goddard, Roudsari, Wyatt 2012; 19 Kroll, Barocas, Felten, Reidenberg, Robinson, Yu 2017; 165 Boyd, Crawford 2012; 15 Andrews 2019; 97 Mulder, Ferguson, Groenewegen, Boersma, Wolbers 2016; 3 Desouza, Jacob 2017; 49 Meijer, Wessels 2019; 42 Ren, He, Girshick, Sun 2016; 39 Beduschi 2021; 9 Safarov, Meijer, Grimmelikhuijsen 2017; 22 Bullock, Young, Wang 2020; 25 Aizenberg, Van den Hoven 2020; 7 O’Malley 2014; 74 Lepri, Oliver, Letouzé, Pentland, Vinck 2018; 31 Obermeyer, Powers, Vogeli, Mullainathan 2019; 366 bibr25-20539517221087855 bibr73-20539517221087855 Eubanks V (bibr22-20539517221087855) 2018 bibr18-20539517221087855 bibr45-20539517221087855 bibr32-20539517221087855 bibr2-20539517221087855 bibr12-20539517221087855 bibr52-20539517221087855 bibr17-20539517221087855 bibr81-20539517221087855 bibr78-20539517221087855 bibr7-20539517221087855 bibr72-20539517221087855 bibr1-20539517221087855 bibr8-20539517221087855 bibr58-20539517221087855 Van Bekkum M (bibr71-20539517221087855) 2021 bibr31-20539517221087855 Dekker R (bibr19-20539517221087855) 2021 bibr51-20539517221087855 bibr11-20539517221087855 bibr21-20539517221087855 bibr61-20539517221087855 bibr47-20539517221087855 bibr57-20539517221087855 Janis IL (bibr37-20539517221087855) 1982 bibr77-20539517221087855 bibr36-20539517221087855 bibr46-20539517221087855 bibr10-20539517221087855 bibr20-20539517221087855 bibr40-20539517221087855 bibr66-20539517221087855 bibr26-20539517221087855 bibr50-20539517221087855 bibr56-20539517221087855 bibr80-20539517221087855 bibr6-20539517221087855 bibr70-20539517221087855 bibr16-20539517221087855 Kroll JA (bibr41-20539517221087855) 2017; 165 bibr60-20539517221087855 bibr15-20539517221087855 bibr48-20539517221087855 bibr35-20539517221087855 Giest S (bibr27-20539517221087855) 2020 bibr28-20539517221087855 Raymond NA (bibr59-20539517221087855) 2013; 14 bibr5-20539517221087855 Hasian M (bibr33-20539517221087855) 2016 Kettl D (bibr38-20539517221087855) 2018 bibr42-20539517221087855 bibr14-20539517221087855 bibr62-20539517221087855 bibr4-20539517221087855 bibr55-20539517221087855 bibr82-20539517221087855 bibr68-20539517221087855 bibr54-20539517221087855 bibr44-20539517221087855 bibr34-20539517221087855 Gritsenko D (bibr30-20539517221087855) 2020 bibr24-20539517221087855 bibr74-20539517221087855 Schuler D (bibr65-20539517221087855) 1993 bibr64-20539517221087855 bibr23-20539517221087855 bibr49-20539517221087855 Westley F (bibr75-20539517221087855) 2010; 15 bibr69-20539517221087855 bibr79-20539517221087855 bibr29-20539517221087855 bibr53-20539517221087855 bibr3-20539517221087855 bibr39-20539517221087855 Whitman M (bibr76-20539517221087855) 2018; 2 bibr13-20539517221087855 bibr63-20539517221087855 Stringer E (bibr67-20539517221087855) 1996 bibr9-20539517221087855 bibr43-20539517221087855 |
| References_xml | – volume: 15 start-page: e0230264 issue: 3 year: 2020 article-title: Migrant mobility flows characterized with digital data publication-title: Plos One – volume: 51 start-page: 249 issue: 3 year: 2018 end-page: 267 article-title: The rise of public sector innovation labs: Experiments in design thinking for policy publication-title: Policy Sciences – volume: 36 start-page: 87 year: 2015 end-page: 93 article-title: Detecting tents to estimate the displaced populations for post-disaster relief using high resolution satellite imagery publication-title: International Journal of Applied Earth Observation and Geoinformation – volume: 15 start-page: 662 issue: 5 year: 2012 end-page: 679 article-title: Critical questions for big data publication-title: Information, Communication & Society – volume: 4 start-page: 2056305118764439 issue: 1 year: 2018 article-title: Smart refugees: How Syrian asylum migrants use social media information in migration decision-making publication-title: Social Media + Society – year: 2020 article-title: Algorithmic governance: A modes of governance approach publication-title: Regulation & Governance – volume: 48 start-page: 21 issue: 1 year: 2020 end-page: 48 article-title: Applying design in public administration: A literature review to explore the state of the art publication-title: Policy & Politics – volume: 5 start-page: 1 year: 2020 end-page: 20 article-title: The potential for computational IT tools in disaster relief and shelter design publication-title: Journal of International Humanitarian Action – volume: 4 start-page: 1 issue: 2 year: 2017 end-page: 12 article-title: Toward human-centered algorithm design publication-title: Big Data & Society – volume: 21 start-page: 611 issue: 3 year: 2000 end-page: 616 article-title: Using very high spatial resolution multispectral satellite sensor imagery to monitor refugee camps publication-title: International Journal of Remote Sensing – volume: 23 start-page: 1203 issue: 8 year: 2020 end-page: 1219 article-title: Understanding power positions in a new digital landscape: Perceptions of Syrian refugees and data experts on relocation algorithm publication-title: Information, Communication & Society – volume: 352 start-page: 897 issue: 6288 year: 2016 end-page: 899 article-title: International migration under the microscope publication-title: Science – volume: 42 start-page: 1031 issue: 12 year: 2019 end-page: 1039 article-title: Predictive policing: Review of benefits and drawbacks publication-title: International Journal of Public Administration – volume: 67 start-page: 917 issue: 5 year: 2007 end-page: 929 article-title: Pessimism, computer failure, and information systems development in the public sector publication-title: Public Administration Review – volume: 6 start-page: 2912 issue: 4 year: 2014 end-page: 2939 article-title: Performance evaluation of machine learning algorithms for urban pattern recognition from multi-spectral satellite images publication-title: Remote Sensing – volume: 21 start-page: 161 issue: 1 year: 2019 end-page: 187 article-title: Exodus 2.0: Crowdsourcing geographical and social trails of mass migration publication-title: Journal of Geographical Systems – volume: 97 start-page: 296 issue: 2 year: 2019 end-page: 310 article-title: Public administration, public leadership and the construction of public value in the age of the algorithm and ‘big data’ publication-title: Public Administration – volume: 35 start-page: 336 issue: 2 year: 2018 end-page: 347 article-title: Customer agility and responsiveness through big data analytics for public value creation: A case study of Houston 311 on-demand services publication-title: Government Information Quarterly – volume: 3 start-page: 2053951716679679 issue: 2 year: 2016 article-title: The ethics of algorithms: Mapping the debate publication-title: Big Data & Society – volume: 34 start-page: 470 issue: 3 year: 2017 end-page: 480 article-title: Connecting societal issues, users and data. Scenario-based design of open data platforms publication-title: Government Information Quarterly – volume: 15 issue: 2 year: 2010 article-title: Making a difference: Strategies for scaling social innovation for greater impact publication-title: Innovation Journal – volume: 3 start-page: 2053951715622512 issue: 1 year: 2016 article-title: How the machine ‘thinks’: Understanding opacity in machine learning algorithms publication-title: Big Data & Society – volume: 48 start-page: 167 issue: 1 year: 2020 end-page: 189 article-title: Using a design approach to create collaborative governance publication-title: Policy & Politics – volume: 2 start-page: 1 year: 2018 end-page: 23 article-title: Value-sensitive algorithm design: Method, case study, and lessons publication-title: Proceedings of the ACM on Human-Computer Interaction – volume: 24 start-page: 4251 issue: 22 year: 2003 end-page: 4266 article-title: Information extraction from very high resolution satellite imagery over Lukole refugee camp, Tanzania publication-title: International Journal of Remote Sensing – volume: 36 start-page: 27 issue: 1 year: 2019 end-page: 38 article-title: Rationality and politics of algorithms. Will the promise of big data survive the dynamics of public decision making? publication-title: Government Information Quarterly – volume: 22 start-page: 1 issue: 1 year: 2017 end-page: 24 article-title: Utilization of open government data: A systematic literature review of types, conditions, effects and users publication-title: Information Polity – volume: 20 start-page: 14 issue: 1 year: 2017 end-page: 29 article-title: Thinking critically about and researching algorithms publication-title: Information, Communication & Society – volume: 77 start-page: 729 issue: 4 year: 2018 end-page: 743 article-title: The promise of co-design for public policy publication-title: Australian Journal of Public Administration – start-page: 1356389021997848 year: 2021 article-title: Tensions of evaluating innovation in a living lab: Moving beyond actionable knowledge production publication-title: Evaluation – volume: 4 start-page: 363 issue: 3-4 year: 2000 end-page: 374 article-title: From machine learning to knowledge discovery: Survey of preprocessing and postprocessing publication-title: Intelligent Data Analysis – volume: 76 start-page: 928 issue: 6 year: 2016 end-page: 937 article-title: Big data in public affairs publication-title: Public Administration Review – volume: 366 start-page: 447 issue: 6464 year: 2019 end-page: 453 article-title: Dissecting racial bias in an algorithm used to manage the health of populations publication-title: Science – volume: 48 start-page: 111 issue: 1 year: 2020 end-page: 130 article-title: When design meets power: Design thinking, public sector innovation and the politics of policymaking publication-title: Policy & Politics – volume: 4 start-page: 2053951717726554 issue: 2 year: 2017 article-title: Algorithmic governance: Developing a research agenda through the power of collective intelligence publication-title: Big Data & Society – volume: 73 start-page: 821 issue: 6 year: 2013 end-page: 830 article-title: Collaborative innovation: A viable alternative to market competition and organizational entrepreneurship publication-title: Public Administration Review – volume: 31 start-page: 239 issue: 2 year: 2003 end-page: 248 article-title: Action research as a methodology for theory development publication-title: Policy & Politics – volume: 19 start-page: 267 issue: 2 year: 2017 end-page: 283 article-title: Big data in the public sector: Uncertainties and readiness publication-title: Information Systems Frontiers – volume: 3 start-page: 2053951716662054 issue: 2 year: 2016 article-title: Questioning big data: Crowdsourcing crisis data towards an inclusive humanitarian response publication-title: Big Data & Society – volume: 49 start-page: 1043 issue: 7 year: 2017 end-page: 1064 article-title: Big data in the public sector: Lessons for practitioners and scholars publication-title: Administration & Society – volume: 20 start-page: 118 issue: 1 year: 2017 end-page: 136 article-title: ‘Hypernudge’: Big data as a mode of regulation by design publication-title: Information, Communication & Society – volume: 62 start-page: 643 issue: 6 year: 2002 end-page: 657 article-title: Nonmission-based values in results-oriented public management: The case of freedom of information publication-title: Public Administration Review – volume: 25 start-page: 491 issue: 4 year: 2020 end-page: 506 article-title: Artificial intelligence, bureaucratic form, and discretion in public service publication-title: Information Polity – volume: 14 start-page: 185 issue: 2 year: 2013 end-page: 191 article-title: While we watched: Assessing the impact of the satellite sentinel project publication-title: Georgetown Journal of International Affairs – start-page: 1 year: 2020 end-page: 9 article-title: Introduction to special issue algorithmic transparency in government: Towards a multi-level perspective publication-title: Information Polity – volume: 9 start-page: 576 issue: 3 year: 2021 end-page: 596 article-title: International migration management in the age of artificial intelligence publication-title: Migration Studies – start-page: 13882627211031257 year: 2021 article-title: Digital welfare fraud detection and the Dutch SyRI judgment publication-title: European Journal of Social Security – volume: 38 start-page: 514 issue: 2 year: 2017 end-page: 536 article-title: Scene classification based on a hierarchical convolutional sparse auto-encoder for high spatial resolution imagery publication-title: International Journal of Remote Sensing – volume: 29 start-page: 292 issue: 4 year: 2014 end-page: 312 article-title: Knowing public services: Cross-sector intermediaries and algorithmic governance in public sector reform publication-title: Public Policy and Administration – volume: 39 start-page: 1137 issue: 6 year: 2016 end-page: 1149 article-title: Faster R-CNN: towards real-time object detection with region proposal networks publication-title: IEEE Transactions on Pattern Analysis and Machine Intelligence – volume: 2 start-page: 1 year: 2018 end-page: 6 article-title: Potential for participatory big data ethics and algorithm design: A scoping mapping review publication-title: Proceedings of the 15th Participatory Design Conference – volume: 7 start-page: 1 issue: 2 year: 2020 end-page: 14 article-title: Designing for human rights in AI publication-title: Big Data & Society – volume: 74 start-page: 555 issue: 5 year: 2014 end-page: 556 article-title: Doing what works: Governing in the age of big data publication-title: Public Administration Review – volume: 165 start-page: 633 issue: 3 year: 2017 end-page: 706 article-title: Accountable algorithms publication-title: University of Pennsylvania Law Review – volume: 19 start-page: 121 issue: 1 year: 2012 end-page: 127 article-title: Automation bias: A systematic review of frequency, effect mediators, and mitigators publication-title: Journal of the American Medical Informatics Association – volume: 31 start-page: 611 issue: 4 year: 2018 end-page: 627 article-title: Fair, transparent, and accountable algorithmic decision-making processes publication-title: Philosophy & Technology – volume: 543 start-page: 32 issue: 7643 year: 2017 end-page: 34 article-title: Migration tracking is a mess publication-title: Nature – ident: bibr18-20539517221087855 doi: 10.1177/2056305118764439 – ident: bibr15-20539517221087855 doi: 10.1016/j.giq.2017.11.002 – volume: 2 start-page: 1 year: 2018 ident: bibr76-20539517221087855 publication-title: Proceedings of the 15th Participatory Design Conference – ident: bibr4-20539517221087855 doi: 10.1177/2053951717718854 – start-page: 138826272110312 year: 2021 ident: bibr71-20539517221087855 publication-title: European Journal of Social Security – ident: bibr50-20539517221087855 doi: 10.1111/puar.12625 – ident: bibr13-20539517221087855 doi: 10.1177/2053951715622512 – volume: 14 start-page: 185 issue: 2 year: 2013 ident: bibr59-20539517221087855 publication-title: Georgetown Journal of International Affairs – ident: bibr82-20539517221087855 doi: 10.1145/3274463 – ident: bibr54-20539517221087855 doi: 10.1126/science.aax2342 – ident: bibr61-20539517221087855 doi: 10.1214/21-SS133 – ident: bibr72-20539517221087855 doi: 10.1016/j.giq.2018.10.011 – ident: bibr32-20539517221087855 doi: 10.1111/puar.12136 – ident: bibr56-20539517221087855 doi: 10.1111/puar.12260 – ident: bibr7-20539517221087855 doi: 10.1111/1467-8500.12310 – ident: bibr39-20539517221087855 doi: 10.1080/1369118X.2016.1154087 – volume-title: Forensic Rhetorics and Satellite Surveillance: The Visualization of War Crimes and Human Rights Violations year: 2016 ident: bibr33-20539517221087855 – ident: bibr66-20539517221087855 – ident: bibr6-20539517221087855 doi: 10.1080/014311600210786 – ident: bibr3-20539517221087855 doi: 10.1017/CBO9781316105337.002 – ident: bibr63-20539517221087855 doi: 10.3233/IP-160012 – ident: bibr64-20539517221087855 doi: 10.1007/978-3-030-12554-7 – ident: bibr14-20539517221087855 doi: 10.1111/puar.13293 – ident: bibr16-20539517221087855 doi: 10.1007/s10109-018-0278-1 – ident: bibr62-20539517221087855 doi: 10.1016/j.giq.2017.06.003 – ident: bibr2-20539517221087855 doi: 10.1111/padm.12534 – ident: bibr31-20539517221087855 doi: 10.1080/01431161.2016.1266059 – ident: bibr73-20539517221087855 – volume-title: Little Bites of Big Data for Public Policy year: 2018 ident: bibr38-20539517221087855 – ident: bibr47-20539517221087855 doi: 10.1007/s11077-018-9315-7 – ident: bibr74-20539517221087855 doi: 10.1016/j.jag.2014.11.013 – ident: bibr17-20539517221087855 doi: 10.1177/2053951717726554 – ident: bibr48-20539517221087855 doi: 10.4324/9780429261404-5 – ident: bibr80-20539517221087855 doi: 10.1080/1369118X.2016.1186713 – ident: bibr23-20539517221087855 doi: 10.18574/nyu/9781479854608.001.0001 – ident: bibr10-20539517221087855 doi: 10.3233/IDA-2000-43-413 – ident: bibr12-20539517221087855 doi: 10.3233/IP-200223 – ident: bibr79-20539517221087855 doi: 10.1177/0952076714529139 – ident: bibr42-20539517221087855 doi: 10.1186/s41018-020-00069-1 – ident: bibr26-20539517221087855 doi: 10.1080/0143116021000035021 – ident: bibr70-20539517221087855 – volume: 165 start-page: 633 issue: 3 year: 2017 ident: bibr41-20539517221087855 publication-title: University of Pennsylvania Law Review – ident: bibr8-20539517221087855 doi: 10.1080/1369118X.2012.678878 – volume: 15 issue: 2 year: 2010 ident: bibr75-20539517221087855 publication-title: Innovation Journal – ident: bibr24-20539517221087855 doi: 10.1017/CBO9780511973000 – ident: bibr45-20539517221087855 doi: 10.1080/1369118X.2020.1739731 – ident: bibr58-20539517221087855 doi: 10.1111/1540-6210.00247 – ident: bibr52-20539517221087855 doi: 10.1177/2053951716679679 – ident: bibr55-20539517221087855 – ident: bibr11-20539517221087855 doi: 10.1332/030557319X15613696433190 – ident: bibr57-20539517221087855 doi: 10.4159/harvard.9780674736061 – ident: bibr40-20539517221087855 doi: 10.1007/s10796-016-9686-2 – ident: bibr77-20539517221087855 doi: 10.3390/rs6042912 – ident: bibr53-20539517221087855 doi: 10.1177/2053951716662054 – volume-title: Groupthink: Psychological Studies of Policy Decisions and Fiascoes year: 1982 ident: bibr37-20539517221087855 – ident: bibr69-20539517221087855 – ident: bibr81-20539517221087855 doi: 10.1093/oso/9780198838494.003.0001 – ident: bibr9-20539517221087855 doi: 10.4324/9781315756400-13 – ident: bibr28-20539517221087855 doi: 10.1136/amiajnl-2011-000089 – ident: bibr36-20539517221087855 – ident: bibr49-20539517221087855 doi: 10.1080/01900692.2019.1575664 – ident: bibr21-20539517221087855 doi: 10.1038/543032a – volume-title: Action Research: A Handbook for Practitioners year: 1996 ident: bibr67-20539517221087855 – ident: bibr5-20539517221087855 doi: 10.1093/migration/mnaa003 – ident: bibr20-20539517221087855 doi: 10.1177/0095399714555751 – ident: bibr46-20539517221087855 doi: 10.1371/journal.pone.0230264 – ident: bibr78-20539517221087855 doi: 10.1126/science.aaf6545 – ident: bibr29-20539517221087855 doi: 10.1111/j.1540-6210.2007.00778.x – ident: bibr35-20539517221087855 doi: 10.1332/030557303765371726 – volume-title: Participatory Design: Principles and Practices year: 1993 ident: bibr65-20539517221087855 – ident: bibr60-20539517221087855 doi: 10.1109/TPAMI.2016.2577031 – volume-title: Automating Inequality. How High-Tech Tools Profile, Police, and Punish the Poor year: 2018 ident: bibr22-20539517221087855 – ident: bibr68-20539517221087855 – start-page: 1 year: 2020 ident: bibr27-20539517221087855 publication-title: Information Polity – ident: bibr44-20539517221087855 doi: 10.1332/030557319X15579230420081 – ident: bibr1-20539517221087855 doi: 10.1177/2053951720949566 – year: 2020 ident: bibr30-20539517221087855 publication-title: Regulation & Governance – ident: bibr25-20539517221087855 doi: 10.7551/mitpress/7585.001.0001 – ident: bibr34-20539517221087855 doi: 10.1332/030557319X15579230420126 – ident: bibr51-20539517221087855 – start-page: 135638902199784 year: 2021 ident: bibr19-20539517221087855 publication-title: Evaluation – ident: bibr43-20539517221087855 doi: 10.1007/s13347-017-0279-x |
| SSID | ssj0001485348 |
| Score | 2.2647736 |
| Snippet | There is increasing criticism on the use of big data and algorithms in public governance. Studies revealed that algorithms may reinforce existing biases and... |
| SourceID | doaj proquest crossref sage |
| SourceType | Open Website Aggregation Database Enrichment Source Index Database Publisher |
| SubjectTerms | Accountability Algorithms Bias Big Data Case studies Co-design Data processing Governance Public officials Refugee camps Refugees Reinforcement Scrutiny Transparency |
| SummonAdditionalLinks | – databaseName: ABI/INFORM Global dbid: M0C link: http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwpV3BbhMxELVKy4ELpRREoCAfkJCQLLyOd21zQTRqxYWqhx56W9necaiU7KbZhBMfz9jxJq1Qe-G4Xtuy5BnP83hmHiEfNYCOqXksgDZMlqZiJrjAXGO1t0oa6Vwim1AXF_r62lxmh1ufwyqHMzEd1E3no4_8i6g0WlpE3-Lb4pZF1qj4upopNJ6Qg4hsYkjfTz7Z-VgkGiOp82NmrLMkUOYQUyiBNx2tdEzwu2OOUtX-e1DzTnRXMjjnh_-71BfkeYaa9PtGNo7IHrQvyeFA40CzVh-TP5OONSmQA80YtbMpzrX6Ne8p4lk6TVy8UTS-0rO2T0mNdDkE1s6A2rahdkM5YdP3MP7G0_k2toZ2AUeF9RSAejtf0H6d4G__ilydn11NfrBMysC8VHzFFA-ugaArVwgOrilMA9xbrwCxQVN6J8ALK3RQUipXjr0SwRiHah6RgB-_Jvtt18IbQnUFeJ8qIndWKaEqDbdjhJfclYUNOO-I8GFrap8LlkfejFld5Brl_-zmiHzeDllsqnU81vk07ve2Yyy0nRq65bTOelvzYAIPQUHiKFIISAPnaBMUIlGtxnpETgYZqLP29_VOAEbkU5Sg3a8HV_P28YnekWciJl4k588J2V8t1_CePPW_Vzf98kMS-79WLgeR priority: 102 providerName: ProQuest |
| Title | Co-designing algorithms for governance: Ensuring responsible and accountable algorithmic management of refugee camp supplies |
| URI | https://journals.sagepub.com/doi/full/10.1177/20539517221087855 https://www.proquest.com/docview/2682732602 https://doaj.org/article/0f9f0ff7e627417095f00add72328738 |
| Volume | 9 |
| WOSCitedRecordID | wos000780879700001&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| journalDatabaseRights | – providerCode: PRVAON databaseName: DOAJ Directory of Open Access Journals customDbUrl: eissn: 2053-9517 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0001485348 issn: 2053-9517 databaseCode: DOA dateStart: 20140101 isFulltext: true titleUrlDefault: https://www.doaj.org/ providerName: Directory of Open Access Journals – providerCode: PRVHPJ databaseName: ROAD: Directory of Open Access Scholarly Resources (ISSN International Center) customDbUrl: eissn: 2053-9517 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0001485348 issn: 2053-9517 databaseCode: M~E dateStart: 20140101 isFulltext: true titleUrlDefault: https://road.issn.org providerName: ISSN International Centre – providerCode: PRVPQU databaseName: ABI/INFORM Global customDbUrl: eissn: 2053-9517 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0001485348 issn: 2053-9517 databaseCode: M0C dateStart: 20180101 isFulltext: true titleUrlDefault: https://search.proquest.com/abiglobal providerName: ProQuest – providerCode: PRVPQU databaseName: Access via ABI/INFORM (ProQuest) customDbUrl: eissn: 2053-9517 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0001485348 issn: 2053-9517 databaseCode: 7WY dateStart: 20180101 isFulltext: true titleUrlDefault: https://www.proquest.com/abicomplete providerName: ProQuest – providerCode: PRVPQU databaseName: ProQuest Central customDbUrl: eissn: 2053-9517 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0001485348 issn: 2053-9517 databaseCode: BENPR dateStart: 20180101 isFulltext: true titleUrlDefault: https://www.proquest.com/central providerName: ProQuest – providerCode: PRVPQU databaseName: Publicly Available Content Database customDbUrl: eissn: 2053-9517 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0001485348 issn: 2053-9517 databaseCode: PIMPY dateStart: 20180101 isFulltext: true titleUrlDefault: http://search.proquest.com/publiccontent providerName: ProQuest – providerCode: PRVPQU databaseName: Research Library (ProQuest) customDbUrl: eissn: 2053-9517 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0001485348 issn: 2053-9517 databaseCode: M2O dateStart: 20180101 isFulltext: true titleUrlDefault: https://search.proquest.com/pqrl providerName: ProQuest |
| link | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwrV3Pa9swFH507Q67rO1-sGxt0KEwGJjJimxJu7UhZT00DaOw9mQkWUoLiVPiZKf98XuS7SxjdL3sIrAlGaH3xPue_N77AE6kczKk5iXeSZXwTOWJ8sYnptTSasEVNyaSTYjxWN7cqMkW1VeICWvKAzcb95l65an3wkWSGIGIwFOKh1IgFJBiENN8qVBbzlS8XeFohrhsf2OGCksMtQ3RhGDo40ghQ2rfliGK9fr_AJlbcV3R1JwfwMsWI5LTZm2HsOOqV7Df8S-Q9ji-hp_DRVLGCAy0P0TPpgv09O_mNUEgSqaRRDfI9AsZVXXMRiTLLiJ25oiuSqIbrggdn7v595bMN0ExZOFxll9PnSNWzx9IvY64tX4D1-ej6-HXpGVTSCwXdJUI6k3pvMxNyqgzZapKR622wqFRLzNrmLNMM-kF58JkAyuYV8rg-Qwm3A7ewm61qNw7IDJ36AilgfQq4y7PFNUDxIXUZKn2-N0e0G5nC9tWGg-EF7MibYuL_yWMHnzaTHloymz8a_BZENdmYKiQHV-g3hSt3hRP6U0PjjphF-2xrQuWS4Rz6OKxHnwMCvC769HVvP8fq_kAL1jIq4h3O0ewu1qu3TE8tz9W9_WyD8_E99s-7J2NxpNv_ajp2F7SYWjZFfZMLi4nt78AwLT-1w |
| linkProvider | Directory of Open Access Journals |
| linkToHtml | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMw1V3Pb9MwFH4aAwkuG78mOgb4AEJCinBcJ7aREIKyadNGxaGH3SLbscukNilNC0LiX-J_5NlN2iHEbjtwTGJbkfPlvc_2e-8DeC6dkyE1L_FOqoRnKk-UNz4xpZZWC664MVFsQgyH8vxcfd6CX10uTAir7GxiNNRlbcMe-WuWS_S0yL7Zu9nXJKhGhdPVTkJjBYtT9-M7Ltmatycf8fu-YOzocDQ4TlpVgcRyQReJoN6UzsvcpIw6U6aqdNRqKxw6tzKzhjnLNJNecC5M1reCeaUM4jS4MtvHYW_ATc7x7wiRgnSw2dLh6Pu4bM9OQ1knhhBHCiMYLqykkCGf8JL3iyIBfzDbS8Fk0b8d7f5nM3MXdloiTd6vkH8Ptlx1H3Y7kQrS2qwH8HNQJ2UMU0EnTfRkjK---DJtCLJ1Mo5KwwH4b8hh1cSUTTLvwoYnjuiqJHolqKHjddf_wpLpOnKI1B57-eXYOWL1dEaaZST3zUMYXccU7MF2VVfuERCZO1wtpkEZLOMuzxTVfSTP1GSp9jhuD2iHhMK25diDKsikSNsK7H-Bpwev1l1mq1okVzX-EOC1bhjKiMcb9XxctFapoF556r1wUYFJIN32lKLHE8izpejLHhx0kCta29YUG7z14GUA7ObRP99m_-qBnsHt49Gns-LsZHj6GO6wkGISt7kOYHsxX7oncMt-W1w086fxjyNQXDOOfwMqb2Uu |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Co-designing+algorithms+for+governance%3A+Ensuring+responsible+and+accountable+algorithmic+management+of+refugee+camp+supplies&rft.jtitle=Big+data+%26+society&rft.au=Rianne+Dekker&rft.au=Paul+Koot&rft.au=S.+Ilker+Birbil&rft.au=Mark+van+Embden+Andres&rft.date=2022-01-01&rft.pub=SAGE+Publishing&rft.eissn=2053-9517&rft.volume=9&rft_id=info:doi/10.1177%2F20539517221087855&rft.externalDBID=DOA&rft.externalDocID=oai_doaj_org_article_0f9f0ff7e627417095f00add72328738 |
| thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=2053-9517&client=summon |
| thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=2053-9517&client=summon |
| thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=2053-9517&client=summon |