Measuring and Reporting Intercoder Reliability in Plan Quality Evaluation Research
Plan quality evaluation researchers typically evaluate plans in relation to whether they contain certain desirable features. Best practice dictates that plans be evaluated by at least two readers and that researchers report a measure of the extent to which the readers agree on whether the plans cont...
Saved in:
| Published in: | Journal of planning education and research Vol. 34; no. 1; pp. 77 - 93 |
|---|---|
| Main Authors: | , , |
| Format: | Journal Article |
| Language: | English |
| Published: |
Los Angeles, CA
SAGE Publications
01.03.2014
Sage Publications Ltd |
| Subjects: | |
| ISSN: | 0739-456X, 1552-6577 |
| Online Access: | Get full text |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| Abstract | Plan quality evaluation researchers typically evaluate plans in relation to whether they contain certain desirable features. Best practice dictates that plans be evaluated by at least two readers and that researchers report a measure of the extent to which the readers agree on whether the plans contain the desirable features. Established practice for assessing this agreement has been subject to criticism. We summarize this criticism, discuss an alternative approach to assessing agreement, and provide recommendations for plan quality evaluation researchers to follow to improve the quality of their data and the manner in which they assess and report that quality. |
|---|---|
| AbstractList | Plan quality evaluation researchers typically evaluate plans in relation to whether they contain certain desirable features. Best practice dictates that plans be evaluated by at least two readers and that researchers report a measure of the extent to which the readers agree on whether the plans contain the desirable features. Established practice for assessing this agreement has been subject to criticism. We summarize this criticism, discuss an alternative approach to assessing agreement, and provide recommendations for plan quality evaluation researchers to follow to improve the quality of their data and the manner in which they assess and report that quality. Plan quality evaluation researchers typically evaluate plans in relation to whether they contain certain desirable features. Best practice dictates that plans be evaluated by at least two readers and that researchers report a measure of the extent to which the readers agree on whether the plans contain the desirable features. Established practice for assessing this agreement has been subject to criticism. We summarize this criticism, discuss an alternative approach to assessing agreement, and provide recommendations for plan quality evaluation researchers to follow to improve the quality of their data and the manner in which they assess and report that quality. [Reprinted by permission of Sage Publications Inc., copyright Association of Collegiate Schools of Planning.] Plan quality evaluation researchers typically evaluate plans in relation to whether they contain certain desirable features. Best practice dictates that plans be evaluated by at least two readers and that researchers report a measure of the extent to which the readers agree on whether the plans contain the desirable features. Established practice for assessing this agreement has been subject to criticism. We summarize this criticism, discuss an alternative approach to assessing agreement, and provide recommendations for plan quality evaluation researchers to follow to improve the quality of their data and the manner in which they assess and report that quality. [PUBLICATION ABSTRACT] |
| Author | Stevens, Mark R. Berke, Philip R. Lyles, Ward |
| Author_xml | – sequence: 1 givenname: Mark R. surname: Stevens fullname: Stevens, Mark R. email: xstevens@mail.ubc.ca – sequence: 2 givenname: Ward surname: Lyles fullname: Lyles, Ward – sequence: 3 givenname: Philip R. surname: Berke fullname: Berke, Philip R. |
| BookMark | eNqNkctLxDAQxoMouK7ePRa8eKlmmld7FPGxsOIDBW8lTacaqematML-96auB1nwcRpm5vcN38zskE3XOSRkH-gRgFLHVLGCC_kITACTwDfIBITIUimU2iSTsZ2O_W2yE8ILpRlwpibk7gp1GLx1T4l2dXKHi873YzZzPXrT1ehjsbW6sq3tl4l1yU2rXXI76M_87F23g-5t5yIWUHvzvEu2Gt0G3PuKU_JwfnZ_epnOry9mpyfz1HAOfcqYoRyyijaszlBKUTdFjRpqBYY2OVW6jrWKqrhehnmdNQolal6xhtOsMmxKDldzF757GzD05asNBttoD7shlCAVSCh4of5GBYMiY0Lwf6BUMJbHs0b0YA196Qbv4s4jleeMU1ZEiq4o47sQPDblwttX7Zcl0HJ8Xbn-uiiRaxJj-88j917b9jdhuhIG_YTf3PzEfwDM5Ko8 |
| CitedBy_id | crossref_primary_10_3390_su141911872 crossref_primary_10_3390_su11174811 crossref_primary_10_1080_01944363_2020_1752776 crossref_primary_10_1111_grow_12481 crossref_primary_10_1186_s13705_025_00531_1 crossref_primary_10_3390_su8090763 crossref_primary_10_1016_j_jenvman_2022_115493 crossref_primary_10_1080_09640568_2021_1971955 crossref_primary_10_1016_j_landurbplan_2018_10_007 crossref_primary_10_1080_09640568_2014_973479 crossref_primary_10_1080_01944363_2018_1430606 crossref_primary_10_1080_09640568_2024_2417198 crossref_primary_10_1080_02508060_2023_2214876 crossref_primary_10_1080_07352166_2020_1834405 crossref_primary_10_1080_01944363_2020_1829498 crossref_primary_10_1177_0739456X221144610 crossref_primary_10_1177_0885412220914990 crossref_primary_10_1080_01944363_2024_2386055 crossref_primary_10_1007_s11027_016_9725_9 crossref_primary_10_1080_09654313_2017_1353592 crossref_primary_10_1080_09640568_2021_1902789 crossref_primary_10_1080_08920753_2017_1303757 crossref_primary_10_1108_JFRA_10_2024_0748 crossref_primary_10_1016_j_jenvman_2019_109984 crossref_primary_10_1080_1523908X_2023_2244446 crossref_primary_10_1177_0739456X221100503 crossref_primary_10_1080_02697459_2021_1919431 crossref_primary_10_1007_s11069_014_1117_4 crossref_primary_10_1016_j_landusepol_2021_105572 crossref_primary_10_1108_MEDAR_02_2020_0770 crossref_primary_10_1016_j_evalprogplan_2022_102186 crossref_primary_10_1080_01944363_2022_2096100 crossref_primary_10_1080_12265934_2020_1751684 crossref_primary_10_1177_0739456X231197182 crossref_primary_10_1016_j_jrurstud_2022_12_008 crossref_primary_10_1177_0739456X16659700 crossref_primary_10_1371_journal_pone_0185972 crossref_primary_10_1080_1523908X_2016_1265885 crossref_primary_10_1016_j_uclim_2024_102258 crossref_primary_10_1080_01944363_2021_2004913 crossref_primary_10_1080_02697459_2024_2323886 crossref_primary_10_1016_j_landurbplan_2016_04_003 crossref_primary_10_3390_su15020934 crossref_primary_10_1177_0739456X211053654 crossref_primary_10_1016_j_jenvman_2025_126105 crossref_primary_10_24193_JSSP_2022_2_03 crossref_primary_10_1371_journal_pone_0310236 crossref_primary_10_1177_23998083251351743 crossref_primary_10_1061__ASCE_NH_1527_6996_0000519 crossref_primary_10_1177_0739456X19861144 crossref_primary_10_4102_td_v18i1_1146 crossref_primary_10_1080_02697459_2024_2305564 crossref_primary_10_1016_j_landusepol_2019_03_025 crossref_primary_10_1080_02697459_2022_2126165 crossref_primary_10_1371_journal_pone_0235773 crossref_primary_10_1038_nclimate3012 crossref_primary_10_1080_1523908X_2020_1781605 crossref_primary_10_1080_17477891_2017_1407743 crossref_primary_10_1007_s13280_023_01974_6 crossref_primary_10_1061__ASCE_NH_1527_6996_0000470 crossref_primary_10_1111_psj_12364 crossref_primary_10_1080_01944363_2014_976585 crossref_primary_10_1080_01944363_2023_2271893 crossref_primary_10_1080_02697459_2025_2465940 crossref_primary_10_1007_s10584_019_02488_5 crossref_primary_10_1080_07352166_2022_2038033 crossref_primary_10_1093_biosci_bix012 crossref_primary_10_1177_0739456X241236486 crossref_primary_10_1016_j_landusepol_2017_07_026 crossref_primary_10_1016_j_scs_2025_106683 crossref_primary_10_1111_grow_12615 crossref_primary_10_1177_0739456X16628605 crossref_primary_10_1088_1748_9326_ad5d05 crossref_primary_10_1186_s40494_022_00818_y crossref_primary_10_1080_20964129_2022_2070550 crossref_primary_10_1080_09640568_2017_1391070 crossref_primary_10_1016_j_cities_2021_103239 crossref_primary_10_3390_su12176868 crossref_primary_10_1016_j_ijinfomgt_2020_102154 crossref_primary_10_1080_01944363_2022_2029542 crossref_primary_10_1177_0739456X20963605 crossref_primary_10_1016_j_landusepol_2021_105893 crossref_primary_10_1007_s10584_018_2312_1 crossref_primary_10_1007_s11069_018_3420_y crossref_primary_10_1080_01944363_2023_2211574 crossref_primary_10_1177_0739456X211002910 crossref_primary_10_1177_2399808317737070 crossref_primary_10_1016_j_landusepol_2017_11_049 crossref_primary_10_1007_s10584_021_02987_4 crossref_primary_10_1007_s11205_019_02234_5 crossref_primary_10_1080_21650349_2025_2481254 crossref_primary_10_1080_24694452_2023_2284299 crossref_primary_10_1016_j_envsci_2025_104127 crossref_primary_10_1080_01944363_2015_1093954 crossref_primary_10_1080_09640568_2020_1835618 crossref_primary_10_1177_0739456X18801057 crossref_primary_10_1080_09640568_2016_1151771 crossref_primary_10_1016_j_landurbplan_2020_103891 crossref_primary_10_1007_s11069_018_3225_z crossref_primary_10_1080_01944363_2022_2038659 crossref_primary_10_1061_JHTRBP_HZENG_1370 crossref_primary_10_1177_0739456X251372082 crossref_primary_10_1057_s41310_020_00092_z crossref_primary_10_1080_09640568_2022_2082930 crossref_primary_10_1016_j_landusepol_2020_105188 crossref_primary_10_1080_01944363_2017_1404486 crossref_primary_10_1177_0739456X19827083 crossref_primary_10_1177_0739456X15570320 crossref_primary_10_1080_23812346_2025_2559676 crossref_primary_10_1016_j_cities_2021_103465 crossref_primary_10_1016_j_ufug_2023_127985 crossref_primary_10_1177_0739456X14549752 crossref_primary_10_1080_10511482_2024_2337033 crossref_primary_10_1108_JAAR_10_2020_0214 |
| Cites_doi | 10.20965/jdr.2010.p0526 10.1080/09640560903399772 10.1016/j.landurbplan.2003.09.002 10.1080/01944360708976138 10.1177/0739456X05278984 10.1016/j.landusepol.2012.08.009 10.5055/jem.2011.0045 10.3390/challe3020183 10.1108/09653560610669936 10.1023/A:1025078715216 10.1080/13574800903265496 10.1016/j.landurbplan.2012.05.014 10.1016/j.landurbplan.2012.05.009 10.1177/0081175012444860 10.1016/j.ocecoaman.2008.06.001 10.1097/FCH.0b013e31820e0d47 10.1068/b240451 10.1177/001316446002000104 10.1080/01944360802377973 10.1080/19312450709336664 10.1177/0739456X05280546 10.1016/j.landusepol.2007.10.006 10.1068/b34076 10.1086/266577 10.1068/b260643 10.1068/a367 10.1080/01944369408975604 10.1080/08920753.2010.540708 10.1016/j.ocecoaman.2004.03.005 10.4135/9781412985642 10.1080/09640569612688 10.1080/01944363.2011.619951 10.1177/0739456X07305792 10.1177/1524839910381699 10.1177/0739456X03258635 10.1080/19312458.2011.568376 10.1080/01944369708975926 10.1177/0739456X03022004002 10.1080/09640560801979667 10.1080/09640568.2012.756805 10.1080/01944369808976004 10.1080/01944360008976081 10.1111/j.1468-2958.2004.tb00738.x 10.1080/01944360208976265 10.4135/9781412985123 10.56021/9780801856235 10.1016/j.landurbplan.2006.04.005 10.1080/09640569408711967 10.1177/0739456X02238442 10.2307/976725 10.1061/(ASCE)NH.1527-6996.0000063 10.1080/15389580903434199 10.1080/01944360508976405 10.1177/088541229601000302 10.1080/01944363.2010.509703 10.1177/0885412208327014 10.1111/j.1468-2958.2002.tb00826.x 10.1177/0739456X9401300401 10.1007/s11027-010-9270-x |
| ContentType | Journal Article |
| Copyright | The Author(s) 2014 Copyright Sage Publications Ltd. Spring 2014 |
| Copyright_xml | – notice: The Author(s) 2014 – notice: Copyright Sage Publications Ltd. Spring 2014 |
| DBID | AAYXX CITATION 7TB 7TQ 8FD DHY DON FR3 KR7 7ST 7U6 C1K |
| DOI | 10.1177/0739456X13513614 |
| DatabaseName | CrossRef Mechanical & Transportation Engineering Abstracts PAIS Index Technology Research Database PAIS International PAIS International (Ovid) Engineering Research Database Civil Engineering Abstracts Environment Abstracts Sustainability Science Abstracts Environmental Sciences and Pollution Management |
| DatabaseTitle | CrossRef Civil Engineering Abstracts Engineering Research Database Technology Research Database Mechanical & Transportation Engineering Abstracts PAIS International Environment Abstracts Sustainability Science Abstracts Environmental Sciences and Pollution Management |
| DatabaseTitleList | CrossRef PAIS International Environment Abstracts Civil Engineering Abstracts Civil Engineering Abstracts |
| DeliveryMethod | fulltext_linktorsrc |
| Discipline | Architecture Sociology & Social History Education |
| EISSN | 1552-6577 |
| EndPage | 93 |
| ExternalDocumentID | 3251593001 10_1177_0739456X13513614 10.1177_0739456X13513614 |
| Genre | Feature |
| GroupedDBID | -TM .2G .2L 01A 09Z 0R~ 1~K 29L 31S 31V 31W 31X 4.4 56W 5GY 5VS 90D AABOD AACKU AADIR AADUE AAGGD AAGLT AAHSB AAJPV AAKTJ AAMFR AANSI AAPEO AAQDB AAQXI AARIX AATAA AAWLO AAZLU ABAWP ABCCA ABCJG ABEIX ABFXH ABHQH ABIDT ABJNI ABKRH ABPNF ABQKF ABQPY ABQXT ABRHV ABUJY ABYTW ACAEP ACCVJ ACDXX ACFUR ACFZE ACGFS ACHQT ACIWK ACJER ACLZU ACOFE ACOXC ACROE ACRPL ACSIQ ACUFS ACUIR ADDLC ADEBD ADEIA ADNMO ADNON ADPEE ADRRZ ADSTG ADTOS ADUKL ADYCS AEDXQ AEOBU AESMA AESZF AEUHG AEVPJ AEWDL AEWHI AEXNY AFEET AFKBI AFKRG AFMOU AFQAA AFRAH AFUIA AFWMB AGDVU AGKLV AGNHF AGNWV AGQPQ AGWNL AHDMH AHHCN AHHFK AHWHD AI. AJUZI ALFTD ALMA_UNASSIGNED_HOLDINGS ANDLU ARTOV ASPBG AUTPY AUVAJ AVWKF AYPQM AZFZN B8O B8S B8T B8Z BDZRT BMVBW BPACV BYIEH CAG CBRKF CCGJY CEADM COF CS3 DD0 DD~ DG~ DOPDO DV7 DV8 EBS EJD FEDTE FHBDP GROUPED_SAGE_PREMIER_JOURNAL_COLLECTION H13 HF~ HVGLF HZ~ H~9 J8X N9A O9- P.B P2P PQQKQ Q1R Q7O Q7P Q7X ROL S01 SASJQ SAUOL SBI SCNPE SFB SFC SFK SFT SFU SFX SGP SGU SGV SHB SHF SHM SPJ SPP SQCSI SSDHQ TN5 VH1 XOL ZPLXX ZPPRI ~32 AAEJI AAPII AAYXX ABUAX ACCVC AEYHP AJGYC AJHME AJVBE AMNSR CITATION 7TB 7TQ 8FD DHY DON FR3 KR7 7ST 7U6 C1K |
| ID | FETCH-LOGICAL-c441t-33c0412b0f3d2e665df9dea1d71c0f807ad65db071172e8d2f7e6ea4b3f402bc3 |
| IEDL.DBID | AEVPJ |
| ISICitedReferencesCount | 130 |
| ISICitedReferencesURI | http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000331199600006&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| ISSN | 0739-456X |
| IngestDate | Sun Nov 09 11:00:36 EST 2025 Tue Oct 21 13:13:06 EDT 2025 Tue Oct 07 10:00:17 EDT 2025 Mon Nov 10 02:43:05 EST 2025 Sat Nov 29 08:16:59 EST 2025 Tue Nov 18 22:37:43 EST 2025 Tue Jun 17 22:48:00 EDT 2025 |
| IsPeerReviewed | true |
| IsScholarly | true |
| Issue | 1 |
| Keywords | percent agreement Krippendorff’s alpha intercoder reliability content analysis plan quality plan evaluation |
| Language | English |
| LinkModel | DirectLink |
| MergedId | FETCHMERGED-LOGICAL-c441t-33c0412b0f3d2e665df9dea1d71c0f807ad65db071172e8d2f7e6ea4b3f402bc3 |
| Notes | SourceType-Scholarly Journals-1 ObjectType-Feature-1 content type line 14 ObjectType-Article-1 ObjectType-Feature-2 content type line 23 |
| PQID | 1508834039 |
| PQPubID | 43228 |
| PageCount | 17 |
| ParticipantIDs | proquest_miscellaneous_1671619497 proquest_miscellaneous_1531923554 proquest_miscellaneous_1505338657 proquest_journals_1508834039 crossref_primary_10_1177_0739456X13513614 crossref_citationtrail_10_1177_0739456X13513614 sage_journals_10_1177_0739456X13513614 |
| PublicationCentury | 2000 |
| PublicationDate | 2014-03-01 |
| PublicationDateYYYYMMDD | 2014-03-01 |
| PublicationDate_xml | – month: 03 year: 2014 text: 2014-03-01 day: 01 |
| PublicationDecade | 2010 |
| PublicationPlace | Los Angeles, CA |
| PublicationPlace_xml | – name: Los Angeles, CA – name: Thousand Oaks |
| PublicationTitle | Journal of planning education and research |
| PublicationYear | 2014 |
| Publisher | SAGE Publications Sage Publications Ltd |
| Publisher_xml | – name: SAGE Publications – name: Sage Publications Ltd |
| References | Baer 1997; 63 Berke, Roenigk, Kaiser, Burby 1996; 39 Krippendorff 2011; 5 Norton 2008; 25 Kang, Peacock, Husein 2010; 5 Preston, Westaway, Yuen 2011; 16 Hayes, Krippendorff 2007; 1 Tang, Lindell, Prater, Wei, Hussey 2011; 39 Horney, Naimi, Lyles, Simon, Salvesen, Berke 2012; 3 Berke, Dixon, Ericksen 1997; 24 Jones, Evenson, Rodriguez, Aytur 2010; 11 Brody, Highfield, Carrasco 2004; 69 Hoch 2007; 73 Norton 2005b; 71 Brody 2003b; 24 Freelon 2010; 5 Brody, Carrasco, Highfield 2006; 25 Berke, Crawford, Dixon, Ericksen 1999; 26 Tang 2008; 51 Dalton, Burby 1994; 60 Tang, Brody, Quinn, Chang, Wei 2010; 53 Lombard, Snyder-Duch, Bracken 2002; 28 Brody 2003a; 23 Wheeler 2008; 74 Davis 2004; 47 Edwards, Haines 2007; 27 Evenson, Satinsky, Rodriguez, Aytur 2012; 13 Srivastava, Laurian 2006; 15 Aytur, Satinsky, Evenson, Rodriguez 2011; 34 Berke, Godschalk 2009; 23 Baker, Peterson, Brown, McAlpine 2012; 107 Krippendorff 2004; 30 Talen 1996; 10 Stone, Vargo, Habeeb 2012; 107 Berke, Ericksen, Crawford, Dixon 2002; 22 Tang, Brody 2009; 36 Berke 1994; 37 Bassett, Shandas 2010; 76 Scott 1955; 19 Evans-Cowley, Gough 2009; 14 Compton, Love, Sell 2012; 42 Baynham, Stevens 2013 Bunnell, Jepson 2011; 77 Burby, Dalton 1994; 54 Talen, Knaap 2003; 22 Manta-Conroy, Berke 2004; 36 Olonilua, Ibitayo 2011; 9 Kaiser, Davies 1999; 24 Evans-Cowley, Gough 2008; 51 Berke, Manta-Conroy 2000; 66 Deyle, Smith 1998; 64 Termorshuizen, Paul, van den Brink 2007; 79 Berke, Spurlock, Hess, Band 2013; 31 Nelson, French 2002; 68 Berke, French 1994; 13 Norton 2005a; 25 Berke, Smith, Lyles 2012; 13 Cohen 1960; 20 bibr31-0739456X13513614 bibr15-0739456X13513614 bibr40-0739456X13513614 bibr14-0739456X13513614 bibr66-0739456X13513614 bibr23-0739456X13513614 bibr1-0739456X13513614 bibr48-0739456X13513614 bibr13-0739456X13513614 bibr56-0739456X13513614 bibr30-0739456X13513614 bibr39-0739456X13513614 Freelon Deen G. (bibr35-0739456X13513614) 2010; 5 Wesman Alexander G. (bibr68-0739456X13513614) 1971 bibr22-0739456X13513614 Putt Allen D. (bibr57-0739456X13513614) 1989 bibr65-0739456X13513614 bibr17-0739456X13513614 bibr51-0739456X13513614 bibr25-0739456X13513614 bibr38-0739456X13513614 bibr64-0739456X13513614 bibr62-0739456X13513614 bibr67-0739456X13513614 bibr7-0739456X13513614 bibr54-0739456X13513614 bibr41-0739456X13513614 bibr59-0739456X13513614 bibr33-0739456X13513614 bibr2-0739456X13513614 bibr20-0739456X13513614 bibr6-0739456X13513614 bibr61-0739456X13513614 bibr28-0739456X13513614 bibr44-0739456X13513614 Berke Philip R. (bibr12-0739456X13513614) 2006 bibr19-0739456X13513614 bibr53-0739456X13513614 bibr27-0739456X13513614 Miles Matthew B. (bibr49-0739456X13513614) 1984 bibr60-0739456X13513614 bibr5-0739456X13513614 bibr10-0739456X13513614 bibr43-0739456X13513614 bibr18-0739456X13513614 Godschalk David R. (bibr36-0739456X13513614) 1999 bibr52-0739456X13513614 bibr4-0739456X13513614 bibr26-0739456X13513614 bibr69-0739456X13513614 Wimmer Roger D. (bibr70-0739456X13513614) 1983 bibr55-0739456X13513614 bibr47-0739456X13513614 bibr8-0739456X13513614 Miles Matthew B. (bibr50-0739456X13513614) 1994 bibr9-0739456X13513614 bibr21-0739456X13513614 bibr3-0739456X13513614 bibr34-0739456X13513614 Krippendorff Klaus (bibr46-0739456X13513614) 2013 bibr24-0739456X13513614 bibr29-0739456X13513614 bibr11-0739456X13513614 bibr32-0739456X13513614 bibr45-0739456X13513614 bibr16-0739456X13513614 Kaiser Edward J. (bibr42-0739456X13513614) 1999; 24 bibr58-0739456X13513614 Hamin Elisabeth M. (bibr37-0739456X13513614) 2011 bibr63-0739456X13513614 |
| References_xml | – volume: 1 start-page: 77 issue: 1 year: 2007 end-page: 89 article-title: Answering the Call for a Standard Reliability Measure for Coding Data publication-title: Communication Methods and Measures – volume: 22 start-page: 115 issue: 2 year: 2002 end-page: 34 article-title: Planning for Indigenous People: Human Rights and Environmental Protection in New Zealand publication-title: Journal of Planning Education and Research – volume: 13 start-page: 204 issue: 2 year: 2012 end-page: 13 article-title: Exploring a Public Health Perspective on Pedestrian Planning publication-title: Health Promotion Practice – volume: 23 start-page: 227 issue: 3 year: 2009 end-page: 40 article-title: Searching for the Good Plan: A Meta-analysis of Plan Quality Studies publication-title: Journal of Planning Literature – volume: 25 start-page: 294 issue: 3 year: 2006 end-page: 310 article-title: Measuring the Adoption of Local Sprawl Reduction Planning Policies in Florida publication-title: Journal of Planning Education and Research – volume: 51 start-page: 544 issue: 7 year: 2008 end-page: 55 article-title: Evaluating Local Coastal Zone Land Use Planning Capacities in California publication-title: Ocean & Coastal Management – volume: 10 start-page: 248 issue: 3 year: 1996 end-page: 59 article-title: Do Plans Get Implemented? A Review of Evaluation in Planning publication-title: Journal of Planning Literature – volume: 34 start-page: 173 issue: 2 year: 2011 end-page: 81 article-title: Pedestrian and Bicycle Planning in Rural Communities: Tools for Active Living publication-title: Family & Community Health – volume: 68 start-page: 194 issue: 2 year: 2002 end-page: 207 article-title: Plan Quality and Mitigating Damage from Natural Disasters: A Case Study of the Northridge Earthquake with Planning Policy Considerations publication-title: Journal of the American Planning Association – volume: 19 start-page: 321 issue: 3 year: 1955 end-page: 25 article-title: Reliability of Content Analysis: The Case of Nominal Scale Coding publication-title: Public Opinion Quarterly – volume: 77 start-page: 338 issue: 4 year: 2011 end-page: 53 article-title: The Effect of Mandated Planning on Plan Quality publication-title: Journal of the American Planning Association – volume: 16 start-page: 407 issue: 4 year: 2011 end-page: 38 article-title: Climate Adaptation Planning in Practice: An Evaluation of Adaptation Plans from Three Developed Nations publication-title: Mitigation and Adaptation Strategies for Global Change – volume: 36 start-page: 522 issue: 6 year: 2009 end-page: 37 article-title: Linking Planning Theories with Factors Influencing Local Environmental-Plan Quality publication-title: Environment and Planning B – volume: 73 start-page: 86 issue: 1 year: 2007 end-page: 99 article-title: How Plan Mandates Work: Affordable Housing in Illinois publication-title: Journal of the American Planning Association – volume: 5 start-page: 520 issue: 5 year: 2010 end-page: 28 article-title: An Assessment of Coastal Zone Hazard Mitigation Plans in Texas publication-title: Journal of Disaster Research – volume: 74 start-page: 481 issue: 4 year: 2008 end-page: 96 article-title: State and Municipal Climate Change Plans publication-title: Journal of the American Planning Association – volume: 9 start-page: 37 issue: 1 year: 2011 end-page: 49 article-title: Toward Multihazard Mitigation: An Evaluation of FEMA-Approved Hazard Mitigation Plans under the Disaster Mitigation Act of 2000 publication-title: Journal of Emergency Management – volume: 51 start-page: 399 issue: 3 year: 2008 end-page: 419 article-title: Evaluating Environmental Protection in Post-Hurricane Katrina Plans in Mississippi publication-title: Journal of Environmental Planning and Management – volume: 24 start-page: 29 issue: 2 year: 1999 end-page: 41 article-title: What a Good Plan Should Contain: A Proposed Model publication-title: Carolina Planning – volume: 107 start-page: 127 issue: 2 year: 2012 end-page: 36 article-title: Local Government Response to the Impacts of Climate Change: An Evaluation of Local Climate Adaptation Plans publication-title: Landscape and Urban Planning – volume: 28 start-page: 587 issue: 4 year: 2002 end-page: 604 article-title: Content Analysis in Mass Communication: Assessment and Reporting of Intercoder Reliability publication-title: Human Communication Research – volume: 26 start-page: 643 issue: 5 year: 1999 end-page: 64 article-title: Do Cooperative Environmental Planning Mandates Produce Good Plans? Empirical Results from the New Zealand Experience publication-title: Environment and Planning B: Planning and Design – volume: 66 start-page: 21 issue: 1 year: 2000 end-page: 33 article-title: Are We Planning for Sustainable Development? An Evaluation of 30 Comprehensive Plans publication-title: Journal of the American Planning Association – volume: 25 start-page: 432 issue: 3 year: 2008 end-page: 54 article-title: Using Content Analysis to Evaluate Local Master Plans and Zoning Codes publication-title: Land Use Policy – volume: 37 start-page: 155 issue: 2 year: 1994 end-page: 70 article-title: Evaluating Environmental Plan Quality: The Case of Planning for Sustainable Development in New Zealand publication-title: Journal of Environmental Planning and Management – volume: 24 start-page: 511 issue: 6 year: 2003b end-page: 40 article-title: Implementing the Principles of Ecosystem Management through Local Land Use Planning publication-title: Population and Environment – volume: 36 start-page: 1381 issue: 8 year: 2004 end-page: 96 article-title: What Makes a Good Sustainable Development Plan? An Analysis of Factors That Influence Principles of Sustainable Development publication-title: Environment and Planning A – year: 2013 article-title: Are We Planning Effectively for Climate Change? An Evaluation of Official Community Plans in British Columbia publication-title: Journal of Environmental Planning and Management – volume: 107 start-page: 263 issue: 3 year: 2012 end-page: 71 article-title: Managing Climate Change in Cities: Will Climate Action Plans Work?” publication-title: Landscape and Urban Planning – volume: 23 start-page: 191 issue: 2 year: 2003a end-page: 201 article-title: Are We Learning to Make Better Plans? A Longitudinal Analysis of Plan Quality Associated with Natural Hazards publication-title: Journal of Planning Education and Research – volume: 11 start-page: 57 issue: 1 year: 2010 end-page: 65 article-title: Addressing Pedestrian Safety: A Content Analysis of Pedestrian Master Plans in North Carolina publication-title: Traffic Injury Prevention – volume: 30 start-page: 411 issue: 3 year: 2004 end-page: 33 article-title: Reliability in Content Analysis: Some Common Misconceptions and Recommendations publication-title: Human Communication Research – volume: 24 start-page: 451 issue: 3 year: 1997 end-page: 68 article-title: Coercive and Cooperative Intergovernmental Mandates: A Comparative Analysis of Florida and New Zealand Environmental Plans publication-title: Environment and Planning B: Planning and Design – volume: 5 start-page: 20 issue: 1 year: 2010 end-page: 33 article-title: ReCal: Intercoder Reliability Calculation as a Web Service publication-title: International Journal of Internet Science – volume: 54 start-page: 229 issue: 3 year: 1994 end-page: 38 article-title: Plans Can Matter! The Role of Land Use Plans and State Planning Mandates in Limiting the Development of Hazardous Areas publication-title: Public Administration Review – volume: 47 start-page: 79 issue: 1–2 year: 2004 end-page: 94 article-title: Regional Planning in the US Coastal Zone: A Comparative Analysis of 15 Special Area Plans publication-title: Ocean and Coastal Management – volume: 5 start-page: 93 issue: 2 year: 2011 end-page: 112 article-title: Agreement and Information in the Reliability of Coding publication-title: Communication Methods and Measures – volume: 27 start-page: 49 issue: 1 year: 2007 end-page: 64 article-title: Evaluating Smart Growth: Implications for Small Communities publication-title: Journal of Planning Education and Research – volume: 69 start-page: 33 issue: 1 year: 2004 end-page: 50 article-title: Measuring the Collective Planning Capabilities of Local Jurisdictions to Manage Ecological Systems in Southern Florida publication-title: Landscape and Urban Planning – volume: 60 start-page: 444 issue: 4 year: 1994 end-page: 61 article-title: Mandates, Plans, and Planners: Building Local Commitment to Development Management publication-title: Journal of the American Planning Association – volume: 20 start-page: 37 issue: 1 year: 1960 end-page: 46 article-title: A Coefficient of Agreement for Nominal Scales publication-title: Educational and Psychological Measurement – volume: 15 start-page: 461 issue: 3 year: 2006 end-page: 83 article-title: Natural Hazard Mitigation in Local Comprehensive Plans: The Case of Flood, Wildfire and Drought Planning in Arizona publication-title: Disaster Prevention and Management – volume: 71 start-page: 55 issue: 1 year: 2005b end-page: 72 article-title: More and Better Local Planning: State-Mandated Local Planning in Coastal North Carolina publication-title: Journal of the American Planning Association – volume: 42 start-page: 348 issue: 1 year: 2012 end-page: 64 article-title: Developing and Assessing Intercoder Reliability in Studies of Group Interaction publication-title: Sociological Methodology – volume: 76 start-page: 435 issue: 4 year: 2010 end-page: 50 article-title: Innovation and Climate Action Planning—Perspectives from Municipal Plans publication-title: Journal of the American Planning Association – volume: 39 start-page: 105 issue: 2 year: 2011 end-page: 32 article-title: Examining Local Coastal Zone Management Capacity in U.S. Pacific Coastal Counties publication-title: Coastal Management – volume: 63 start-page: 329 issue: 3 year: 1997 end-page: 44 article-title: General Plan Evaluation Criteria: An Approach to Making Better Plans publication-title: Journal of the American Planning Association – volume: 13 start-page: 237 issue: 4 year: 1994 end-page: 50 article-title: The Influence of State Planning Mandates on Local Plan Quality publication-title: Journal of Planning Education and Research – volume: 14 start-page: 439 issue: 4 year: 2009 end-page: 61 article-title: Evaluating New Urbanist Plans in Post-Katrina Mississippi publication-title: Journal of Urban Design – volume: 25 start-page: 149 issue: 2 year: 2005a end-page: 71 article-title: Local Commitment to State-Mandated Planning in Coastal North Carolina publication-title: Journal of Planning Education and Research – volume: 22 start-page: 345 issue: 4 year: 2003 end-page: 59 article-title: Legalizing Smart Growth: An Empirical Study of Land Use Regulation in Illinois publication-title: Journal of Planning Education and Research – volume: 64 start-page: 457 issue: 4 year: 1998 end-page: 69 article-title: Local Government Compliance with State Plan Mandates: The Effects of State Implementation in Florida publication-title: Journal of the American Planning Association – volume: 39 start-page: 79 issue: 1 year: 1996 end-page: 96 article-title: Enhancing Plan Quality: Evaluating the Role of State Planning Mandates for Natural Hazard Mitigation publication-title: Journal of Environmental Planning & Management – volume: 13 start-page: 139 issue: 2 year: 2012 end-page: 49 article-title: Planning for Resiliency: Evaluation of State Hazard Mitigation Plans under the Disaster Mitigation Act publication-title: Natural Hazards Review – volume: 31 start-page: 450 year: 2013 end-page: 9 article-title: Local Comprehensive Plan Quality and Regional Ecosystem Protection: The Case of the Jordan Lake Watershed, North Carolina, U.S.A publication-title: Land Use Policy – volume: 53 start-page: 41 issue: 1 year: 2010 end-page: 62 article-title: Moving from Agenda to Action: Evaluating Local Climate Change Action Plans publication-title: Journal of Environmental Planning and Management – volume: 79 start-page: 374 issue: 3–4 year: 2007 end-page: 84 article-title: Incorporating Ecological Sustainability into Landscape Planning publication-title: Landscape and Urban Planning – volume: 3 start-page: 183 issue: 2 year: 2012 end-page: 93 article-title: Assessing the Relationship between Hazard Mitigation Plan Quality and Rural Status in a Cohort of 57 Counties from 3 States in the Southeastern U.S publication-title: Challenges – ident: bibr43-0739456X13513614 doi: 10.20965/jdr.2010.p0526 – ident: bibr65-0739456X13513614 doi: 10.1080/09640560903399772 – ident: bibr20-0739456X13513614 doi: 10.1016/j.landurbplan.2003.09.002 – ident: bibr39-0739456X13513614 doi: 10.1080/01944360708976138 – volume-title: Mass Media Research: An Introduction year: 1983 ident: bibr70-0739456X13513614 – ident: bibr52-0739456X13513614 doi: 10.1177/0739456X05278984 – volume-title: Educational Measurement year: 1971 ident: bibr68-0739456X13513614 – ident: bibr16-0739456X13513614 doi: 10.1016/j.landusepol.2012.08.009 – ident: bibr55-0739456X13513614 doi: 10.5055/jem.2011.0045 – ident: bibr40-0739456X13513614 doi: 10.3390/challe3020183 – ident: bibr59-0739456X13513614 doi: 10.1108/09653560610669936 – ident: bibr18-0739456X13513614 doi: 10.1023/A:1025078715216 – volume-title: Policy Research: Concepts, Methods, and Applications year: 1989 ident: bibr57-0739456X13513614 – ident: bibr33-0739456X13513614 doi: 10.1080/13574800903265496 – ident: bibr60-0739456X13513614 doi: 10.1016/j.landurbplan.2012.05.014 – ident: bibr3-0739456X13513614 doi: 10.1016/j.landurbplan.2012.05.009 – ident: bibr26-0739456X13513614 doi: 10.1177/0081175012444860 – ident: bibr63-0739456X13513614 doi: 10.1016/j.ocecoaman.2008.06.001 – ident: bibr1-0739456X13513614 doi: 10.1097/FCH.0b013e31820e0d47 – volume-title: Qualitative Data Analysis: An Expanded Sourcebook year: 1994 ident: bibr50-0739456X13513614 – ident: bibr10-0739456X13513614 doi: 10.1068/b240451 – ident: bibr25-0739456X13513614 doi: 10.1177/001316446002000104 – ident: bibr69-0739456X13513614 doi: 10.1080/01944360802377973 – ident: bibr38-0739456X13513614 doi: 10.1080/19312450709336664 – ident: bibr19-0739456X13513614 doi: 10.1177/0739456X05280546 – ident: bibr54-0739456X13513614 doi: 10.1016/j.landusepol.2007.10.006 – ident: bibr64-0739456X13513614 doi: 10.1068/b34076 – ident: bibr58-0739456X13513614 doi: 10.1086/266577 – ident: bibr9-0739456X13513614 doi: 10.1068/b260643 – ident: bibr48-0739456X13513614 doi: 10.1068/a367 – ident: bibr27-0739456X13513614 doi: 10.1080/01944369408975604 – volume: 5 start-page: 20 issue: 1 year: 2010 ident: bibr35-0739456X13513614 publication-title: International Journal of Internet Science – ident: bibr66-0739456X13513614 doi: 10.1080/08920753.2010.540708 – ident: bibr28-0739456X13513614 doi: 10.1016/j.ocecoaman.2004.03.005 – ident: bibr24-0739456X13513614 doi: 10.4135/9781412985642 – volume-title: Qualitative Data Analysis: A Sourcebook of New Methods year: 1984 ident: bibr49-0739456X13513614 – ident: bibr14-0739456X13513614 doi: 10.1080/09640569612688 – ident: bibr21-0739456X13513614 doi: 10.1080/01944363.2011.619951 – volume-title: Natural Hazard Mitigation: Recasting Disaster Policy and Planning year: 1999 ident: bibr36-0739456X13513614 – ident: bibr30-0739456X13513614 doi: 10.1177/0739456X07305792 – ident: bibr34-0739456X13513614 doi: 10.1177/1524839910381699 – ident: bibr17-0739456X13513614 doi: 10.1177/0739456X03258635 – ident: bibr45-0739456X13513614 doi: 10.1080/19312458.2011.568376 – ident: bibr2-0739456X13513614 doi: 10.1080/01944369708975926 – ident: bibr62-0739456X13513614 doi: 10.1177/0739456X03022004002 – ident: bibr32-0739456X13513614 doi: 10.1080/09640560801979667 – ident: bibr5-0739456X13513614 doi: 10.1080/09640568.2012.756805 – ident: bibr29-0739456X13513614 doi: 10.1080/01944369808976004 – volume: 24 start-page: 29 issue: 2 year: 1999 ident: bibr42-0739456X13513614 publication-title: Carolina Planning – ident: bibr13-0739456X13513614 doi: 10.1080/01944360008976081 – ident: bibr44-0739456X13513614 doi: 10.1111/j.1468-2958.2004.tb00738.x – volume-title: Urban Land Use Planning year: 2006 ident: bibr12-0739456X13513614 – ident: bibr51-0739456X13513614 doi: 10.1080/01944360208976265 – ident: bibr31-0739456X13513614 doi: 10.4135/9781412985123 – volume-title: Climate Change and Land Policies year: 2011 ident: bibr37-0739456X13513614 – ident: bibr23-0739456X13513614 doi: 10.56021/9780801856235 – ident: bibr67-0739456X13513614 doi: 10.1016/j.landurbplan.2006.04.005 – ident: bibr8-0739456X13513614 doi: 10.1080/09640569408711967 – ident: bibr11-0739456X13513614 doi: 10.1177/0739456X02238442 – ident: bibr22-0739456X13513614 doi: 10.2307/976725 – ident: bibr15-0739456X13513614 doi: 10.1061/(ASCE)NH.1527-6996.0000063 – ident: bibr41-0739456X13513614 doi: 10.1080/15389580903434199 – ident: bibr53-0739456X13513614 doi: 10.1080/01944360508976405 – ident: bibr61-0739456X13513614 doi: 10.1177/088541229601000302 – ident: bibr4-0739456X13513614 doi: 10.1080/01944363.2010.509703 – ident: bibr7-0739456X13513614 doi: 10.1177/0885412208327014 – ident: bibr47-0739456X13513614 doi: 10.1111/j.1468-2958.2002.tb00826.x – ident: bibr6-0739456X13513614 doi: 10.1177/0739456X9401300401 – volume-title: Content Analysis: An Introduction to Its Methodology year: 2013 ident: bibr46-0739456X13513614 – ident: bibr56-0739456X13513614 doi: 10.1007/s11027-010-9270-x |
| SSID | ssj0021437 |
| Score | 2.4028468 |
| Snippet | Plan quality evaluation researchers typically evaluate plans in relation to whether they contain certain desirable features. Best practice dictates that plans... |
| SourceID | proquest crossref sage |
| SourceType | Aggregation Database Enrichment Source Index Database Publisher |
| StartPage | 77 |
| SubjectTerms | Agreements Alternative approaches Best practice Criticism Data quality Education Evaluation research Planning Readers Reliability Reporting Researchers |
| Title | Measuring and Reporting Intercoder Reliability in Plan Quality Evaluation Research |
| URI | https://journals.sagepub.com/doi/full/10.1177/0739456X13513614 https://www.proquest.com/docview/1508834039 https://www.proquest.com/docview/1505338657 https://www.proquest.com/docview/1531923554 https://www.proquest.com/docview/1671619497 |
| Volume | 34 |
| WOSCitedRecordID | wos000331199600006&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| journalDatabaseRights | – providerCode: PRVSPB databaseName: SAGE Journals HSS Package 2015 customDbUrl: eissn: 1552-6577 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0021437 issn: 0739-456X databaseCode: AEVPJ dateStart: 19990301 isFulltext: true titleUrlDefault: http://journals.sagepub.com/ providerName: SAGE Publications |
| link | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwvV1LS8NAEB60ehDBR1WsL1aQgofYtJvH5iRFWkRQRFR6C8k-QNAotRX6753JJmlVLJ68BLqZZreb2c63OzPfAJxEZJVVqBw_9KTjGdd3Um64I6SvfIV4xEiVF5sIb27EYBDdLkBW5sIUM_h-RmFVOKL8z5pWN51GtwonY4vcS9jHgMrLcTQw5-PRS2xPu8uiGtRC7unxC3m2JcVDTpwyu20RljrEE1ODpW7v8faq2qIhesgTrEPyj2IHU8fmjz6_GrIpOp0JCMttVH_9v3_dBqwVaJZ1rfptwoLO6rDanXFO1GGvyolhTWazgZklJ5lswd11fkaJ9pMlmWJ2O0Cf8pNKyrcfMoqatmziE_aUMSqzxCz1x4T1KrJyVsYQbsNDv3d_cekUZR4ciVhs5HAuifQrdQ1XHR0EvjKR0klbhW3pGuGGicK2FLEQgi0tVMeEOtCJhzqFm99U8h2oZa-Z3gUmAu4Fihhx8JoKKbjRMsWGRCXScNGAVvnOYllwoFMpjue4XdKef5v7BpxW33iz_B9zZA9KNYjLNx0T377gnsujBhxXt3ENk2MmyfTrOJdB1C0CP5wnwwmMI_qbIxOgTrcjL8LnNEnFZobxy5j3_iq4DyuIFT0bfncAtdFwrA9hWX6Mnt6HR8U6-gQFFjFS |
| linkProvider | SAGE Publications |
| linkToHtml | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwpV3rS8MwED9EBUXwLc5nBBn4odotbZN-HDLxOUSm7Ftp84CBdDKnsP_eu76cikPwS6HpJRxJrvdLcvkdwHFIXlkL7fjCU45nXd9JuOWOVL72NeIRq3SWbEJ0OrLXC-8nUn0VPfh6SmFVqFH2s66sm5iSBA-x-R5lluMBpbCe8xC1o03OtdpP99fVaguBQHZXWtBRJ1b4PKP80cZXn_QJNCdiuzJ3c7HyD0VXYbnAmKyVT4o1mDHpOiy1Jo4M1mGnuqnC6iy_o8tyypDxBjzcZTuH6NVYnGqWg3R6y_YP6Rb8kFEsc87xPWb9lFHyI5YTcoxZu6IQZ2Vk3yY8XrS755dOkXzBUYiQRg7niqi4Etdy3TRB4GsbahM3tGgo10pXxBrLEkQoCIGM1E0rTGBiD0cal6SJ4lswmw5Ssw1MBtwLNPHU4DORSnJrVIIFsY6V5bIGZ2X3R6pgJqcEGc9RoyQj_9aXNTiparzkrBxTZPfKEY3KQYuIBV9yz-VhDY6qz2hZdFwSp2bwlskgFpaBL6bJcILIiMmmyAS4Jm2EXojt1Gm2TKjxi847fxU8hIXL7t1tdHvVudmFRURzXh4gtwezo-Gb2Yd59T7qvw4PCvP4AOZKCUQ |
| linkToPdf | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwpV1ZS8NAEB6kFRHBW6znClLwITZ1c2wei7Z4liIqfQvJHlCQKLUV-u-dyWVVLIIvgSSzm2WP7Dc7M98AHAe0KytfWa7vSMsxtmvF3HBLSFe5CvGIkSpNNuF3u6LfD3q5bw7FwuQ9-HZKblXYovRnTav7VZlGbmNskHUJP9Gn7HLcozTWVdRqbJzm1Vb7qXddalwIBtJ4aZ_MnVjg0075o46v-9In2Jzy70q3nM7KPxu7Css51mStbHKswZxO1mGpNWU6WIedMmKF1VkWq8sy6pDJBtzfpSeIuLuxKFEsA-t0l54jUjT8kJFPc8b1PWGDhFESJJYRc0xYu6QSZ4WH3yY8dtoP55dWnoTBkoiURhbnkii5YttwdaY9z1UmUDpqKr8pbSNsP1L4LEakglBIC3VmfO3pyMERR9U0lnwLKslLoreBCY87niK-GrzGQgputIzxQaQiabioQaMYglDmDOWUKOM5bBak5N_6sgYnZYnXjJ1jhuxeMaphMXAhseEL7tg8qMFR-RpXGJlNokS_jFMZxMTCc_1ZMpygMmKzGTIe6qbNwAmwnjrNmKlm_NLmnb8KHsJC76IT3l51b3ZhEUGdk_nJ7UFlNBzrfZiX76PB2_AgXyEfk3sLuA |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Measuring+and+Reporting+Intercoder+Reliability+in+Plan+Quality+Evaluation+Research&rft.jtitle=Journal+of+planning+education+and+research&rft.au=Stevens%2C+Mark+R&rft.au=Lyles%2C+Ward&rft.au=Berke%2C+Philip+R&rft.date=2014-03-01&rft.pub=Sage+Publications+Ltd&rft.issn=0739-456X&rft.eissn=1552-6577&rft.volume=34&rft.issue=1&rft.spage=77&rft_id=info:doi/10.1177%2F0739456X13513614&rft.externalDBID=NO_FULL_TEXT&rft.externalDocID=3251593001 |
| thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=0739-456X&client=summon |
| thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=0739-456X&client=summon |
| thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=0739-456X&client=summon |