Systemic evaluation of community environmental management programmes
•Community environmental management programmes are about community engagement.•The relationship between community engagement and environmental outcomes is complex.•A systemic evaluation methodology is presented to address this complexity.•Promising results from a trial with a regional council in New...
Uložené v:
| Vydané v: | European journal of operational research Ročník 288; číslo 1; s. 207 - 224 |
|---|---|
| Hlavní autori: | , , , , |
| Médium: | Journal Article |
| Jazyk: | English |
| Vydavateľské údaje: |
Elsevier B.V
01.01.2021
|
| Predmet: | |
| ISSN: | 0377-2217, 1872-6860, 1872-6860 |
| On-line prístup: | Získať plný text |
| Tagy: |
Pridať tag
Žiadne tagy, Buďte prvý, kto otaguje tento záznam!
|
| Abstract | •Community environmental management programmes are about community engagement.•The relationship between community engagement and environmental outcomes is complex.•A systemic evaluation methodology is presented to address this complexity.•Promising results from a trial with a regional council in New Zealand are discussed.•There is potential for adaptation to other contexts.
Community environmental management (CEM) involves the facilitation of community partnerships, local dialogue, consultation and participative decision-making. This is increasingly seen as a solution to some of the more complex environmental issues faced by regulatory authorities. Anecdotal evidence suggests that CEM programmes have much potential, but the evaluation of them is problematic, and there is a need for more robust evidence of their effectiveness. This paper reports on the development of a new CEM evaluation approach (inspired by soft systems methodology, developmental work research and systemic intervention), which was trialled with a New Zealand regional council. The approach shows promise in addressing common evaluation bottlenecks and helping stakeholders to develop causal narratives that more fully account for the complex relationship between community participation and environmental outcomes. However, while the local participants in the CEM initiative acted on the evaluation findings, they hoped that it would stimulate wider organisational change, and this did not happen. Project reflections, informed by institutional theory, reveal that the logics of ‘participation’ and ‘community’ implicit in the findings were appropriate for local participants, but non-participating regional council stakeholders read the findings with different logics, and therefore the evaluation failed to communicate the necessity for wider change. The reflections highlight a previously unrecognised evaluation bottleneck. While the CEM evaluation methodology has the potential to be adapted for other contexts, if wider organisational change is required, care must be taken to anticipate the different institutional logics of stakeholders who might be unfamiliar with, or even hostile to, CEM. |
|---|---|
| AbstractList | Community environmental management (CEM) involves the facilitation of community partnerships, local dialogue, consultation and participative decision-making. This is increasingly seen as a solution to some of the more complex environmental issues faced by regulatory authorities. Anecdotal evidence suggests that CEM programmes have much potential, but the evaluation of them is problematic, and there is a need for more robust evidence of their effectiveness. This paper reports on the development of a new CEM evaluation approach (inspired by soft systems methodology, developmental work research and systemic intervention), which was trialled with a New Zealand regional council. The approach shows promise in addressing common evaluation bottlenecks and helping stakeholders to develop causal narratives that more fully account for the complex relationship between community participation and environmental outcomes. However, while the local participants in the CEM initiative acted on the evaluation findings, they hoped that it would stimulate wider organisational change, and this did not happen. Project reflections, informed by institutional theory, reveal that the logics of 'participation' and 'community' implicit in the findings were appropriate for local participants, but non-participating regional council stakeholders read the findings with different logics, and therefore the evaluation failed to communicate the necessity for wider change. The reflections highlight a previously unrecognised evaluation bottleneck. While the CEM evaluation methodology has the potential to be adapted for other contexts, if wider organisational change is required, care must be taken to anticipate the different institutional logics of stakeholders who might be unfamiliar with, or even hostile to, CEM. (c) 2020 Elsevier B.V. All rights reserved. Community environmental management (CEM) involves the facilitation of community partnerships, local dialogue, consultation and participative decision-making. This is increasingly seen as a solution to some of the more complex environmental issues faced by regulatory authorities. Anecdotal evidence suggests that CEM programmes have much potential, but the evaluation of them is problematic, and there is a need for more robust evidence of their effectiveness. This paper reports on the development of a new CEM evaluation approach (inspired by soft systems methodology, developmental work research and systemic intervention), which was trialled with a New Zealand regional council. The approach shows promise in addressing common evaluation bottlenecks and helping stakeholders to develop causal narratives that more fully account for the complex relationship between community participation and environmental outcomes. However, while the local participants in the CEM initiative acted on the evaluation findings, they hoped that it would stimulate wider organisational change, and this did not happen. Project reflections, informed by institutional theory, reveal that the logics of 'participation' and 'community' implicit in the findings were appropriate for local participants, but non-participating regional council stakeholders read the findings with different logics, and therefore the evaluation failed to communicate the necessity for wider change. The reflections highlight a previously unrecognised evaluation bottleneck. While the CEM evaluation methodology has the potential to be adapted for other contexts, if wider organisational change is required, care must be taken to anticipate the different institutional logics of stakeholders who might be unfamiliar with, or even hostile to, CEM. •Community environmental management programmes are about community engagement.•The relationship between community engagement and environmental outcomes is complex.•A systemic evaluation methodology is presented to address this complexity.•Promising results from a trial with a regional council in New Zealand are discussed.•There is potential for adaptation to other contexts. Community environmental management (CEM) involves the facilitation of community partnerships, local dialogue, consultation and participative decision-making. This is increasingly seen as a solution to some of the more complex environmental issues faced by regulatory authorities. Anecdotal evidence suggests that CEM programmes have much potential, but the evaluation of them is problematic, and there is a need for more robust evidence of their effectiveness. This paper reports on the development of a new CEM evaluation approach (inspired by soft systems methodology, developmental work research and systemic intervention), which was trialled with a New Zealand regional council. The approach shows promise in addressing common evaluation bottlenecks and helping stakeholders to develop causal narratives that more fully account for the complex relationship between community participation and environmental outcomes. However, while the local participants in the CEM initiative acted on the evaluation findings, they hoped that it would stimulate wider organisational change, and this did not happen. Project reflections, informed by institutional theory, reveal that the logics of ‘participation’ and ‘community’ implicit in the findings were appropriate for local participants, but non-participating regional council stakeholders read the findings with different logics, and therefore the evaluation failed to communicate the necessity for wider change. The reflections highlight a previously unrecognised evaluation bottleneck. While the CEM evaluation methodology has the potential to be adapted for other contexts, if wider organisational change is required, care must be taken to anticipate the different institutional logics of stakeholders who might be unfamiliar with, or even hostile to, CEM. |
| Author | Midgley, G. Foote, J. Earl-Goulet, J. Ahuriri-Driscoll, A. Hepi, M. |
| Author_xml | – sequence: 1 givenname: J. surname: Foote fullname: Foote, J. email: jeff.foote@otago.ac.nz organization: Department of Management, University of Otago, P.O. Box 56, Dunedin, New Zealand – sequence: 2 givenname: G. surname: Midgley fullname: Midgley, G. organization: Centre for Systems Studies, Faculty of Business, Law and Politics, University of Hull, Hull, HU6 7RX, United Kingdom – sequence: 3 givenname: A. surname: Ahuriri-Driscoll fullname: Ahuriri-Driscoll, A. organization: School of Health Sciences, University of Canterbury, Private Bag 4800, Christchurch, New Zealand – sequence: 4 givenname: M. surname: Hepi fullname: Hepi, M. organization: Institute of Environmental Science and Research (ESR), P.O. Box 29-181, Christchurch, New Zealand – sequence: 5 givenname: J. surname: Earl-Goulet fullname: Earl-Goulet, J. organization: Environment Canterbury, P.O. Box 345, Christchurch, New Zealand |
| BackLink | https://urn.kb.se/resolve?urn=urn:nbn:se:lnu:diva-98261$$DView record from Swedish Publication Index (Linnéuniversitetet) https://urn.kb.se/resolve?urn=urn:nbn:se:mdh:diva-50212$$DView record from Swedish Publication Index (Mälardalens högskola) |
| BookMark | eNqNkE1LAzEQQIMoWKt_wNP-AHedybrZXfAifoPgwY9rSNNJTdkkJdlW-u_dWvHgoXgaBt4bhnfE9n3wxNgpQoGA4nxe0DzEggOHAqoCsN1jI2xqnotGwD4bQVnXOedYH7KjlOYAgBVWI3bzsk49OaszWqluqXobfBZMpoNzS2_7dUZ-ZWPwjnyvuswpr2a0WbJFDLOonKN0zA6M6hKd_Mwxe7u7fb1-yJ-e7x-vr55yfVG2fV5BbVAJNYH2QiNyYRo-KZFr4lRW5aSFpqzBCKNrDcPzArVpWiPQ6LbWZMoxO9veTZ-0WE7kIlqn4loGZeWNfb-SIc6km37ICjjy_-GdX8q24QIHnG9xHUNKkcyvgCA3leVcbirLTWUJlRwqD1LzR9K2_67YR2W73erlVqUh2cpSlElb8pqmNpLu5TTYXfoXg3uckw |
| CitedBy_id | crossref_primary_10_1016_j_ejdp_2022_100017 crossref_primary_10_1002_ieam_4847 crossref_primary_10_1002_sres_3096 crossref_primary_10_1016_j_ejor_2023_10_037 crossref_primary_10_3389_fenvs_2024_1356065 crossref_primary_10_1080_23322373_2025_2500909 crossref_primary_10_1002_ev_20457 crossref_primary_10_1038_s43247_025_02155_x crossref_primary_10_1002_ev_20459 crossref_primary_10_1002_sres_3014 crossref_primary_10_1051_shsconf_20219202065 crossref_primary_10_1002_sres_2912 crossref_primary_10_1016_j_ejor_2020_11_045 crossref_primary_10_1007_s11213_024_09672_4 crossref_primary_10_1016_j_ejor_2023_01_045 crossref_primary_10_1108_JEC_03_2025_0071 crossref_primary_10_1017_jmo_2021_45 crossref_primary_10_1080_01605682_2025_2537279 crossref_primary_10_1002_sres_2819 |
| Cites_doi | 10.1016/j.ejor.2016.02.044 10.1057/palgrave.jors.2601331 10.1177/1356389010370251 10.5751/ES-09126-220214 10.1016/S0377-2217(03)00065-1 10.1016/j.biocon.2008.07.014 10.1016/j.evalprogplan.2007.01.002 10.1016/j.ejor.2013.04.035 10.1525/cse.2017.000513 10.1002/sd.218 10.1057/palgrave.jors.2600912 10.1177/030802260006300305 10.1177/1098214008325023 10.1023/A:1009515404417 10.1016/j.ejor.2017.11.032 10.1002/sres.3850050108 10.1016/j.ejor.2017.11.040 10.1016/j.ejor.2013.01.047 10.1177/1356389006064176 10.1080/03081070108960713 10.1016/j.ejor.2017.05.030 10.1007/BF02169216 10.1080/01969728908902205 10.1016/j.ejor.2017.11.024 10.1057/palgrave.jors.2602281 10.1177/1356389007084674 10.1007/BF01059938 10.1177/109019810002700308 10.1007/BF02557850 10.1057/palgrave.jors.2600531 10.1177/135638909600200106 10.1177/1476750314558428 10.1016/j.evalprogplan.2009.03.003 10.1016/j.evalprogplan.2011.12.006 10.1023/A:1009519505326 10.1177/1098214010371972 10.1007/s00267-008-9123-5 10.1023/A:1009523606235 10.1016/j.ejor.2018.03.004 10.1057/jors.2012.88 10.1126/science.359.6381.1206 10.1080/09644010701419121 10.1057/palgrave.jors.2602147 10.1177/109821409401500109 10.1016/j.ejor.2012.11.020 10.1007/BF01060046 10.1080/089419200750035575 10.1177/1098214016676573 10.1016/j.evalprogplan.2017.12.001 10.1002/sres.827 10.1057/palgrave.jors.2602538 10.1007/BF02169366 10.1016/j.ejor.2017.11.007 10.1006/jema.1997.0017 10.1038/scientificamerican1148-14 10.1016/j.worlddev.2004.01.002 10.1016/j.jenvman.2015.04.012 10.1080/08941920601161338 10.1016/0305-0483(87)90003-X 10.1057/jors.1992.3 10.1057/jors.2010.31 10.1016/j.ejor.2017.08.014 10.1002/fee.1251 10.1016/j.envsci.2017.01.008 10.1016/j.evalprogplan.2012.01.006 10.1023/A:1022469607464 10.1007/s11213-006-9060-2 10.1016/j.agsy.2017.04.002 10.1080/09640560120046070 10.5751/ES-08804-210409 10.1111/j.1467-8489.2011.00554.x 10.1080/13549839.2015.1127218 10.1016/j.evalprogplan.2013.12.001 10.1177/1356389005059382 10.1016/j.ejor.2017.12.002 10.1057/palgrave.jors.2602118 10.1057/palgrave.jors.2602248 10.1002/ev.276 10.1057/palgrave.jors.2602081 10.1057/jors.2010.76 10.1057/palgrave.jors.2602093 10.1177/13563890022209208 10.1002/sres.2351 10.1006/jema.2001.0493 10.1016/j.evalprogplan.2008.09.007 10.1057/jors.1988.126 10.1080/089419200279243 10.1111/j.1475-3995.2000.tb00224.x 10.1007/BF00148991 10.1080/13639080020028747 10.1016/j.indmarman.2016.08.008 10.1002/sres.1120 10.1002/smj.507 10.1016/j.ejor.2017.02.022 10.1016/j.evalprogplan.2007.12.001 10.1023/A:1009567421256 10.1016/j.ejor.2017.08.004 10.1007/BF01059480 10.1016/j.evalprogplan.2016.11.005 10.1016/j.jenvman.2013.11.057 10.1007/s11747-007-0069-6 10.1016/j.ejor.2017.11.025 10.1002/sres.2423 10.1080/001401300409143 10.1177/1356389018765487 10.1016/j.ejor.2017.07.053 10.1002/sres.2205 10.1023/A:1009527707143 10.1007/s11213-006-9058-9 10.1177/1350507601324003 10.1177/1098214011411574 10.1007/s11213-006-9059-8 10.1016/j.ejor.2019.10.044 10.1057/ejis.1995.10 10.1007/BF02557900 10.1006/jema.2001.0478 10.1057/jors.1984.101 10.1016/j.ejor.2017.11.056 10.1016/j.landurbplan.2016.03.018 10.1016/j.ejor.2013.06.033 |
| ContentType | Journal Article |
| Copyright | 2020 Elsevier B.V. |
| Copyright_xml | – notice: 2020 Elsevier B.V. |
| DBID | AAYXX CITATION ADTPV AOWAS D92 DF7 |
| DOI | 10.1016/j.ejor.2020.05.019 |
| DatabaseName | CrossRef SwePub SwePub Articles SWEPUB Linnéuniversitetet SWEPUB Mälardalens högskola |
| DatabaseTitle | CrossRef |
| DatabaseTitleList | |
| DeliveryMethod | fulltext_linktorsrc |
| Discipline | Engineering Computer Science Business |
| EISSN | 1872-6860 |
| EndPage | 224 |
| ExternalDocumentID | oai_DiVA_org_mdh_50212 oai_DiVA_org_lnu_98261 10_1016_j_ejor_2020_05_019 S0377221720304471 |
| GroupedDBID | --K --M -~X .DC .~1 0R~ 1B1 1RT 1~. 1~5 4.4 457 4G. 5GY 5VS 6OB 7-5 71M 8P~ 9JN 9JO AAAKF AABNK AACTN AAEDT AAEDW AAIAV AAIKJ AAKOC AALRI AAOAW AAQFI AARIN AAXUO AAYFN ABAOU ABBOA ABFNM ABFRF ABJNI ABMAC ABUCO ABYKQ ACAZW ACDAQ ACGFO ACGFS ACIWK ACNCT ACRLP ACZNC ADBBV ADEZE ADGUI AEBSH AEFWE AEKER AENEX AFKWA AFTJW AGHFR AGUBO AGYEJ AHHHB AHZHX AIALX AIEXJ AIGVJ AIKHN AITUG AJOXV ALMA_UNASSIGNED_HOLDINGS AMFUW AMRAJ AOUOD APLSM ARUGR AXJTR BKOJK BKOMP BLXMC CS3 DU5 EBS EFJIC EFLBG EO8 EO9 EP2 EP3 F5P FDB FIRID FNPLU FYGXN G-Q GBLVA GBOLZ HAMUX IHE J1W KOM LY1 M41 MHUIS MO0 MS~ N9A O-L O9- OAUVE OZT P-8 P-9 P2P PC. PQQKQ Q38 ROL RPZ RXW SCC SDF SDG SDP SDS SES SPC SPCBC SSB SSD SSV SSW SSZ T5K TAE TN5 U5U XPP ZMT ~02 ~G- 1OL 29G 41~ 9DU AAAKG AAQXK AATTM AAXKI AAYWO AAYXX ABWVN ABXDB ACLOT ACNNM ACRPL ACVFH ADCNI ADIYS ADJOM ADMUD ADNMO ADXHL AEIPS AEUPX AFFNX AFJKZ AFPUW AGQPQ AI. AIGII AIIUN AKBMS AKRWK AKYEP ANKPU APXCP ASPBG AVWKF AZFZN CITATION EFKBS EJD FEDTE FGOYB HVGLF HZ~ R2- SEW VH1 WUQ ~HD ADTPV AOWAS D92 DF7 |
| ID | FETCH-LOGICAL-c439t-507f1a6ab094c1126f82b312ce2e353b908370f6fc7c018761cf89f61fc97cef3 |
| ISICitedReferencesCount | 20 |
| ISICitedReferencesURI | http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000564504000015&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| ISSN | 0377-2217 1872-6860 |
| IngestDate | Tue Nov 04 16:16:35 EST 2025 Tue Nov 04 16:43:56 EST 2025 Sat Nov 29 07:17:09 EST 2025 Tue Nov 18 22:28:25 EST 2025 Fri Feb 23 02:47:59 EST 2024 |
| IsPeerReviewed | true |
| IsScholarly | true |
| Issue | 1 |
| Keywords | Systemic evaluation Community environmental management Problem structuring methods Community operational research Systems thinking |
| Language | English |
| LinkModel | OpenURL |
| MergedId | FETCHMERGED-LOGICAL-c439t-507f1a6ab094c1126f82b312ce2e353b908370f6fc7c018761cf89f61fc97cef3 |
| PageCount | 18 |
| ParticipantIDs | swepub_primary_oai_DiVA_org_mdh_50212 swepub_primary_oai_DiVA_org_lnu_98261 crossref_primary_10_1016_j_ejor_2020_05_019 crossref_citationtrail_10_1016_j_ejor_2020_05_019 elsevier_sciencedirect_doi_10_1016_j_ejor_2020_05_019 |
| PublicationCentury | 2000 |
| PublicationDate | 2021-01-01 2021-01-00 2021 |
| PublicationDateYYYYMMDD | 2021-01-01 |
| PublicationDate_xml | – month: 01 year: 2021 text: 2021-01-01 day: 01 |
| PublicationDecade | 2020 |
| PublicationTitle | European journal of operational research |
| PublicationYear | 2021 |
| Publisher | Elsevier B.V |
| Publisher_xml | – name: Elsevier B.V |
| References | Zanetell, Knuth (bib0175) 2004; 32 Rodríguez-Campos (bib0147) 2012; 35 Winstanley, Ahuriri-Driscoll, Hepi, Baker, Foote (bib0174) 2016; 21 Midgley, Pinzón (bib0119) 2011; 62 Cohen, Midgley (bib0016e) 1994 Ife, Tesoriero (bib0073) 2006 Patton (bib0138) 2010 Gregory (bib0016k) 1994 Midgley (bib0016v) 1996 Engeström (bib0035) 2000; 43 Alexander, Andrachuk, Armitage (bib0001) 2016; 14 (bib0043) 1991 Midgley (bib0016t) 1990; 12 Midgley (bib0110) 2006 Midgley, Ochoa-Arias (bib0118) 2004 Jackson (bib0079) 1991 Kirk (bib0091) 2017; 1 Johnson, Midgley, Chichirau (bib0085) 2018; 268 Curtis, Lockwood (bib0027a) 2000; 13 Mingers (bib0016q) 2000; 7 Buchy, Race (bib0012) 2001; 44 Mingers (bib0127) 1984; 11 Harmsworth, Awatere, Robb (bib0060) 2016; 21 Astbury, Leeuw (bib0016a) 2010; 31 Chouinard, Milley (bib0022) 2018; 67 Rogers (bib0148) 2008; 14 Durie (bib0032) 1998 Cooperrider, Srivastva (bib0025) 1987 Hepi, Foote, Marino, Rogers, Taimona (bib0066) 2007; 2 Mingers, Gill (bib0128) 1997 Morrison, Oczkowski, Greig (bib0132) 2011; 55 Taylor-Powell, Boyd (bib0163) 2008; 120 Morgan, Fa'aui (bib0131) 2018; 268 Ulrich (bib0166) 1994 (bib0044) 1996 Córdoba, Midgley (bib0016g) 2006; 57 Bellamy, Walker, McDonald, Syme (bib0004) 2001; 63 Brocklesby, Beall (bib0010) 2018; 268 Tan, Watson, Wei (bib0162) 1995; 4 Weiner (bib0170) 1948 Shen, Midgley (bib0155) 2007; 20 Ufua, Papadopoulos, Midgley (bib0017b) 2018; 268 Gysen, Bruyninckx, Bachus (bib0059) 2006; 12 Durie (bib0033) 2001 Midgley (bib0016x) 2016 Memon, Perkins (bib0103) 2000 Wilson (bib0173) 2001 Boyd, Geerling, Gregory, Kagan, Midgley, Murray (bib0007) 2007; 58 Ulrich (bib0165) 1993; 6 Ministry for the Environment (bib0129) 2009 Pawson, R., Greenhalgh, T., & Harvey, G. (2004). Realist synthesis: An introduction. ESRC Research Methods Programme, University of Manchester RMP Methods Paper 2/2004, pp. 7–8. URL (accessed May 2011) Fielden, Rusch, Masinda, Sands, Frankish, Evoy (bib0041) 2007; 30 Foote, Scholes, Capper, Hill, Wilson (bib0046) 2009 Gregory (bib0055) 1992 Engeström (bib0038) 2015 Kajamaa (bib0087) 2008 Te Puni Kōkiri (bib0092) 2006 Hickey, Mohan (bib0068) 2004 (bib0150) 2001 Kotiadis, Mingers (bib0016p) 2006; 57 Keys (bib0090) 1988; 5 Checkland (bib0017) 1981 Thornton, Ocasio, Lounsbury (bib0164) 2012 Mingers (bib0126) 1980; 7 Smith (bib0157) 1999 Patton (bib0137) 2006; 13 Jackson (bib0081) 2003 Jackson (bib0083) 2019 Midgley, Reynolds (bib0120) 2001 Paz-Ybarnegaray, Douthwaite (bib0140) 2017; 38 Seyfang, Smith (bib0153) 2007; 16 Hassenforder, Smajgl, Ward (bib0061) 2015; 157 Helfgott (bib0063) 2018; 268 Gregory, Romm (bib0057) 2001; 32 Hepi, Foote (bib0064) 2013 Strauss, Corbin (bib0160) 1990 Gomes, Hermans, Thissen (bib0049) 2018; 268 Henao, Franco (bib0016h) 2016; 253 Reed (bib0143) 2008; 141 Midgley, Nicholson, Brennan (bib0116) 2017; 62 Head, Xiang (bib0062) 2016; 154 Kellert, Mehta, Ebbin, Lichtenfeld (bib0089) 2000; 13 Cabrera, Colosi, Lobdell (bib01016) 2008; 31 Midgley, Reynolds (bib0121) 2002 Gregory (bib0016l) 2000; 6 Martin (bib0097) 1991; 15 Brousselle, Buregeya (bib0011) 2018; 24 Hume (bib0071) 1748 Brauer (bib0008) 2018; 268 Morell (bib0130) 2010 Bishop (bib0005) 1996 Checkland, Winter (bib0021) 2006; 57 Murthy (bib0134) 1994; 7 Hume (bib0070) 1739 Spash (bib0159) 1997; 50 Jackson (bib0076) 1987; 15 Burns (bib0013) 2018; 268 Environment Canterbury (bib0040) 2009 Jackson (bib0082) 2006; 57 Robins, Burt, Bracken, Boardman, Thompson (bib0146) 2017; 71 Foote, Gregor, Hepi, Baker, Houston, Midgley (bib0047) 2007; 58 Matthews (bib0098) 2004 Taket, White (bib0161) 2000 Matunga (bib0099) 2000 Boyd, Brown, Midgley (bib0006) 2004 Cooke, Kothari (bib0024) 2001 Checkland (bib0018) 2001 Midgley (bib0105) 1992; 5 (bib0017a) 1997 Midgley (bib0107) 1997; 10 Cabrera, Cabrera, Powers (bib0015) 2015; 32 Dunkley, Franklin (bib0031) 2017; 60 Gregory (bib0056) 1996; 9 Baur, van Elteren, Nierse, Abma (bib0003) 2010; 16 Córdoba, Midgley (bib0026) 2003 Environment Canterbury (bib0039) 2005 Gregory, Jackson (bib0053) 1992; 5 Jackson (bib0077) 1987 Checkland, Poulter (bib0019) 2006 Vargo, Lusch (bib0167) 2008; 36 Conway, Tunks, Henwood, Casswell (bib0023) 2000; 27 Gregory, Jackson (bib0052) 1992; 43 Guba, Lincoln (bib0016f) 1989 Mayne (bib0100) 2011 Engeström (bib0036) 2001; 14 Midgley, Shen (bib0124) 2007; 20 Gregory, Midgley (bib0054) 2000; 51 Midgley (bib0106) 1997; 10 Jackson (bib0080) 2000 Midgley, Reynolds (bib0122) 2004 Laursen, Salter (bib0093) 2006; 27 Johnson, Midgley, Wright, Chichirau (bib0086) 2018; 268 New Zealand Association of Resource Management (bib0135) 2002 Gu, Zhu (bib0058) 2000; 13 Cox (bib0028) 2000; 63 Munro, Mingers (bib0016r) 2002; 53 Jackson (bib0075) 1987; 2 Dyer, Stringer, Dougill, Leventon, Nshimbi, Chama (bib0034) 2014; 137 Midgley (bib0016u) 1996; 2 Zhu (bib0176) 2000; 13 Wang (bib0169) 2000; 13 Popper (bib0142) 1972 Midgley, Johnson, Chichirau (bib0114) 2018; 268 Smits, Champagne (bib0158) 2008; 29 Midgley, Wilby (bib0016n) 2000; 13 McCallum, Hughey, Rixecker (bib0101) 2007; 20 Checkland, Scholes (bib0020) 1990 Munro (bib0133) 1999; 12 Li, Zhu (bib0095) 2014; 232 Chen (bib0016d) 1994; 15 Hermans, Naber, Enserink (bib0067) 2012; 35 Parkinson (bib0136) 2009; 32 Konsti-Laakso, Rantala (bib0016o) 2018; 268 Bateson (bib0002) 1979 Bressers, Gerrits (bib0009) 2015; 32 Bowers (bib0016c) 2011; 28 Shen, Midgley (bib0156) 2015; 13 Midgley (bib0109) 2001; 30 Forrester (bib0048) 1971; 2 Jackson (bib0074) 1982; 9 Midgley, Reynolds (bib0123) 2004; 12 Flood (bib0042) 1990 Lennie (bib0094) 2005; 11 Romm (bib0149) 2018; 268 Zhu (bib0017c) 2011; 62 Midgley (bib0016s) 1989; 20 Weiss (bib0171) 1973; 1 Douthwaite, Hoffecker (bib0030) 2017; 155 Midgley, Ochoa-Arias (bib0117) 2004 Pinzon-Salcedo, Torres-Cuello (bib0141) 2018; 268 Sager, Andereggen (bib0151) 2012; 33 Midgley, Ahuriri-Driscoll, Baker, Foote, Hepi, Taimona (bib0111) 2007; 24 Midgley, Munlo, Brown (bib0115) 1998; 49 Cousins, Goh, Elliot, Aubry, Gilbert (bib0027) 2014; 44 Bina (bib0016b) 2008; 42 Kapoor (bib0088) 2001; 63 Cradock-Henry, Greenhalgh, Brown, Sinner (bib0029) 2017; 22 Engeström (bib0037) 2005 Margoluis, Stem, Salafsky, Brown (bib0096) 2009; 32 Hjortsø (bib0069) 2004; 152 Jackson, Keys (bib0084) 1984; 35 Ferreira (bib0016i) 2013; 64 Gregory, Atkins, Burdon, Elliott (bib0050) 2013; 227 SEPA (bib0152) 2009 Midgley (bib0108) 2000 Midgley (bib0104) 1989 Franco (bib0016j) 2013; 231 Virkkunen (bib0168) 2013 Midgley, Munlo, Brown (bib0016y) 1997 (bib0145) 1994 Midgley, Gu, Campbell (bib0113) 2000; 13 (bib0016z) 1996 Midgley, Cavana, Brocklesby, Foote, Ahuriri-Driscoll, Wood (bib0112) 2013; 229 Loseke (bib0020y) 1999 Reynolds, Gates, Hummelbrunner, Marra, Williams (bib0144) 2016; 33 Jackson (bib0078) 1988; 39 Mingers, Brocklesby (bib0125) 1996; 18 Shen, Midgley (bib0154) 2007; 20 Pollack (bib0016w) 2009; 60 Cabrera, Cabrera (bib0014) 2015 Hvistendahl (bib0072) 2018; 359 Gregory, Atkins, Midgley, Hodgson (bib0051) 2020; 283 Cox (10.1016/j.ejor.2020.05.019_bib0028) 2000; 63 Kajamaa (10.1016/j.ejor.2020.05.019_bib0087) 2008 Popper (10.1016/j.ejor.2020.05.019_bib0142) 1972 Matunga (10.1016/j.ejor.2020.05.019_bib0099) 2000 Seyfang (10.1016/j.ejor.2020.05.019_bib0153) 2007; 16 Midgley (10.1016/j.ejor.2020.05.019_bib0113) 2000; 13 Paz-Ybarnegaray (10.1016/j.ejor.2020.05.019_bib0140) 2017; 38 Spash (10.1016/j.ejor.2020.05.019_bib0159) 1997; 50 Midgley (10.1016/j.ejor.2020.05.019_bib0120) 2001 Fielden (10.1016/j.ejor.2020.05.019_bib0041) 2007; 30 Ulrich (10.1016/j.ejor.2020.05.019_bib0165) 1993; 6 Hvistendahl (10.1016/j.ejor.2020.05.019_bib0072) 2018; 359 Jackson (10.1016/j.ejor.2020.05.019_bib0077) 1987 Thornton (10.1016/j.ejor.2020.05.019_bib0164) 2012 Checkland (10.1016/j.ejor.2020.05.019_bib0021) 2006; 57 Zhu (10.1016/j.ejor.2020.05.019_bib0176) 2000; 13 Midgley (10.1016/j.ejor.2020.05.019_bib0115) 1998; 49 Midgley (10.1016/j.ejor.2020.05.019_bib0119) 2011; 62 Kotiadis (10.1016/j.ejor.2020.05.019_bib0016p) 2006; 57 Checkland (10.1016/j.ejor.2020.05.019_bib0019) 2006 Midgley (10.1016/j.ejor.2020.05.019_bib0124) 2007; 20 Margoluis (10.1016/j.ejor.2020.05.019_bib0096) 2009; 32 Te Puni Kōkiri (10.1016/j.ejor.2020.05.019_bib0092) 2006 Romm (10.1016/j.ejor.2020.05.019_bib0149) 2018; 268 Gregory (10.1016/j.ejor.2020.05.019_bib0016l) 2000; 6 Li (10.1016/j.ejor.2020.05.019_bib0095) 2014; 232 (10.1016/j.ejor.2020.05.019_bib0016z) 1996 Morell (10.1016/j.ejor.2020.05.019_bib0130) 2010 Mingers (10.1016/j.ejor.2020.05.019_bib0125) 1996; 18 Engeström (10.1016/j.ejor.2020.05.019_bib0038) 2015 Gregory (10.1016/j.ejor.2020.05.019_bib0056) 1996; 9 Shen (10.1016/j.ejor.2020.05.019_bib0155) 2007; 20 Kellert (10.1016/j.ejor.2020.05.019_bib0089) 2000; 13 Flood (10.1016/j.ejor.2020.05.019_bib0042) 1990 Chen (10.1016/j.ejor.2020.05.019_bib0016d) 1994; 15 10.1016/j.ejor.2020.05.019_bib0139 Smits (10.1016/j.ejor.2020.05.019_bib0158) 2008; 29 Checkland (10.1016/j.ejor.2020.05.019_bib0017) 1981 (10.1016/j.ejor.2020.05.019_bib0017a) 1997 Jackson (10.1016/j.ejor.2020.05.019_bib0080) 2000 Weiss (10.1016/j.ejor.2020.05.019_bib0171) 1973; 1 Durie (10.1016/j.ejor.2020.05.019_bib0032) 1998 Hepi (10.1016/j.ejor.2020.05.019_bib0064) 2013 (10.1016/j.ejor.2020.05.019_bib0145) 1994 McCallum (10.1016/j.ejor.2020.05.019_bib0101) 2007; 20 Midgley (10.1016/j.ejor.2020.05.019_bib0118) 2004 Midgley (10.1016/j.ejor.2020.05.019_bib0104) 1989 Cooke (10.1016/j.ejor.2020.05.019_bib0024) 2001 Gu (10.1016/j.ejor.2020.05.019_bib0058) 2000; 13 SEPA (10.1016/j.ejor.2020.05.019_bib0152) 2009 Mingers (10.1016/j.ejor.2020.05.019_bib0126) 1980; 7 Helfgott (10.1016/j.ejor.2020.05.019_bib0063) 2018; 268 Henao (10.1016/j.ejor.2020.05.019_bib0016h) 2016; 253 Engeström (10.1016/j.ejor.2020.05.019_bib0035) 2000; 43 Mingers (10.1016/j.ejor.2020.05.019_bib0127) 1984; 11 Memon (10.1016/j.ejor.2020.05.019_bib0103) 2000 Midgley (10.1016/j.ejor.2020.05.019_bib0117) 2004 Midgley (10.1016/j.ejor.2020.05.019_bib0112) 2013; 229 Midgley (10.1016/j.ejor.2020.05.019_bib0106) 1997; 10 Wilson (10.1016/j.ejor.2020.05.019_bib0173) 2001 Cooperrider (10.1016/j.ejor.2020.05.019_bib0025) 1987 Douthwaite (10.1016/j.ejor.2020.05.019_bib0030) 2017; 155 Mayne (10.1016/j.ejor.2020.05.019_bib0100) 2011 Pinzon-Salcedo (10.1016/j.ejor.2020.05.019_bib0141) 2018; 268 Cabrera (10.1016/j.ejor.2020.05.019_bib0014) 2015 Franco (10.1016/j.ejor.2020.05.019_bib0016j) 2013; 231 Gomes (10.1016/j.ejor.2020.05.019_bib0049) 2018; 268 Checkland (10.1016/j.ejor.2020.05.019_bib0020) 1990 Bowers (10.1016/j.ejor.2020.05.019_bib0016c) 2011; 28 Brousselle (10.1016/j.ejor.2020.05.019_bib0011) 2018; 24 Midgley (10.1016/j.ejor.2020.05.019_bib0111) 2007; 24 Gregory (10.1016/j.ejor.2020.05.019_bib0052) 1992; 43 Foote (10.1016/j.ejor.2020.05.019_bib0046) 2009 Durie (10.1016/j.ejor.2020.05.019_bib0033) 2001 Midgley (10.1016/j.ejor.2020.05.019_bib0016n) 2000; 13 Bressers (10.1016/j.ejor.2020.05.019_bib0009) 2015; 32 Hassenforder (10.1016/j.ejor.2020.05.019_bib0061) 2015; 157 Zanetell (10.1016/j.ejor.2020.05.019_bib0175) 2004; 32 Midgley (10.1016/j.ejor.2020.05.019_bib0122) 2004 Cradock-Henry (10.1016/j.ejor.2020.05.019_bib0029) 2017; 22 Brocklesby (10.1016/j.ejor.2020.05.019_bib0010) 2018; 268 Bateson (10.1016/j.ejor.2020.05.019_bib0002) 1979 Murthy (10.1016/j.ejor.2020.05.019_bib0134) 1994; 7 Morgan (10.1016/j.ejor.2020.05.019_bib0131) 2018; 268 Harmsworth (10.1016/j.ejor.2020.05.019_bib0060) 2016; 21 Cabrera (10.1016/j.ejor.2020.05.019_bib01016) 2008; 31 Laursen (10.1016/j.ejor.2020.05.019_bib0093) 2006; 27 Midgley (10.1016/j.ejor.2020.05.019_bib0016s) 1989; 20 Checkland (10.1016/j.ejor.2020.05.019_bib0018) 2001 Mingers (10.1016/j.ejor.2020.05.019_bib0016q) 2000; 7 Alexander (10.1016/j.ejor.2020.05.019_bib0001) 2016; 14 Midgley (10.1016/j.ejor.2020.05.019_bib0107) 1997; 10 Robins (10.1016/j.ejor.2020.05.019_bib0146) 2017; 71 Morrison (10.1016/j.ejor.2020.05.019_bib0132) 2011; 55 Midgley (10.1016/j.ejor.2020.05.019_bib0016y) 1997 Midgley (10.1016/j.ejor.2020.05.019_bib0121) 2002 Jackson (10.1016/j.ejor.2020.05.019_bib0084) 1984; 35 (10.1016/j.ejor.2020.05.019_bib0150) 2001 Jackson (10.1016/j.ejor.2020.05.019_bib0075) 1987; 2 Ulrich (10.1016/j.ejor.2020.05.019_bib0166) 1994 Parkinson (10.1016/j.ejor.2020.05.019_bib0136) 2009; 32 Córdoba (10.1016/j.ejor.2020.05.019_bib0016g) 2006; 57 (10.1016/j.ejor.2020.05.019_bib0044) 1996 Cabrera (10.1016/j.ejor.2020.05.019_bib0015) 2015; 32 Midgley (10.1016/j.ejor.2020.05.019_bib0110) 2006 Buchy (10.1016/j.ejor.2020.05.019_bib0012) 2001; 44 Keys (10.1016/j.ejor.2020.05.019_bib0090) 1988; 5 Midgley (10.1016/j.ejor.2020.05.019_bib0114) 2018; 268 Engeström (10.1016/j.ejor.2020.05.019_bib0036) 2001; 14 Curtis (10.1016/j.ejor.2020.05.019_bib0027a) 2000; 13 Midgley (10.1016/j.ejor.2020.05.019_bib0016u) 1996; 2 Martin (10.1016/j.ejor.2020.05.019_bib0097) 1991; 15 Dunkley (10.1016/j.ejor.2020.05.019_bib0031) 2017; 60 Jackson (10.1016/j.ejor.2020.05.019_bib0078) 1988; 39 Midgley (10.1016/j.ejor.2020.05.019_bib0016t) 1990; 12 Johnson (10.1016/j.ejor.2020.05.019_bib0086) 2018; 268 Vargo (10.1016/j.ejor.2020.05.019_bib0167) 2008; 36 Forrester (10.1016/j.ejor.2020.05.019_bib0048) 1971; 2 Matthews (10.1016/j.ejor.2020.05.019_bib0098) 2004 Reynolds (10.1016/j.ejor.2020.05.019_bib0144) 2016; 33 Ferreira (10.1016/j.ejor.2020.05.019_bib0016i) 2013; 64 Jackson (10.1016/j.ejor.2020.05.019_bib0079) 1991 Gregory (10.1016/j.ejor.2020.05.019_bib0016k) 1994 Gregory (10.1016/j.ejor.2020.05.019_bib0050) 2013; 227 Gregory (10.1016/j.ejor.2020.05.019_bib0051) 2020; 283 Brauer (10.1016/j.ejor.2020.05.019_bib0008) 2018; 268 Midgley (10.1016/j.ejor.2020.05.019_bib0016v) 1996 Midgley (10.1016/j.ejor.2020.05.019_bib0109) 2001; 30 Burns (10.1016/j.ejor.2020.05.019_bib0013) 2018; 268 Gregory (10.1016/j.ejor.2020.05.019_bib0054) 2000; 51 Taket (10.1016/j.ejor.2020.05.019_bib0161) 2000 Gysen (10.1016/j.ejor.2020.05.019_bib0059) 2006; 12 Midgley (10.1016/j.ejor.2020.05.019_bib0108) 2000 Bellamy (10.1016/j.ejor.2020.05.019_bib0004) 2001; 63 Patton (10.1016/j.ejor.2020.05.019_bib0138) 2010 Boyd (10.1016/j.ejor.2020.05.019_bib0006) 2004 Boyd (10.1016/j.ejor.2020.05.019_bib0007) 2007; 58 Chouinard (10.1016/j.ejor.2020.05.019_bib0022) 2018; 67 Guba (10.1016/j.ejor.2020.05.019_bib0016f) 1989 Kirk (10.1016/j.ejor.2020.05.019_bib0091) 2017; 1 Munro (10.1016/j.ejor.2020.05.019_bib0016r) 2002; 53 Smith (10.1016/j.ejor.2020.05.019_bib0157) 1999 Wang (10.1016/j.ejor.2020.05.019_bib0169) 2000; 13 Hickey (10.1016/j.ejor.2020.05.019_bib0068) 2004 Conway (10.1016/j.ejor.2020.05.019_bib0023) 2000; 27 Midgley (10.1016/j.ejor.2020.05.019_bib0016x) 2016 Hermans (10.1016/j.ejor.2020.05.019_bib0067) 2012; 35 Pollack (10.1016/j.ejor.2020.05.019_bib0016w) 2009; 60 Kapoor (10.1016/j.ejor.2020.05.019_bib0088) 2001; 63 Johnson (10.1016/j.ejor.2020.05.019_bib0085) 2018; 268 Jackson (10.1016/j.ejor.2020.05.019_bib0076) 1987; 15 Cohen (10.1016/j.ejor.2020.05.019_bib0016e) 1994 Jackson (10.1016/j.ejor.2020.05.019_bib0081) 2003 Environment Canterbury (10.1016/j.ejor.2020.05.019_bib0039) 2005 Córdoba (10.1016/j.ejor.2020.05.019_bib0026) 2003 Patton (10.1016/j.ejor.2020.05.019_bib0137) 2006; 13 Shen (10.1016/j.ejor.2020.05.019_bib0156) 2015; 13 Ufua (10.1016/j.ejor.2020.05.019_bib0017b) 2018; 268 Dyer (10.1016/j.ejor.2020.05.019_bib0034) 2014; 137 Winstanley (10.1016/j.ejor.2020.05.019_bib0174) 2016; 21 Tan (10.1016/j.ejor.2020.05.019_bib0162) 1995; 4 Gregory (10.1016/j.ejor.2020.05.019_bib0057) 2001; 32 Jackson (10.1016/j.ejor.2020.05.019_bib0074) 1982; 9 Midgley (10.1016/j.ejor.2020.05.019_bib0116) 2017; 62 Taylor-Powell (10.1016/j.ejor.2020.05.019_bib0163) 2008; 120 Jackson (10.1016/j.ejor.2020.05.019_bib0083) 2019 Sager (10.1016/j.ejor.2020.05.019_bib0151) 2012; 33 Baur (10.1016/j.ejor.2020.05.019_bib0003) 2010; 16 Midgley (10.1016/j.ejor.2020.05.019_bib0123) 2004; 12 Zhu (10.1016/j.ejor.2020.05.019_bib0017c) 2011; 62 Strauss (10.1016/j.ejor.2020.05.019_bib0160) 1990 Hume (10.1016/j.ejor.2020.05.019_bib0071) 1748 Loseke (10.1016/j.ejor.2020.05.019_bib0020y) 1999 Bishop (10.1016/j.ejor.2020.05.019_bib0005) 1996 Ministry for the Environment (10.1016/j.ejor.2020.05.019_bib0129) 2009 Midgley (10.1016/j.ejor.2020.05.019_bib0105) 1992; 5 Gregory (10.1016/j.ejor.2020.05.019_bib0053) 1992; 5 Ife (10.1016/j.ejor.2020.05.019_bib0073) 2006 Bina (10.1016/j.ejor.2020.05.019_bib0016b) 2008; 42 Foote (10.1016/j.ejor.2020.05.019_bib0047) 2007; 58 Mingers (10.1016/j.ejor.2020.05.019_bib0128) 1997 Engeström (10.1016/j.ejor.2020.05.019_bib0037) 2005 Environment Canterbury (10.1016/j.ejor.2020.05.019_bib0040) 2009 Gregory (10.1016/j.ejor.2020.05.019_bib0055) 1992 Konsti-Laakso (10.1016/j.ejor.2020.05.019_bib0016o) 2018; 268 Rogers (10.1016/j.ejor.2020.05.019_bib0148) 2008; 14 Jackson (10.1016/j.ejor.2020.05.019_bib0082) 2006; 57 Munro (10.1016/j.ejor.2020.05.019_bib0133) 1999; 12 Rodríguez-Campos (10.1016/j.ejor.2020.05.019_bib0147) 2012; 35 Hepi (10.1016/j.ejor.2020.05.019_bib0066) 2007; 2 Cousins (10.1016/j.ejor.2020.05.019_bib0027) 2014; 44 Weiner (10.1016/j.ejor.2020.05.019_bib0170) 1948 Astbury (10.1016/j.ejor.2020.05.019_bib0016a) 2010; 31 Virkkunen (10.1016/j.ejor.2020.05.019_bib0168) 201 |
| References_xml | – year: 1991 ident: bib0043 publication-title: Critical systems thinking: Directed readings – volume: 1 start-page: 37 year: 1973 end-page: 45 ident: bib0171 article-title: Where politics and evaluation research meet publication-title: Evaluation – volume: 63 start-page: 115 year: 2000 end-page: 120 ident: bib0028 article-title: Using programme logic models in evaluation: A review of the literature and the spinal outreach team experience publication-title: British Journal of Occupational Therapy – volume: 62 start-page: 150 year: 2017 end-page: 159 ident: bib0116 article-title: Dealing with challenges to methodological pluralism: The paradigm problem, psychological resistance and cultural barriers publication-title: Industrial Marketing Management – volume: 32 start-page: 138 year: 2009 end-page: 147 ident: bib0096 article-title: Using conceptual models as a planning and evaluation tool in conservation publication-title: Evaluation and Program Planning – volume: 32 start-page: 793 year: 2004 end-page: 807 ident: bib0175 article-title: Participation rhetoric or community-based management reality? Influences on willingness to participate in a Venezuelan freshwater fishery publication-title: World Development – volume: 42 start-page: 717 year: 2008 end-page: 733 ident: bib0016b article-title: Context and systems: Thinking more broadly about effectiveness in strategic environmental assessment in China publication-title: Environmental Management – year: 1999 ident: bib0020y article-title: Thinking about social problems: An introduction to constructionist perspectives – year: 2013 ident: bib0064 article-title: Literature review on mātauranga māori and environmental decision making – volume: 14 start-page: 133 year: 2001 end-page: 156 ident: bib0036 article-title: Expansive learning at work: Toward an activity theoretical reconceptualization publication-title: Journal of Education and Work – volume: 231 start-page: 720 year: 2013 end-page: 733 ident: bib0016j article-title: Rethinking soft OR interventions: Models as boundary objects publication-title: European Journal of Operational Research – year: 2001 ident: bib0173 article-title: Soft systems methodology: Conceptual model building and its contribution – year: 1990 ident: bib0042 article-title: Liberating systems theory – volume: 268 start-page: 971 year: 2018 end-page: 983 ident: bib0149 article-title: Reflections on a multi-layered intervention in the South African public education system: Some ethical implications for community operational research publication-title: European Journal of Operational Research – volume: 18 start-page: 101 year: 1996 end-page: 131 ident: bib0125 article-title: Multimethodology: Towards a framework for critical pluralism publication-title: Systemist – volume: 24 start-page: 153 year: 2018 end-page: 168 ident: bib0011 article-title: Theory-based evaluations: Framing the existence of a new theory in evaluation and the rise of the 5th generation publication-title: Evaluation – volume: 9 start-page: 605 year: 1996 end-page: 625 ident: bib0056 article-title: Discordant pluralism: A new strategy for critical systems thinking publication-title: Systems Practice – volume: 60 start-page: 156 year: 2009 end-page: 167 ident: bib0016w article-title: Multimethodology in series and parallel: Strategic planning using hard and soft OR publication-title: Journal of the Operational Research Society – volume: 44 start-page: 293 year: 2001 end-page: 308 ident: bib0012 article-title: The twists and turns of community participation in natural resource management in Australia: What is missing? publication-title: Journal of Environmental Planning and Management – volume: 9 start-page: 17 year: 1982 end-page: 29 ident: bib0074 article-title: The nature of soft systems thinking: The work of Churchman, Ackoff and Checkland publication-title: Journal of Applied Systems Analysis – year: 1948 ident: bib0170 article-title: Cybernetics publication-title: Scientific American – volume: 63 start-page: 407 year: 2001 end-page: 423 ident: bib0004 article-title: A systems approach to the evaluation of natural resource management initiatives publication-title: Journal of Environmental Management – volume: 2 start-page: 67 year: 1996 end-page: 84 ident: bib0016u article-title: Evaluating services for people with disabilities: A critical systems perspective publication-title: Evaluation – year: 2005 ident: bib0039 article-title: Annual plan 2005-2006 – year: 2001 ident: bib0024 publication-title: Participation: The new tyranny? – volume: 60 start-page: 112 year: 2017 end-page: 122 ident: bib0031 article-title: Failing better: The stochastic art of evaluating community-led environmental action programs publication-title: Evaluation and Program Planning – year: 2001 ident: bib0033 article-title: Whaiora: Māori health development – volume: 62 start-page: 784 year: 2011 end-page: 798 ident: bib0017c article-title: After paradigm: Why mixing-methodology theorising fails and how to make it work again publication-title: Journal of the Operational Research Society – volume: 24 start-page: 233 year: 2007 end-page: 247 ident: bib0111 article-title: Practitioner identity in systemic intervention: Reflections on the promotion of environmental health through Māori community development publication-title: Systems Research and Behavioral Science – volume: 2 start-page: 47 year: 1987 end-page: 73 ident: bib0075 article-title: Community operational research: Purposes, theory and practice publication-title: Dragon – volume: 21 start-page: 1171 year: 2016 end-page: 1184 ident: bib0174 article-title: Understanding the impact of democratic logics on participatory resource decision-making in New Zealand publication-title: Local Environment – year: 2001 ident: bib0150 publication-title: Rational analysis for a problematic world revisited: Problem structuring methods for complexity, uncertainty and conflict – year: 1998 ident: bib0032 article-title: Te mana, te kāwanatanga: The politics of māori self-determination – year: 1994 ident: bib0145 publication-title: Community works: 26 case studies showing community operational research in action – year: 1972 ident: bib0142 article-title: Objective knowledge – volume: 35 start-page: 427 year: 2012 end-page: 438 ident: bib0067 article-title: An approach to design long-term monitoring and evaluation frameworks in multi-actor systems—A case in water management publication-title: Evaluation and Program Planning – year: 2005 ident: bib0037 article-title: Developmental work research: Expanding activity theory in practice – volume: 7 start-page: 457 year: 1994 end-page: 463 ident: bib0134 article-title: Inquiry systems of upanishads publication-title: Systems Practice – year: 2006 ident: bib0073 article-title: Community development: Community-based alternatives in an age of globalisation – volume: 12 start-page: 513 year: 1999 end-page: 532 ident: bib0133 article-title: Man-machine systems: People and technology in OR publication-title: Systemic Practice and Action Research – volume: 32 start-page: 453 year: 2001 end-page: 467 ident: bib0057 article-title: Critical facilitation: Learning through intervention in group processes publication-title: Management Learning – year: 2006 ident: bib0019 article-title: Learning for action: A short definitive account of soft systems methodology and its use for practitioners, teachers and students – volume: 268 start-page: 761 year: 2018 end-page: 770 ident: bib0086 article-title: Community operational research: Innovations, internationalization and agenda-setting applications publication-title: European Journal of Operational Research – year: 2003 ident: bib0026 article-title: Addressing organisational and societal concerns: An application of critical systems thinking to information systems planning in Colombia publication-title: Critical reflections on information systems: A systemic approach – volume: 6 start-page: 179 year: 2000 end-page: 199 ident: bib0016l article-title: Problematizing participation: A critical review of approaches to participation in evaluation theory publication-title: Evaluation – volume: 253 start-page: 681 year: 2016 end-page: 696 ident: bib0016h article-title: Unpacking multimethodology: Impacts of a community development intervention publication-title: European Journal of Operational Research – volume: 53 start-page: 369 year: 2002 end-page: 378 ident: bib0016r article-title: The use of multimethodology in practice - Results of a survey of practitioners publication-title: Journal of the Operational Research Society – year: 1994 ident: bib0016e publication-title: The North Humberside diversion from custody project for mentally disordered offenders: Research report – volume: 12 start-page: 95 year: 2006 end-page: 118 ident: bib0059 article-title: The modus narrandi: A methodology for evaluating effects of environmental policy publication-title: Evaluation – year: 2001 ident: bib0120 article-title: Operational research and environmental management: A new agenda – volume: 268 start-page: 904 year: 2018 end-page: 917 ident: bib0049 article-title: Extending community operational research to address institutional aspects of societal problems: Experiences from peri-urban Bangladesh publication-title: European Journal of Operational Research – year: 1991 ident: bib0079 article-title: Systems methodology for the management sciences – year: 1990 ident: bib0160 article-title: Basics of qualitative research: Grounded theory procedures and techniques – year: 1989 ident: bib0104 article-title: Critical systems: The theory and practice of partitioning methodologies publication-title: Proceedings of the 33rd Annual Meeting of the International Society for the Systems Sciences, held – year: 1996 ident: bib0016z publication-title: Systems methodology II: Possibilities for cross-cultural learning and integration – volume: 35 start-page: 523 year: 2012 end-page: 528 ident: bib0147 article-title: Advances in collaborative evaluation publication-title: Evaluation and Program Planning – year: 1996 ident: bib0005 article-title: Collaborative research stories: Whakawhanaungatanga – year: 2019 ident: bib0083 article-title: Critical systems thinking and the management of complexity – volume: 268 start-page: 852 year: 2018 end-page: 864 ident: bib0063 article-title: Operationalising systemic resilience publication-title: European Journal of Operational Research – volume: 30 start-page: 379 year: 2001 end-page: 409 ident: bib0109 article-title: Rethinking the unity of science publication-title: International Journal of General Systems – volume: 13 start-page: 3 year: 2000 end-page: 9 ident: bib0016n article-title: Systems practice in China: New developments and cross-cultural collaborations publication-title: Systemic Practice and Action Research – year: 2008 ident: bib0087 article-title: Evaluation in and for developmental work activity: Towards an activity theoretically oriented narrative evaluation approach – volume: 32 start-page: 534 year: 2015 end-page: 545 ident: bib0015 article-title: A unifying theory of systems thinking with psychosocial applications publication-title: Systems Research and Behavioral Science – volume: 359 start-page: 1206 year: 2018 end-page: 1209 ident: bib0072 article-title: Master planner publication-title: Science (New York, N.Y.) – volume: 229 start-page: 143 year: 2013 end-page: 154 ident: bib0112 article-title: Towards a new framework for evaluating systemic problem structuring methods publication-title: European Journal of Operational Research – year: 2012 ident: bib0164 article-title: The institutional logics perspective: A new approach to culture, structure and process – volume: 12 start-page: 108 year: 1990 end-page: 113 ident: bib0016t article-title: Creative methodology design publication-title: Systemist – reference: Pawson, R., Greenhalgh, T., & Harvey, G. (2004). Realist synthesis: An introduction. ESRC Research Methods Programme, University of Manchester RMP Methods Paper 2/2004, pp. 7–8. URL (accessed May 2011): – year: 2000 ident: bib0103 article-title: Environmental planning and management: The broad context publication-title: Environmental planning and management in New Zealand – volume: 11 start-page: 390 year: 2005 end-page: 414 ident: bib0094 article-title: An evaluation capacity-building process for sustainable community IT initiatives: Empowering and disempowering impacts publication-title: Evaluation – volume: 6 start-page: 583 year: 1993 end-page: 611 ident: bib0165 article-title: Some difficulties of ecological thinking, considered from a critical systems perspective: A plea for critical holism publication-title: Systems Practice – year: 2004 ident: bib0117 article-title: Community operational research: OR and systems thinking for community development – volume: 58 start-page: 1306 year: 2007 end-page: 1320 ident: bib0007 article-title: Systemic evaluation: A participative, multi-method approach publication-title: Journal of the Operational Research Society – volume: 10 start-page: 305 year: 1997 end-page: 319 ident: bib0106 article-title: Developing the methodology of TSI: From the oblique use of methods to creative design publication-title: Systems Practice – volume: 5 start-page: 65 year: 1988 end-page: 76 ident: bib0090 article-title: A methodology for methodology choice publication-title: Systems Research – volume: 268 start-page: 798 year: 2018 end-page: 808 ident: bib0008 article-title: Capturing the imprecision during an OR intervention: What is, what isn't and what should be publication-title: European Journal of Operational Research – year: 1999 ident: bib0157 article-title: Decolonizing methodologies: Research and indigenous peoples – volume: 36 start-page: 1 year: 2008 end-page: 10 ident: bib0167 article-title: Service-dominant logic: Continuing the evolution publication-title: Journal of the Academy of Marketing Science – volume: 22 start-page: 14 year: 2017 end-page: 30 ident: bib0029 article-title: Factors influencing successful collaboration for fresh-water management in Aotearoa, New Zealand publication-title: Ecology and Society – year: 2015 ident: bib0038 article-title: Learning by expanding: An activity-theoretical approach to developmental research – volume: 51 start-page: 278 year: 2000 end-page: 290 ident: bib0054 article-title: Planning for disaster: Developing a multi-agency counselling service publication-title: Journal of the Operational Research Society – volume: 28 start-page: 537 year: 2011 end-page: 552 ident: bib0016c article-title: Towards a framework for multiparadigm multimethodologies publication-title: Systems Research and Behavioral Science – volume: 10 start-page: 37 year: 1997 end-page: 57 ident: bib0107 article-title: Dealing with coercion: Critical systems heuristics and beyond publication-title: Systems Practice – volume: 27 start-page: 339 year: 2000 end-page: 350 ident: bib0023 article-title: Te whanau cadillac—A waka for change publication-title: Health Education & Behavior – year: 2006 ident: bib0110 article-title: Systems thinking for evaluation publication-title: Systems concepts in evaluation: An expert anthology – year: 1748 ident: bib0071 article-title: An enquiry concerning human understanding – year: 2003 ident: bib0081 article-title: Systems thinking: Creative holism for managers – volume: 12 start-page: 56 year: 2004 end-page: 64 ident: bib0123 article-title: Systems/operational research and sustainable development: Towards a new agenda publication-title: Sustainable Development – volume: 29 start-page: 427 year: 2008 end-page: 442 ident: bib0158 article-title: An assessment of the theoretical underpinnings of practical participatory evaluation publication-title: American Journal of Evaluation – volume: 13 start-page: 705 year: 2000 end-page: 715 ident: bib0089 article-title: Community natural resource management: Promise, rhetoric and reality publication-title: Society and Natural Resources – volume: 64 start-page: 873 year: 2013 end-page: 883 ident: bib0016i article-title: Multimethodology in metaheuristics publication-title: Journal of the Operational Research Society – year: 1994 ident: bib0166 article-title: Critical heuristics of social planning: A new approach to practical philosophy – year: 1979 ident: bib0002 article-title: Mind and nature: A necessary unity – volume: 21 start-page: 9 year: 2016 ident: bib0060 article-title: Indigenous Māori values and perspectives to inform freshwater management in Aotearoa-New Zealand publication-title: Ecology and Society – volume: 1 start-page: 1 year: 2017 end-page: 8 ident: bib0091 article-title: Collaborative planning in response to policy failure: The case of freshwater management in Canterbury, Aotearoa New Zealand publication-title: Case Studies in the Environment – year: 2015 ident: bib0014 article-title: Systems thinking made simple: New hope for solving wicked problems – volume: 14 start-page: 155 year: 2016 end-page: 164 ident: bib0001 article-title: Navigating governance networks for community-based conservation publication-title: Frontiers in Ecology and the Environment – volume: 15 start-page: 79 year: 1994 end-page: 82 ident: bib0016d article-title: Theory-driven evaluations: Need, difficulties, and options publication-title: Evaluation Practice – year: 1987 ident: bib0077 article-title: New directions in management science publication-title: New directions in management science – volume: 57 start-page: 1435 year: 2006 end-page: 1441 ident: bib0021 article-title: Process and content: Two ways of using SSM publication-title: Journal of the Operational Research Society – volume: 268 start-page: 1134 year: 2018 end-page: 1148 ident: bib0017b article-title: Systemic lean intervention: Enhancing lean with community operational research publication-title: European Journal of Operational Research – volume: 31 start-page: 363 year: 2010 end-page: 381 ident: bib0016a article-title: Unpacking black boxes: mechanisms and theory building in evaluation publication-title: American Journal of Evaluation – volume: 63 start-page: 269 year: 2001 end-page: 279 ident: bib0088 article-title: Towards participatory environmental management? publication-title: Journal of Environmental Management – volume: 15 start-page: 773 year: 1991 end-page: 783 ident: bib0097 article-title: Environmental care in agricultural catchments: Toward the communicative catchment publication-title: Journal of Environmental Management – year: 1990 ident: bib0020 article-title: Soft systems methodology in action – year: 1996 ident: bib0016v article-title: The ideal of unity and the practice of pluralism in systems science publication-title: Critical systems thinking: Current research and practice – year: 2000 ident: bib0161 article-title: Partnership and participation: Decision-making in the multiagency setting – volume: 67 start-page: 70 year: 2018 end-page: 78 ident: bib0022 article-title: Uncovering the mysteries of inclusion: Empirical and methodological possibilities in participatory evaluation in an international context publication-title: Evaluation and Program Planning – year: 1987 ident: bib0025 article-title: Appreciative inquiry in organizational life publication-title: Research in organizational change and development – year: 2000 ident: bib0108 article-title: Systemic intervention: Philosophy, methodology, and practice – volume: 2 start-page: 109 year: 1971 end-page: 140 ident: bib0048 article-title: Counterintuitive behaviour of social systems publication-title: Theory and Decision – volume: 32 start-page: 50 year: 2015 end-page: 63 ident: bib0009 article-title: A complexity-informed approach to evaluating national knowledge and innovation programmes publication-title: Systems Research and Behavioral Science – year: 2009 ident: bib0040 article-title: Community group and landowner support: The resource care team, – volume: 43 start-page: 960 year: 2000 end-page: 974 ident: bib0035 article-title: Activity theory as a framework for analysing and redesigning work publication-title: Ergonomics – volume: 157 start-page: 84 year: 2015 end-page: 95 ident: bib0061 article-title: Towards understanding participatory processes: Framework, application and results publication-title: Journal of Environmental Management – year: 2004 ident: bib0006 article-title: Systemic intervention for community OR: Developing services with young people (under 16) living on the streets publication-title: Community operational research: OR and systems thinking for community development – volume: 13 start-page: 11 year: 2000 end-page: 20 ident: bib0058 article-title: Knowing publication-title: Systemic Practice and Action Research – year: 2002 ident: bib0135 article-title: Broadsheet: Newsletter of the New Zealand Association of Resource Management – year: 2009 ident: bib0046 article-title: Towards a model of relational contracting for economic and environmental sustainability of strong wool – volume: 33 start-page: 60 year: 2012 end-page: 78 ident: bib0151 article-title: Dealing with complex causality in realist synthesis: The promise of qualitative comparative analysis publication-title: American Journal of Evaluation – year: 1997 ident: bib0128 article-title: Multimethodology: The theory and practice of combining management science methodologies – year: 1996 ident: bib0044 publication-title: Critical systems thinking: Current research and practice – year: 2004 ident: bib0118 article-title: An introduction to community OR publication-title: Community operational research: OR and systems thinking for community development – volume: 4 start-page: 82 year: 1995 end-page: 92 ident: bib0162 article-title: National culture and group support systems: Filtering communication to dampen power differentials publication-title: European Journal of Information Systems – volume: 120 start-page: 55 year: 2008 end-page: 69 ident: bib0163 article-title: Evaluation capacity building in complex organizations publication-title: New Directions for Evaluation – year: 2000 ident: bib0099 article-title: Decolonising planning: The Treaty of Waitangi, the environment and a dual planning tradition publication-title: Environmental planning and management in New Zealand – volume: 5 start-page: 37 year: 1992 end-page: 60 ident: bib0053 article-title: Evaluating organizations: A systems and contingency approach publication-title: Systems Practice – year: 2004 ident: bib0068 publication-title: Participation: From tyranny to transformation? – volume: 20 start-page: 323 year: 2007 end-page: 336 ident: bib0101 article-title: Community environmental management in New Zealand: Exploring the realities in the metaphor publication-title: Society and Natural Resources – year: 2002 ident: bib0121 article-title: Operational research and environmental management: A new agenda publication-title: Systems thinking and practice in the knowledge age – year: 2000 ident: bib0080 article-title: Systems approaches to management – volume: 13 start-page: 71 year: 2000 end-page: 96 ident: bib0113 article-title: Dealing with human relations in Chinese systems practice publication-title: Systemic Practice and Action Research – volume: 16 start-page: 584 year: 2007 end-page: 603 ident: bib0153 article-title: Grassroots innovations for sustainable development: Towards a new research and policy agenda publication-title: Environmental Politics – volume: 20 start-page: 211 year: 2007 end-page: 244 ident: bib0155 article-title: Toward a Buddhist systems methodology 3: An application in a Taiwanese non-governmental organization publication-title: Systemic Practice and Action Research – volume: 27 start-page: 131 year: 2006 end-page: 150 ident: bib0093 article-title: Open for innovation: The role of openness in explaining innovation performance among U.K. manufacturing firms publication-title: Strategic Management Journal – volume: 16 start-page: 233 year: 2010 end-page: 248 ident: bib0003 article-title: Dealing with distrust and power dynamics: Asymmetric relations amongst stakeholders in responsive evaluation publication-title: Evaluation – volume: 268 start-page: 1178 year: 2018 end-page: 1191 ident: bib0085 article-title: Emerging trends and new frontiers in community operational research publication-title: European Journal of Operational Research – year: 1997 ident: bib0016y article-title: Sharing power: Integrating user involvement and multi-agency working to improve housing for older people – year: 2009 ident: bib0129 article-title: An everyday guide to the RMA: Getting in on the act – volume: 2 start-page: 37 year: 2007 end-page: 55 ident: bib0066 article-title: “Koe wai hoki koe?!”, or “Who are you?!”: Issues of trust in cross-cultural collaborative research publication-title: Kōtuitui: New Zealand Journal of Social Sciences Online – volume: 7 start-page: 673 year: 2000 end-page: 691 ident: bib0016q article-title: Variety is the spice of life: Combining soft and hard OR/MS methods publication-title: International Transactions in Operational Research – year: 2010 ident: bib0130 article-title: Evaluation in the face of uncertainty: Anticipating surprise and responding to the inevitable – year: 2016 ident: bib0016x article-title: Moving beyond value conflicts: Systemic problem structuring in action publication-title: Research Memorandum No. 96 – volume: 11 start-page: 85 year: 1984 end-page: 103 ident: bib0127 article-title: Subjectivism and soft systems methodology—A critique publication-title: Journal of Applied Systems Analysis – volume: 232 start-page: 427 year: 2014 end-page: 434 ident: bib0095 article-title: Soft OR in China: A critical report publication-title: European Journal of Operational Research – volume: 20 start-page: 195 year: 2007 end-page: 210 ident: bib0124 article-title: Toward a Buddhist systems methodology 2: An exploratory, questioning approach publication-title: Systemic Practice and Action Research – volume: 43 start-page: 19 year: 1992 end-page: 28 ident: bib0052 article-title: Evaluation methodologies: A system for use publication-title: Journal of the Operational Research Society – volume: 154 start-page: 4 year: 2016 end-page: 7 ident: bib0062 article-title: Why is an APT approach to wicked problems important? publication-title: Landscape and Urban Planning – volume: 14 start-page: 29 year: 2008 end-page: 48 ident: bib0148 article-title: Using programme theory to evaluate complicated and complex aspects of interventions publication-title: Evaluation – volume: 32 start-page: 229 year: 2009 end-page: 237 ident: bib0136 article-title: Power and perceptions in participatory monitoring and evaluation publication-title: Evaluation and Program Planning – volume: 38 start-page: 275 year: 2017 end-page: 293 ident: bib0140 article-title: Outcome evidencing: A method for enabling and evaluating program intervention in complex systems publication-title: American Journal of Evaluation – volume: 13 start-page: 170 year: 2015 end-page: 193 ident: bib0156 article-title: Action research in a problem avoiding culture using a Buddhist systems methodology publication-title: Action Research – year: 2004 ident: bib0122 article-title: Community and environmental OR: Towards a new agenda publication-title: Community operational research: OR and systems thinking for community development – volume: 20 start-page: 167 year: 2007 end-page: 194 ident: bib0154 article-title: Toward a Buddhist systems methodology 1: Comparisons between Buddhism and systems theory publication-title: Systemic Practice and Action Research – volume: 33 start-page: 662 year: 2016 end-page: 673 ident: bib0144 article-title: Towards systemic evaluation publication-title: Systems Research and Behavioral Science – volume: 71 start-page: 41 year: 2017 end-page: 55 ident: bib0146 article-title: Making water policy work in the United Kingdom: A case study of practical approaches to strengthening complex, multi-tiered systems of water governance publication-title: Environmental Science & Policy – volume: 30 start-page: 115 year: 2007 end-page: 124 ident: bib0041 article-title: Key considerations for logic model development in research partnerships: A Canadian case study publication-title: Evaluation and Program Planning – year: 1994 ident: bib0016k article-title: Organisational evaluation: A complementarist approach – volume: 268 start-page: 865 year: 2018 end-page: 874 ident: bib0013 article-title: Deepening and scaling participatory research with the poorest and most marginalised publication-title: European Journal of Operational Research – year: 2010 ident: bib0138 article-title: Developmental evaluation: Applying complexity concepts to enhance innovation and use – volume: 227 start-page: 558 year: 2013 end-page: 569 ident: bib0050 article-title: A problem structuring method for ecosystem-based management: The DPSIR modelling process publication-title: European Journal of Operational Research – year: 2011 ident: bib0100 article-title: Addressing cause and effect in simple and complex settings through contribution analysis publication-title: Evaluating the complex: Attribution, contribution and beyond – volume: 13 start-page: 21 year: 2000 end-page: 57 ident: bib0176 article-title: Dealing with a differentiated whole: The philosophy of the WSR approach publication-title: Systemic Practice and Action Research – volume: 13 start-page: 111 year: 2000 end-page: 115 ident: bib0169 article-title: Meta-decision making: Concepts and paradigm publication-title: Systemic Practice and Action Research – volume: 152 start-page: 667 year: 2004 end-page: 683 ident: bib0069 article-title: Enhancing public participation in natural resource management using soft OR - An application of strategic option development and analysis in tactical forest planning publication-title: European Journal of Operational Research – volume: 13 start-page: 61 year: 2000 end-page: 73 ident: bib0027a article-title: Landcare and catchment management in Australia: Lessons for state-sponsored community participation publication-title: Society and Natural Resources – volume: 62 start-page: 1543 year: 2011 end-page: 1554 ident: bib0119 article-title: The implications of boundary critique for conflict prevention publication-title: Journal of the Operational Research Society – volume: 268 start-page: 771 year: 2018 end-page: 783 ident: bib0114 article-title: What is community operational research? publication-title: European Journal of Operational Research – volume: 7 start-page: 41 year: 1980 end-page: 50 ident: bib0126 article-title: Towards an appropriate social theory for applied systems thinking: Critical theory and soft systems methodology publication-title: Journal of Applied Systems Analysis – volume: 39 start-page: 715 year: 1988 end-page: 724 ident: bib0078 article-title: Some methodologies for community operational research publication-title: Journal of the Operational Research Society – volume: 137 start-page: 137 year: 2014 end-page: 145 ident: bib0034 article-title: Assessing participatory practices in community-based natural resource management: Experiences in community engagement from southern Africa publication-title: Journal of Environmental Management – year: 2013 ident: bib0168 article-title: The change laboratory: A tool for collaborative development of work and education – volume: 141 start-page: 2417 year: 2008 end-page: 2431 ident: bib0143 article-title: Stakeholder participation for environmental management: A literature review publication-title: Biological Conservation – volume: 49 start-page: 467 year: 1998 end-page: 478 ident: bib0115 article-title: The theory and practice of boundary critique: Developing housing services for older people publication-title: Journal of the Operational Research Society – year: 2006 ident: bib0092 article-title: Te kotahitanga o te whakahaere rawa: Māori and council engagement under the resource management act 1991 – volume: 31 start-page: 299 year: 2008 end-page: 310 ident: bib01016 article-title: Systems thinking publication-title: Evaluation and Program Planning – year: 1981 ident: bib0017 article-title: Systems thinking, systems practice – year: 2001 ident: bib0018 article-title: Soft systems methodology publication-title: Rational analysis for a problematic world revisited – volume: 57 start-page: 1064 year: 2006 end-page: 1080 ident: bib0016g article-title: Broadening the boundaries: An application of critical systems thinking to IS planning in Colombia publication-title: Journal of the Operational Research Society – volume: 57 start-page: 856 year: 2006 end-page: 867 ident: bib0016p article-title: Combining PSMs with hard OR methods: The philosophical and practical challenges publication-title: Journal of the Operational Research Society – volume: 13 start-page: 28 year: 2006 end-page: 33 ident: bib0137 article-title: Evaluation for the way we work publication-title: Nonprofit Quarterly – volume: 268 start-page: 946 year: 2018 end-page: 959 ident: bib0141 article-title: Community operational research: Developing a systemic peace education programme involving urban and rural communities in Colombia publication-title: European Journal of Operational Research – year: 1997 ident: bib0017a publication-title: The third UK/China/Japan workshop on systems methodology: Possibilities for cross-cultural learning and integration – volume: 155 start-page: 88 year: 2017 end-page: 102 ident: bib0030 article-title: Towards a complexity-aware theory of change for participatory research programs working within agricultural innovation systems publication-title: Agricultural Systems – year: 2004 ident: bib0098 article-title: Rethinking systems thinking: Towards a postmodern understanding of the nature of systemic inquiry – volume: 268 start-page: 996 year: 2018 end-page: 1005 ident: bib0010 article-title: Processes of engagement and methodology design in community operational research: Insights from the indigenous peoples sector publication-title: European Journal of Operational Research – volume: 5 start-page: 147 year: 1992 end-page: 172 ident: bib0105 article-title: Pluralism and the legitimation of systems science publication-title: Systems Practice – volume: 44 start-page: 1 year: 2014 end-page: 13 ident: bib0027 article-title: Government and voluntary sector differences in organizational capacity to do and use evaluation publication-title: Evaluation and Program Planning – year: 2009 ident: bib0152 article-title: Engineering in the water environment good practice guide: Riperian vegetation management – volume: 35 start-page: 473 year: 1984 end-page: 486 ident: bib0084 article-title: Towards a system of systems methodologies publication-title: Journal of the Operational Research Society – year: 1992 ident: bib0055 article-title: Critical systems thinking and pluralism: A new constellation – volume: 57 start-page: 868 year: 2006 end-page: 878 ident: bib0082 article-title: Beyond problem structuring methods: Reinventing the future of OR/MS publication-title: Journal of the Operational Research Society – volume: 20 start-page: 119 year: 1989 end-page: 131 ident: bib0016s article-title: Critical systems and the problem of pluralism publication-title: Cybernetics and Systems – volume: 268 start-page: 1040 year: 2018 end-page: 1049 ident: bib0016o article-title: Managing community engagement: A process model for urban planning publication-title: European Journal of Operational Research – year: 1739 ident: bib0070 article-title: A treatise of human nature – volume: 283 start-page: 321 year: 2020 end-page: 340 ident: bib0051 article-title: Stakeholder identification and engagement in problem structuring interventions publication-title: European Journal of Operational Research – volume: 55 start-page: 560 year: 2011 end-page: 578 ident: bib0132 article-title: The primacy of human capital and social capital in influencing landholders’ participation in programmes designed to improve environmental outcomes publication-title: Australian Journal of Agricultural and Resource Economics – volume: 58 start-page: 645 year: 2007 end-page: 654 ident: bib0047 article-title: Systemic problem structuring applied to community involvement in water conservation publication-title: Journal of the Operational Research Society – year: 1989 ident: bib0016f article-title: Fourth Generation Evaluation – volume: 268 start-page: 984 year: 2018 end-page: 995 ident: bib0131 article-title: Empowering indigenous voices in disaster response: Applying the mauri model to New Zealand's worst environmental maritime disaster publication-title: European Journal of Operational Research – volume: 15 start-page: 455 year: 1987 end-page: 466 ident: bib0076 article-title: Present positions and future prospects in management science publication-title: Omega – volume: 50 start-page: 403 year: 1997 end-page: 416 ident: bib0159 article-title: Ethics and environmental attitudes with implications for economic valuation publication-title: Journal of Environmental Management – volume: 253 start-page: 681 issue: 3 year: 2016 ident: 10.1016/j.ejor.2020.05.019_bib0016h article-title: Unpacking multimethodology: Impacts of a community development intervention publication-title: European Journal of Operational Research doi: 10.1016/j.ejor.2016.02.044 – volume: 53 start-page: 369 issue: 4 year: 2002 ident: 10.1016/j.ejor.2020.05.019_bib0016r article-title: The use of multimethodology in practice - Results of a survey of practitioners publication-title: Journal of the Operational Research Society doi: 10.1057/palgrave.jors.2601331 – volume: 16 start-page: 233 issue: 3 year: 2010 ident: 10.1016/j.ejor.2020.05.019_bib0003 article-title: Dealing with distrust and power dynamics: Asymmetric relations amongst stakeholders in responsive evaluation publication-title: Evaluation doi: 10.1177/1356389010370251 – volume: 22 start-page: 14 issue: 2 year: 2017 ident: 10.1016/j.ejor.2020.05.019_bib0029 article-title: Factors influencing successful collaboration for fresh-water management in Aotearoa, New Zealand publication-title: Ecology and Society doi: 10.5751/ES-09126-220214 – volume: 152 start-page: 667 issue: 3 year: 2004 ident: 10.1016/j.ejor.2020.05.019_bib0069 article-title: Enhancing public participation in natural resource management using soft OR - An application of strategic option development and analysis in tactical forest planning publication-title: European Journal of Operational Research doi: 10.1016/S0377-2217(03)00065-1 – volume: 141 start-page: 2417 issue: 10 year: 2008 ident: 10.1016/j.ejor.2020.05.019_bib0143 article-title: Stakeholder participation for environmental management: A literature review publication-title: Biological Conservation doi: 10.1016/j.biocon.2008.07.014 – volume: 30 start-page: 115 year: 2007 ident: 10.1016/j.ejor.2020.05.019_bib0041 article-title: Key considerations for logic model development in research partnerships: A Canadian case study publication-title: Evaluation and Program Planning doi: 10.1016/j.evalprogplan.2007.01.002 – volume: 232 start-page: 427 issue: 3 year: 2014 ident: 10.1016/j.ejor.2020.05.019_bib0095 article-title: Soft OR in China: A critical report publication-title: European Journal of Operational Research doi: 10.1016/j.ejor.2013.04.035 – volume: 1 start-page: 1 issue: 1 year: 2017 ident: 10.1016/j.ejor.2020.05.019_bib0091 article-title: Collaborative planning in response to policy failure: The case of freshwater management in Canterbury, Aotearoa New Zealand publication-title: Case Studies in the Environment doi: 10.1525/cse.2017.000513 – volume: 12 start-page: 56 year: 2004 ident: 10.1016/j.ejor.2020.05.019_bib0123 article-title: Systems/operational research and sustainable development: Towards a new agenda publication-title: Sustainable Development doi: 10.1002/sd.218 – volume: 51 start-page: 278 year: 2000 ident: 10.1016/j.ejor.2020.05.019_bib0054 article-title: Planning for disaster: Developing a multi-agency counselling service publication-title: Journal of the Operational Research Society doi: 10.1057/palgrave.jors.2600912 – year: 1992 ident: 10.1016/j.ejor.2020.05.019_bib0055 – volume: 63 start-page: 115 issue: 3 year: 2000 ident: 10.1016/j.ejor.2020.05.019_bib0028 article-title: Using programme logic models in evaluation: A review of the literature and the spinal outreach team experience publication-title: British Journal of Occupational Therapy doi: 10.1177/030802260006300305 – volume: 29 start-page: 427 issue: 4 year: 2008 ident: 10.1016/j.ejor.2020.05.019_bib0158 article-title: An assessment of the theoretical underpinnings of practical participatory evaluation publication-title: American Journal of Evaluation doi: 10.1177/1098214008325023 – volume: 13 start-page: 3 issue: 1 year: 2000 ident: 10.1016/j.ejor.2020.05.019_bib0016n article-title: Systems practice in China: New developments and cross-cultural collaborations publication-title: Systemic Practice and Action Research doi: 10.1023/A:1009515404417 – year: 2001 ident: 10.1016/j.ejor.2020.05.019_bib0173 – year: 1990 ident: 10.1016/j.ejor.2020.05.019_bib0020 – volume: 268 start-page: 1178 issue: 3 year: 2018 ident: 10.1016/j.ejor.2020.05.019_bib0085 article-title: Emerging trends and new frontiers in community operational research publication-title: European Journal of Operational Research doi: 10.1016/j.ejor.2017.11.032 – year: 2005 ident: 10.1016/j.ejor.2020.05.019_bib0039 – year: 2013 ident: 10.1016/j.ejor.2020.05.019_bib0168 – volume: 5 start-page: 65 year: 1988 ident: 10.1016/j.ejor.2020.05.019_bib0090 article-title: A methodology for methodology choice publication-title: Systems Research doi: 10.1002/sres.3850050108 – year: 2013 ident: 10.1016/j.ejor.2020.05.019_bib0064 – year: 2006 ident: 10.1016/j.ejor.2020.05.019_bib0019 – volume: 268 start-page: 946 issue: 3 year: 2018 ident: 10.1016/j.ejor.2020.05.019_bib0141 article-title: Community operational research: Developing a systemic peace education programme involving urban and rural communities in Colombia publication-title: European Journal of Operational Research doi: 10.1016/j.ejor.2017.11.040 – volume: 12 start-page: 108 year: 1990 ident: 10.1016/j.ejor.2020.05.019_bib0016t article-title: Creative methodology design publication-title: Systemist – volume: 1 start-page: 37 issue: 3 year: 1973 ident: 10.1016/j.ejor.2020.05.019_bib0171 article-title: Where politics and evaluation research meet publication-title: Evaluation – volume: 229 start-page: 143 year: 2013 ident: 10.1016/j.ejor.2020.05.019_bib0112 article-title: Towards a new framework for evaluating systemic problem structuring methods publication-title: European Journal of Operational Research doi: 10.1016/j.ejor.2013.01.047 – volume: 12 start-page: 95 issue: 1 year: 2006 ident: 10.1016/j.ejor.2020.05.019_bib0059 article-title: The modus narrandi: A methodology for evaluating effects of environmental policy publication-title: Evaluation doi: 10.1177/1356389006064176 – volume: 30 start-page: 379 year: 2001 ident: 10.1016/j.ejor.2020.05.019_bib0109 article-title: Rethinking the unity of science publication-title: International Journal of General Systems doi: 10.1080/03081070108960713 – year: 1991 ident: 10.1016/j.ejor.2020.05.019_bib0079 – volume: 268 start-page: 984 year: 2018 ident: 10.1016/j.ejor.2020.05.019_bib0131 article-title: Empowering indigenous voices in disaster response: Applying the mauri model to New Zealand's worst environmental maritime disaster publication-title: European Journal of Operational Research doi: 10.1016/j.ejor.2017.05.030 – year: 2004 ident: 10.1016/j.ejor.2020.05.019_bib0098 – year: 2004 ident: 10.1016/j.ejor.2020.05.019_bib0006 article-title: Systemic intervention for community OR: Developing services with young people (under 16) living on the streets – volume: 9 start-page: 605 year: 1996 ident: 10.1016/j.ejor.2020.05.019_bib0056 article-title: Discordant pluralism: A new strategy for critical systems thinking publication-title: Systems Practice doi: 10.1007/BF02169216 – year: 2002 ident: 10.1016/j.ejor.2020.05.019_bib0135 – year: 1987 ident: 10.1016/j.ejor.2020.05.019_bib0077 article-title: New directions in management science – year: 2000 ident: 10.1016/j.ejor.2020.05.019_bib0099 article-title: Decolonising planning: The Treaty of Waitangi, the environment and a dual planning tradition – volume: 20 start-page: 119 year: 1989 ident: 10.1016/j.ejor.2020.05.019_bib0016s article-title: Critical systems and the problem of pluralism publication-title: Cybernetics and Systems doi: 10.1080/01969728908902205 – year: 1994 ident: 10.1016/j.ejor.2020.05.019_bib0166 – year: 2003 ident: 10.1016/j.ejor.2020.05.019_bib0081 – volume: 268 start-page: 798 issue: 3 year: 2018 ident: 10.1016/j.ejor.2020.05.019_bib0008 article-title: Capturing the imprecision during an OR intervention: What is, what isn't and what should be publication-title: European Journal of Operational Research doi: 10.1016/j.ejor.2017.11.024 – year: 2015 ident: 10.1016/j.ejor.2020.05.019_bib0038 – year: 1972 ident: 10.1016/j.ejor.2020.05.019_bib0142 – year: 1748 ident: 10.1016/j.ejor.2020.05.019_bib0071 – volume: 58 start-page: 1306 year: 2007 ident: 10.1016/j.ejor.2020.05.019_bib0007 article-title: Systemic evaluation: A participative, multi-method approach publication-title: Journal of the Operational Research Society doi: 10.1057/palgrave.jors.2602281 – year: 1998 ident: 10.1016/j.ejor.2020.05.019_bib0032 – volume: 14 start-page: 29 issue: 1 year: 2008 ident: 10.1016/j.ejor.2020.05.019_bib0148 article-title: Using programme theory to evaluate complicated and complex aspects of interventions publication-title: Evaluation doi: 10.1177/1356389007084674 – year: 2015 ident: 10.1016/j.ejor.2020.05.019_bib0014 – volume: 5 start-page: 147 year: 1992 ident: 10.1016/j.ejor.2020.05.019_bib0105 article-title: Pluralism and the legitimation of systems science publication-title: Systems Practice doi: 10.1007/BF01059938 – year: 2001 ident: 10.1016/j.ejor.2020.05.019_bib0120 – volume: 27 start-page: 339 issue: 3 year: 2000 ident: 10.1016/j.ejor.2020.05.019_bib0023 article-title: Te whanau cadillac—A waka for change publication-title: Health Education & Behavior doi: 10.1177/109019810002700308 – year: 2001 ident: 10.1016/j.ejor.2020.05.019_bib0024 publication-title: Participation: The new tyranny? – volume: 11 start-page: 85 year: 1984 ident: 10.1016/j.ejor.2020.05.019_bib0127 article-title: Subjectivism and soft systems methodology—A critique publication-title: Journal of Applied Systems Analysis – volume: 10 start-page: 37 year: 1997 ident: 10.1016/j.ejor.2020.05.019_bib0107 article-title: Dealing with coercion: Critical systems heuristics and beyond publication-title: Systems Practice doi: 10.1007/BF02557850 – volume: 49 start-page: 467 year: 1998 ident: 10.1016/j.ejor.2020.05.019_bib0115 article-title: The theory and practice of boundary critique: Developing housing services for older people publication-title: Journal of the Operational Research Society doi: 10.1057/palgrave.jors.2600531 – year: 2009 ident: 10.1016/j.ejor.2020.05.019_bib0152 – year: 1994 ident: 10.1016/j.ejor.2020.05.019_bib0145 – volume: 2 start-page: 67 issue: 1 year: 1996 ident: 10.1016/j.ejor.2020.05.019_bib0016u article-title: Evaluating services for people with disabilities: A critical systems perspective publication-title: Evaluation doi: 10.1177/135638909600200106 – year: 1979 ident: 10.1016/j.ejor.2020.05.019_bib0002 – year: 2009 ident: 10.1016/j.ejor.2020.05.019_bib0046 – volume: 2 start-page: 37 year: 2007 ident: 10.1016/j.ejor.2020.05.019_bib0066 article-title: “Koe wai hoki koe?!”, or “Who are you?!”: Issues of trust in cross-cultural collaborative research publication-title: Kōtuitui: New Zealand Journal of Social Sciences Online – volume: 13 start-page: 28 issue: 1 year: 2006 ident: 10.1016/j.ejor.2020.05.019_bib0137 article-title: Evaluation for the way we work publication-title: Nonprofit Quarterly – volume: 13 start-page: 170 issue: 2 year: 2015 ident: 10.1016/j.ejor.2020.05.019_bib0156 article-title: Action research in a problem avoiding culture using a Buddhist systems methodology publication-title: Action Research doi: 10.1177/1476750314558428 – volume: 32 start-page: 229 issue: 3 year: 2009 ident: 10.1016/j.ejor.2020.05.019_bib0136 article-title: Power and perceptions in participatory monitoring and evaluation publication-title: Evaluation and Program Planning doi: 10.1016/j.evalprogplan.2009.03.003 – volume: 35 start-page: 523 issue: 4 year: 2012 ident: 10.1016/j.ejor.2020.05.019_bib0147 article-title: Advances in collaborative evaluation publication-title: Evaluation and Program Planning doi: 10.1016/j.evalprogplan.2011.12.006 – volume: 13 start-page: 21 issue: 1 year: 2000 ident: 10.1016/j.ejor.2020.05.019_bib0176 article-title: Dealing with a differentiated whole: The philosophy of the WSR approach publication-title: Systemic Practice and Action Research doi: 10.1023/A:1009519505326 – volume: 31 start-page: 363 issue: 3 year: 2010 ident: 10.1016/j.ejor.2020.05.019_bib0016a article-title: Unpacking black boxes: mechanisms and theory building in evaluation publication-title: American Journal of Evaluation doi: 10.1177/1098214010371972 – volume: 42 start-page: 717 year: 2008 ident: 10.1016/j.ejor.2020.05.019_bib0016b article-title: Context and systems: Thinking more broadly about effectiveness in strategic environmental assessment in China publication-title: Environmental Management doi: 10.1007/s00267-008-9123-5 – volume: 13 start-page: 71 issue: 1 year: 2000 ident: 10.1016/j.ejor.2020.05.019_bib0113 article-title: Dealing with human relations in Chinese systems practice publication-title: Systemic Practice and Action Research doi: 10.1023/A:1009523606235 – volume: 268 start-page: 761 issue: 3 year: 2018 ident: 10.1016/j.ejor.2020.05.019_bib0086 article-title: Community operational research: Innovations, internationalization and agenda-setting applications publication-title: European Journal of Operational Research doi: 10.1016/j.ejor.2018.03.004 – volume: 64 start-page: 873 issue: 6 year: 2013 ident: 10.1016/j.ejor.2020.05.019_bib0016i article-title: Multimethodology in metaheuristics publication-title: Journal of the Operational Research Society doi: 10.1057/jors.2012.88 – year: 1996 ident: 10.1016/j.ejor.2020.05.019_bib0044 – volume: 359 start-page: 1206 issue: 6381 year: 2018 ident: 10.1016/j.ejor.2020.05.019_bib0072 article-title: Master planner publication-title: Science (New York, N.Y.) doi: 10.1126/science.359.6381.1206 – year: 2004 ident: 10.1016/j.ejor.2020.05.019_bib0122 article-title: Community and environmental OR: Towards a new agenda – volume: 2 start-page: 47 issue: 2 year: 1987 ident: 10.1016/j.ejor.2020.05.019_bib0075 article-title: Community operational research: Purposes, theory and practice publication-title: Dragon – volume: 16 start-page: 584 issue: 4 year: 2007 ident: 10.1016/j.ejor.2020.05.019_bib0153 article-title: Grassroots innovations for sustainable development: Towards a new research and policy agenda publication-title: Environmental Politics doi: 10.1080/09644010701419121 – volume: 7 start-page: 41 year: 1980 ident: 10.1016/j.ejor.2020.05.019_bib0126 article-title: Towards an appropriate social theory for applied systems thinking: Critical theory and soft systems methodology publication-title: Journal of Applied Systems Analysis – volume: 57 start-page: 856 issue: 7 year: 2006 ident: 10.1016/j.ejor.2020.05.019_bib0016p article-title: Combining PSMs with hard OR methods: The philosophical and practical challenges publication-title: Journal of the Operational Research Society doi: 10.1057/palgrave.jors.2602147 – volume: 15 start-page: 79 issue: 1 year: 1994 ident: 10.1016/j.ejor.2020.05.019_bib0016d article-title: Theory-driven evaluations: Need, difficulties, and options publication-title: Evaluation Practice doi: 10.1177/109821409401500109 – volume: 227 start-page: 558 issue: 3 year: 2013 ident: 10.1016/j.ejor.2020.05.019_bib0050 article-title: A problem structuring method for ecosystem-based management: The DPSIR modelling process publication-title: European Journal of Operational Research doi: 10.1016/j.ejor.2012.11.020 – volume: 5 start-page: 37 issue: 1 year: 1992 ident: 10.1016/j.ejor.2020.05.019_bib0053 article-title: Evaluating organizations: A systems and contingency approach publication-title: Systems Practice doi: 10.1007/BF01060046 – year: 1981 ident: 10.1016/j.ejor.2020.05.019_bib0017 – volume: 13 start-page: 705 year: 2000 ident: 10.1016/j.ejor.2020.05.019_bib0089 article-title: Community natural resource management: Promise, rhetoric and reality publication-title: Society and Natural Resources doi: 10.1080/089419200750035575 – volume: 38 start-page: 275 issue: 2 year: 2017 ident: 10.1016/j.ejor.2020.05.019_bib0140 article-title: Outcome evidencing: A method for enabling and evaluating program intervention in complex systems publication-title: American Journal of Evaluation doi: 10.1177/1098214016676573 – volume: 67 start-page: 70 year: 2018 ident: 10.1016/j.ejor.2020.05.019_bib0022 article-title: Uncovering the mysteries of inclusion: Empirical and methodological possibilities in participatory evaluation in an international context publication-title: Evaluation and Program Planning doi: 10.1016/j.evalprogplan.2017.12.001 – volume: 24 start-page: 233 year: 2007 ident: 10.1016/j.ejor.2020.05.019_bib0111 article-title: Practitioner identity in systemic intervention: Reflections on the promotion of environmental health through Māori community development publication-title: Systems Research and Behavioral Science doi: 10.1002/sres.827 – year: 2001 ident: 10.1016/j.ejor.2020.05.019_bib0018 article-title: Soft systems methodology – year: 1996 ident: 10.1016/j.ejor.2020.05.019_bib0005 – volume: 60 start-page: 156 issue: 2 year: 2009 ident: 10.1016/j.ejor.2020.05.019_bib0016w article-title: Multimethodology in series and parallel: Strategic planning using hard and soft OR publication-title: Journal of the Operational Research Society doi: 10.1057/palgrave.jors.2602538 – volume: 7 start-page: 457 issue: 4 year: 1994 ident: 10.1016/j.ejor.2020.05.019_bib0134 article-title: Inquiry systems of upanishads publication-title: Systems Practice doi: 10.1007/BF02169366 – year: 2009 ident: 10.1016/j.ejor.2020.05.019_bib0040 – volume: 268 start-page: 904 issue: 3 year: 2018 ident: 10.1016/j.ejor.2020.05.019_bib0049 article-title: Extending community operational research to address institutional aspects of societal problems: Experiences from peri-urban Bangladesh publication-title: European Journal of Operational Research doi: 10.1016/j.ejor.2017.11.007 – volume: 50 start-page: 403 year: 1997 ident: 10.1016/j.ejor.2020.05.019_bib0159 article-title: Ethics and environmental attitudes with implications for economic valuation publication-title: Journal of Environmental Management doi: 10.1006/jema.1997.0017 – year: 1948 ident: 10.1016/j.ejor.2020.05.019_bib0170 article-title: Cybernetics publication-title: Scientific American doi: 10.1038/scientificamerican1148-14 – year: 2005 ident: 10.1016/j.ejor.2020.05.019_bib0037 – year: 1994 ident: 10.1016/j.ejor.2020.05.019_bib0016e – year: 1987 ident: 10.1016/j.ejor.2020.05.019_bib0025 article-title: Appreciative inquiry in organizational life – year: 2006 ident: 10.1016/j.ejor.2020.05.019_bib0110 article-title: Systems thinking for evaluation – year: 2010 ident: 10.1016/j.ejor.2020.05.019_bib0138 – year: 2011 ident: 10.1016/j.ejor.2020.05.019_bib0100 article-title: Addressing cause and effect in simple and complex settings through contribution analysis – volume: 32 start-page: 793 issue: 5 year: 2004 ident: 10.1016/j.ejor.2020.05.019_bib0175 article-title: Participation rhetoric or community-based management reality? Influences on willingness to participate in a Venezuelan freshwater fishery publication-title: World Development doi: 10.1016/j.worlddev.2004.01.002 – volume: 157 start-page: 84 year: 2015 ident: 10.1016/j.ejor.2020.05.019_bib0061 article-title: Towards understanding participatory processes: Framework, application and results publication-title: Journal of Environmental Management doi: 10.1016/j.jenvman.2015.04.012 – volume: 20 start-page: 323 year: 2007 ident: 10.1016/j.ejor.2020.05.019_bib0101 article-title: Community environmental management in New Zealand: Exploring the realities in the metaphor publication-title: Society and Natural Resources doi: 10.1080/08941920601161338 – year: 2004 ident: 10.1016/j.ejor.2020.05.019_bib0068 publication-title: Participation: From tyranny to transformation? – volume: 15 start-page: 455 year: 1987 ident: 10.1016/j.ejor.2020.05.019_bib0076 article-title: Present positions and future prospects in management science publication-title: Omega doi: 10.1016/0305-0483(87)90003-X – year: 1739 ident: 10.1016/j.ejor.2020.05.019_bib0070 – year: 2006 ident: 10.1016/j.ejor.2020.05.019_bib0073 – volume: 43 start-page: 19 year: 1992 ident: 10.1016/j.ejor.2020.05.019_bib0052 article-title: Evaluation methodologies: A system for use publication-title: Journal of the Operational Research Society doi: 10.1057/jors.1992.3 – year: 2009 ident: 10.1016/j.ejor.2020.05.019_bib0129 – volume: 62 start-page: 784 issue: 4 year: 2011 ident: 10.1016/j.ejor.2020.05.019_bib0017c article-title: After paradigm: Why mixing-methodology theorising fails and how to make it work again publication-title: Journal of the Operational Research Society doi: 10.1057/jors.2010.31 – volume: 268 start-page: 771 issue: 3 year: 2018 ident: 10.1016/j.ejor.2020.05.019_bib0114 article-title: What is community operational research? publication-title: European Journal of Operational Research doi: 10.1016/j.ejor.2017.08.014 – volume: 14 start-page: 155 issue: 3 year: 2016 ident: 10.1016/j.ejor.2020.05.019_bib0001 article-title: Navigating governance networks for community-based conservation publication-title: Frontiers in Ecology and the Environment doi: 10.1002/fee.1251 – year: 1996 ident: 10.1016/j.ejor.2020.05.019_bib0016z – volume: 71 start-page: 41 year: 2017 ident: 10.1016/j.ejor.2020.05.019_bib0146 article-title: Making water policy work in the United Kingdom: A case study of practical approaches to strengthening complex, multi-tiered systems of water governance publication-title: Environmental Science & Policy doi: 10.1016/j.envsci.2017.01.008 – volume: 35 start-page: 427 issue: 4 year: 2012 ident: 10.1016/j.ejor.2020.05.019_bib0067 article-title: An approach to design long-term monitoring and evaluation frameworks in multi-actor systems—A case in water management publication-title: Evaluation and Program Planning doi: 10.1016/j.evalprogplan.2012.01.006 – year: 2019 ident: 10.1016/j.ejor.2020.05.019_bib0083 – volume: 12 start-page: 513 year: 1999 ident: 10.1016/j.ejor.2020.05.019_bib0133 article-title: Man-machine systems: People and technology in OR publication-title: Systemic Practice and Action Research doi: 10.1023/A:1022469607464 – year: 2000 ident: 10.1016/j.ejor.2020.05.019_bib0161 – volume: 15 start-page: 773 issue: 6 year: 1991 ident: 10.1016/j.ejor.2020.05.019_bib0097 article-title: Environmental care in agricultural catchments: Toward the communicative catchment publication-title: Journal of Environmental Management – year: 1997 ident: 10.1016/j.ejor.2020.05.019_bib0128 – year: 2001 ident: 10.1016/j.ejor.2020.05.019_bib0033 – year: 1997 ident: 10.1016/j.ejor.2020.05.019_bib0017a – year: 2004 ident: 10.1016/j.ejor.2020.05.019_bib0117 – year: 1989 ident: 10.1016/j.ejor.2020.05.019_bib0016f – volume: 20 start-page: 211 year: 2007 ident: 10.1016/j.ejor.2020.05.019_bib0155 article-title: Toward a Buddhist systems methodology 3: An application in a Taiwanese non-governmental organization publication-title: Systemic Practice and Action Research doi: 10.1007/s11213-006-9060-2 – volume: 155 start-page: 88 year: 2017 ident: 10.1016/j.ejor.2020.05.019_bib0030 article-title: Towards a complexity-aware theory of change for participatory research programs working within agricultural innovation systems publication-title: Agricultural Systems doi: 10.1016/j.agsy.2017.04.002 – volume: 44 start-page: 293 issue: 3 year: 2001 ident: 10.1016/j.ejor.2020.05.019_bib0012 article-title: The twists and turns of community participation in natural resource management in Australia: What is missing? publication-title: Journal of Environmental Planning and Management doi: 10.1080/09640560120046070 – volume: 21 start-page: 9 issue: 4 year: 2016 ident: 10.1016/j.ejor.2020.05.019_bib0060 article-title: Indigenous Māori values and perspectives to inform freshwater management in Aotearoa-New Zealand publication-title: Ecology and Society doi: 10.5751/ES-08804-210409 – volume: 55 start-page: 560 issue: 4 year: 2011 ident: 10.1016/j.ejor.2020.05.019_bib0132 article-title: The primacy of human capital and social capital in influencing landholders’ participation in programmes designed to improve environmental outcomes publication-title: Australian Journal of Agricultural and Resource Economics doi: 10.1111/j.1467-8489.2011.00554.x – volume: 21 start-page: 1171 issue: 10 year: 2016 ident: 10.1016/j.ejor.2020.05.019_bib0174 article-title: Understanding the impact of democratic logics on participatory resource decision-making in New Zealand publication-title: Local Environment doi: 10.1080/13549839.2015.1127218 – volume: 44 start-page: 1 year: 2014 ident: 10.1016/j.ejor.2020.05.019_bib0027 article-title: Government and voluntary sector differences in organizational capacity to do and use evaluation publication-title: Evaluation and Program Planning doi: 10.1016/j.evalprogplan.2013.12.001 – year: 2003 ident: 10.1016/j.ejor.2020.05.019_bib0026 article-title: Addressing organisational and societal concerns: An application of critical systems thinking to information systems planning in Colombia – volume: 11 start-page: 390 issue: 4 year: 2005 ident: 10.1016/j.ejor.2020.05.019_bib0094 article-title: An evaluation capacity-building process for sustainable community IT initiatives: Empowering and disempowering impacts publication-title: Evaluation doi: 10.1177/1356389005059382 – ident: 10.1016/j.ejor.2020.05.019_bib0139 – volume: 268 start-page: 1040 issue: 3 year: 2018 ident: 10.1016/j.ejor.2020.05.019_bib0016o article-title: Managing community engagement: A process model for urban planning publication-title: European Journal of Operational Research doi: 10.1016/j.ejor.2017.12.002 – year: 1994 ident: 10.1016/j.ejor.2020.05.019_bib0016k – year: 2012 ident: 10.1016/j.ejor.2020.05.019_bib0164 – volume: 57 start-page: 1435 issue: 12 year: 2006 ident: 10.1016/j.ejor.2020.05.019_bib0021 article-title: Process and content: Two ways of using SSM publication-title: Journal of the Operational Research Society doi: 10.1057/palgrave.jors.2602118 – volume: 58 start-page: 645 year: 2007 ident: 10.1016/j.ejor.2020.05.019_bib0047 article-title: Systemic problem structuring applied to community involvement in water conservation publication-title: Journal of the Operational Research Society doi: 10.1057/palgrave.jors.2602248 – volume: 120 start-page: 55 year: 2008 ident: 10.1016/j.ejor.2020.05.019_bib0163 article-title: Evaluation capacity building in complex organizations publication-title: New Directions for Evaluation doi: 10.1002/ev.276 – volume: 57 start-page: 1064 year: 2006 ident: 10.1016/j.ejor.2020.05.019_bib0016g article-title: Broadening the boundaries: An application of critical systems thinking to IS planning in Colombia publication-title: Journal of the Operational Research Society doi: 10.1057/palgrave.jors.2602081 – volume: 62 start-page: 1543 year: 2011 ident: 10.1016/j.ejor.2020.05.019_bib0119 article-title: The implications of boundary critique for conflict prevention publication-title: Journal of the Operational Research Society doi: 10.1057/jors.2010.76 – year: 2000 ident: 10.1016/j.ejor.2020.05.019_bib0080 – volume: 57 start-page: 868 issue: 7 year: 2006 ident: 10.1016/j.ejor.2020.05.019_bib0082 article-title: Beyond problem structuring methods: Reinventing the future of OR/MS publication-title: Journal of the Operational Research Society doi: 10.1057/palgrave.jors.2602093 – volume: 6 start-page: 179 issue: 2 year: 2000 ident: 10.1016/j.ejor.2020.05.019_bib0016l article-title: Problematizing participation: A critical review of approaches to participation in evaluation theory publication-title: Evaluation doi: 10.1177/13563890022209208 – volume: 32 start-page: 534 issue: 5 year: 2015 ident: 10.1016/j.ejor.2020.05.019_bib0015 article-title: A unifying theory of systems thinking with psychosocial applications publication-title: Systems Research and Behavioral Science doi: 10.1002/sres.2351 – volume: 63 start-page: 407 year: 2001 ident: 10.1016/j.ejor.2020.05.019_bib0004 article-title: A systems approach to the evaluation of natural resource management initiatives publication-title: Journal of Environmental Management doi: 10.1006/jema.2001.0493 – volume: 32 start-page: 138 issue: 2 year: 2009 ident: 10.1016/j.ejor.2020.05.019_bib0096 article-title: Using conceptual models as a planning and evaluation tool in conservation publication-title: Evaluation and Program Planning doi: 10.1016/j.evalprogplan.2008.09.007 – volume: 39 start-page: 715 issue: 8 year: 1988 ident: 10.1016/j.ejor.2020.05.019_bib0078 article-title: Some methodologies for community operational research publication-title: Journal of the Operational Research Society doi: 10.1057/jors.1988.126 – volume: 13 start-page: 61 issue: 1 year: 2000 ident: 10.1016/j.ejor.2020.05.019_bib0027a article-title: Landcare and catchment management in Australia: Lessons for state-sponsored community participation publication-title: Society and Natural Resources doi: 10.1080/089419200279243 – volume: 7 start-page: 673 issue: 6 year: 2000 ident: 10.1016/j.ejor.2020.05.019_bib0016q article-title: Variety is the spice of life: Combining soft and hard OR/MS methods publication-title: International Transactions in Operational Research doi: 10.1111/j.1475-3995.2000.tb00224.x – volume: 2 start-page: 109 year: 1971 ident: 10.1016/j.ejor.2020.05.019_bib0048 article-title: Counterintuitive behaviour of social systems publication-title: Theory and Decision doi: 10.1007/BF00148991 – year: 2004 ident: 10.1016/j.ejor.2020.05.019_bib0118 article-title: An introduction to community OR – year: 1999 ident: 10.1016/j.ejor.2020.05.019_bib0020y – volume: 14 start-page: 133 issue: 1 year: 2001 ident: 10.1016/j.ejor.2020.05.019_bib0036 article-title: Expansive learning at work: Toward an activity theoretical reconceptualization publication-title: Journal of Education and Work doi: 10.1080/13639080020028747 – volume: 62 start-page: 150 year: 2017 ident: 10.1016/j.ejor.2020.05.019_bib0116 article-title: Dealing with challenges to methodological pluralism: The paradigm problem, psychological resistance and cultural barriers publication-title: Industrial Marketing Management doi: 10.1016/j.indmarman.2016.08.008 – volume: 28 start-page: 537 issue: 5 year: 2011 ident: 10.1016/j.ejor.2020.05.019_bib0016c article-title: Towards a framework for multiparadigm multimethodologies publication-title: Systems Research and Behavioral Science doi: 10.1002/sres.1120 – year: 1990 ident: 10.1016/j.ejor.2020.05.019_bib0160 – volume: 9 start-page: 17 year: 1982 ident: 10.1016/j.ejor.2020.05.019_bib0074 article-title: The nature of soft systems thinking: The work of Churchman, Ackoff and Checkland publication-title: Journal of Applied Systems Analysis – volume: 27 start-page: 131 issue: 2 year: 2006 ident: 10.1016/j.ejor.2020.05.019_bib0093 article-title: Open for innovation: The role of openness in explaining innovation performance among U.K. manufacturing firms publication-title: Strategic Management Journal doi: 10.1002/smj.507 – volume: 268 start-page: 971 issue: 3 year: 2018 ident: 10.1016/j.ejor.2020.05.019_bib0149 article-title: Reflections on a multi-layered intervention in the South African public education system: Some ethical implications for community operational research publication-title: European Journal of Operational Research doi: 10.1016/j.ejor.2017.02.022 – year: 1996 ident: 10.1016/j.ejor.2020.05.019_bib0016v article-title: The ideal of unity and the practice of pluralism in systems science – year: 1989 ident: 10.1016/j.ejor.2020.05.019_bib0104 article-title: Critical systems: The theory and practice of partitioning methodologies – volume: 31 start-page: 299 issue: 3 year: 2008 ident: 10.1016/j.ejor.2020.05.019_bib01016 article-title: Systems thinking publication-title: Evaluation and Program Planning doi: 10.1016/j.evalprogplan.2007.12.001 – year: 1999 ident: 10.1016/j.ejor.2020.05.019_bib0157 – volume: 13 start-page: 11 issue: 1 year: 2000 ident: 10.1016/j.ejor.2020.05.019_bib0058 article-title: Knowing wuli, sensing shili, caring for renli: Methodology of the WSR approach publication-title: Systemic Practice and Action Research doi: 10.1023/A:1009567421256 – volume: 268 start-page: 1134 issue: 3 year: 2018 ident: 10.1016/j.ejor.2020.05.019_bib0017b article-title: Systemic lean intervention: Enhancing lean with community operational research publication-title: European Journal of Operational Research doi: 10.1016/j.ejor.2017.08.004 – volume: 6 start-page: 583 year: 1993 ident: 10.1016/j.ejor.2020.05.019_bib0165 article-title: Some difficulties of ecological thinking, considered from a critical systems perspective: A plea for critical holism publication-title: Systems Practice doi: 10.1007/BF01059480 – year: 2006 ident: 10.1016/j.ejor.2020.05.019_bib0092 – year: 2010 ident: 10.1016/j.ejor.2020.05.019_bib0130 – volume: 60 start-page: 112 year: 2017 ident: 10.1016/j.ejor.2020.05.019_bib0031 article-title: Failing better: The stochastic art of evaluating community-led environmental action programs publication-title: Evaluation and Program Planning doi: 10.1016/j.evalprogplan.2016.11.005 – volume: 137 start-page: 137 year: 2014 ident: 10.1016/j.ejor.2020.05.019_bib0034 article-title: Assessing participatory practices in community-based natural resource management: Experiences in community engagement from southern Africa publication-title: Journal of Environmental Management doi: 10.1016/j.jenvman.2013.11.057 – volume: 18 start-page: 101 year: 1996 ident: 10.1016/j.ejor.2020.05.019_bib0125 article-title: Multimethodology: Towards a framework for critical pluralism publication-title: Systemist – volume: 36 start-page: 1 issue: 1 year: 2008 ident: 10.1016/j.ejor.2020.05.019_bib0167 article-title: Service-dominant logic: Continuing the evolution publication-title: Journal of the Academy of Marketing Science doi: 10.1007/s11747-007-0069-6 – volume: 268 start-page: 865 issue: 3 year: 2018 ident: 10.1016/j.ejor.2020.05.019_bib0013 article-title: Deepening and scaling participatory research with the poorest and most marginalised publication-title: European Journal of Operational Research doi: 10.1016/j.ejor.2017.11.025 – year: 2000 ident: 10.1016/j.ejor.2020.05.019_bib0108 – volume: 33 start-page: 662 issue: 5 year: 2016 ident: 10.1016/j.ejor.2020.05.019_bib0144 article-title: Towards systemic evaluation publication-title: Systems Research and Behavioral Science doi: 10.1002/sres.2423 – volume: 43 start-page: 960 year: 2000 ident: 10.1016/j.ejor.2020.05.019_bib0035 article-title: Activity theory as a framework for analysing and redesigning work publication-title: Ergonomics doi: 10.1080/001401300409143 – volume: 24 start-page: 153 issue: 2 year: 2018 ident: 10.1016/j.ejor.2020.05.019_bib0011 article-title: Theory-based evaluations: Framing the existence of a new theory in evaluation and the rise of the 5th generation publication-title: Evaluation doi: 10.1177/1356389018765487 – year: 1991 ident: 10.1016/j.ejor.2020.05.019_bib0043 – volume: 268 start-page: 996 year: 2018 ident: 10.1016/j.ejor.2020.05.019_bib0010 article-title: Processes of engagement and methodology design in community operational research: Insights from the indigenous peoples sector publication-title: European Journal of Operational Research doi: 10.1016/j.ejor.2017.07.053 – volume: 32 start-page: 50 issue: 1 year: 2015 ident: 10.1016/j.ejor.2020.05.019_bib0009 article-title: A complexity-informed approach to evaluating national knowledge and innovation programmes publication-title: Systems Research and Behavioral Science doi: 10.1002/sres.2205 – year: 1997 ident: 10.1016/j.ejor.2020.05.019_bib0016y – volume: 13 start-page: 111 issue: 1 year: 2000 ident: 10.1016/j.ejor.2020.05.019_bib0169 article-title: Meta-decision making: Concepts and paradigm publication-title: Systemic Practice and Action Research doi: 10.1023/A:1009527707143 – volume: 20 start-page: 167 year: 2007 ident: 10.1016/j.ejor.2020.05.019_bib0154 article-title: Toward a Buddhist systems methodology 1: Comparisons between Buddhism and systems theory publication-title: Systemic Practice and Action Research doi: 10.1007/s11213-006-9058-9 – volume: 32 start-page: 453 issue: 4 year: 2001 ident: 10.1016/j.ejor.2020.05.019_bib0057 article-title: Critical facilitation: Learning through intervention in group processes publication-title: Management Learning doi: 10.1177/1350507601324003 – volume: 33 start-page: 60 issue: 1 year: 2012 ident: 10.1016/j.ejor.2020.05.019_bib0151 article-title: Dealing with complex causality in realist synthesis: The promise of qualitative comparative analysis publication-title: American Journal of Evaluation doi: 10.1177/1098214011411574 – year: 2001 ident: 10.1016/j.ejor.2020.05.019_bib0150 – volume: 20 start-page: 195 year: 2007 ident: 10.1016/j.ejor.2020.05.019_bib0124 article-title: Toward a Buddhist systems methodology 2: An exploratory, questioning approach publication-title: Systemic Practice and Action Research doi: 10.1007/s11213-006-9059-8 – volume: 283 start-page: 321 year: 2020 ident: 10.1016/j.ejor.2020.05.019_bib0051 article-title: Stakeholder identification and engagement in problem structuring interventions publication-title: European Journal of Operational Research doi: 10.1016/j.ejor.2019.10.044 – year: 2016 ident: 10.1016/j.ejor.2020.05.019_bib0016x article-title: Moving beyond value conflicts: Systemic problem structuring in action – year: 1990 ident: 10.1016/j.ejor.2020.05.019_bib0042 – volume: 4 start-page: 82 issue: 2 year: 1995 ident: 10.1016/j.ejor.2020.05.019_bib0162 article-title: National culture and group support systems: Filtering communication to dampen power differentials publication-title: European Journal of Information Systems doi: 10.1057/ejis.1995.10 – year: 2002 ident: 10.1016/j.ejor.2020.05.019_bib0121 article-title: Operational research and environmental management: A new agenda – volume: 10 start-page: 305 year: 1997 ident: 10.1016/j.ejor.2020.05.019_bib0106 article-title: Developing the methodology of TSI: From the oblique use of methods to creative design publication-title: Systems Practice doi: 10.1007/BF02557900 – volume: 63 start-page: 269 year: 2001 ident: 10.1016/j.ejor.2020.05.019_bib0088 article-title: Towards participatory environmental management? publication-title: Journal of Environmental Management doi: 10.1006/jema.2001.0478 – volume: 35 start-page: 473 year: 1984 ident: 10.1016/j.ejor.2020.05.019_bib0084 article-title: Towards a system of systems methodologies publication-title: Journal of the Operational Research Society doi: 10.1057/jors.1984.101 – volume: 268 start-page: 852 issue: 3 year: 2018 ident: 10.1016/j.ejor.2020.05.019_bib0063 article-title: Operationalising systemic resilience publication-title: European Journal of Operational Research doi: 10.1016/j.ejor.2017.11.056 – volume: 154 start-page: 4 year: 2016 ident: 10.1016/j.ejor.2020.05.019_bib0062 article-title: Why is an APT approach to wicked problems important? publication-title: Landscape and Urban Planning doi: 10.1016/j.landurbplan.2016.03.018 – year: 2008 ident: 10.1016/j.ejor.2020.05.019_bib0087 – year: 2000 ident: 10.1016/j.ejor.2020.05.019_bib0103 article-title: Environmental planning and management: The broad context – volume: 231 start-page: 720 year: 2013 ident: 10.1016/j.ejor.2020.05.019_bib0016j article-title: Rethinking soft OR interventions: Models as boundary objects publication-title: European Journal of Operational Research doi: 10.1016/j.ejor.2013.06.033 |
| SSID | ssj0001515 |
| Score | 2.4736352 |
| Snippet | •Community environmental management programmes are about community engagement.•The relationship between community engagement and environmental outcomes is... Community environmental management (CEM) involves the facilitation of community partnerships, local dialogue, consultation and participative decision-making.... |
| SourceID | swepub crossref elsevier |
| SourceType | Open Access Repository Enrichment Source Index Database Publisher |
| StartPage | 207 |
| SubjectTerms | Community environmental management Community operational research Informatik Information Systems Problem structuring methods Systemic evaluation Systems thinking |
| Title | Systemic evaluation of community environmental management programmes |
| URI | https://dx.doi.org/10.1016/j.ejor.2020.05.019 https://urn.kb.se/resolve?urn=urn:nbn:se:lnu:diva-98261 https://urn.kb.se/resolve?urn=urn:nbn:se:mdh:diva-50212 |
| Volume | 288 |
| WOSCitedRecordID | wos000564504000015&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| journalDatabaseRights | – providerCode: PRVESC databaseName: Elsevier SD Freedom Collection Journals 2021 customDbUrl: eissn: 1872-6860 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0001515 issn: 0377-2217 databaseCode: AIEXJ dateStart: 19950105 isFulltext: true titleUrlDefault: https://www.sciencedirect.com providerName: Elsevier |
| link | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwtV3Nb9MwFLegQwgOfBQQg4FygBNylThp7Bwrug8mmDgM1JuVuPaaaiRV1qL9-TzHH0kZG-PAJaoiu6n8frHfe32_30PoHQRrKpNxjqWiCicxSzCDgTiURM5zKtJctJL5n-nJCZvNsq-2rPmibSdAq4pdXmar_2pquAfG1tTZfzC3_1K4AZ_B6HAFs8P1VoY3GuSl6Al529pxzQQBn7vHbdPUEV__4mq1HCfkT_l667vCjcZlEa1c0KI7z2rTcu945K1Zzs9sbvywzYF5mC02TdmUeApbjUZku1P5aUdy1dYafBn1cxOG6uzYWJRiQgwv0-20hLErkLL7pml9e2U_N6mF5Uguay3eSkIjs5p1p9eWTva0_D7hdXPGf8wXfKzV6--iHUIhaBqgncmn_dmxP6W1I9f-w2R_pw7MGSU4ZWloyVWmDvD3R1_rwPSVZlvv5PQJemTDimBi4PAU3ZHVEN13rIYheuy6dwR2Mx-ihz0pymdo6mATdLAJahV42ARbsAk62AQdbJ6jbwf7px-PsO2wgQU4omsMwYCK8jQvIMgXmkymGCniiAh4U-NxXGSh1kZSmg8mdPfGNBKKZSqNlMiokCp-gQZVXcmXKKCCJXCIE3Afw6SQEsIOGsdJPpcwLUmKXRS5ZePCys_rLijn3NUZLrleaq6XmodjDku9iz74OSsjvnLj6LGzBrfuo3ELOaDpxnnvjen8M7agdF5teAZBePSXcR5yr2457jV6oN8Zk8_bQ4N1s5Fv0D3xc11eNG8tXn8B426v0A |
| linkProvider | Elsevier |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Systemic+evaluation+of+community+environmental+management+programmes&rft.jtitle=European+journal+of+operational+research&rft.au=Foote%2C+J.&rft.au=Midgley%2C+Gerald&rft.au=Ahuriri-Driscoll%2C+A.&rft.au=Hepi%2C+M.&rft.date=2021&rft.issn=0377-2217&rft.volume=288&rft.issue=1&rft.spage=207&rft_id=info:doi/10.1016%2Fj.ejor.2020.05.019&rft.externalDocID=oai_DiVA_org_mdh_50212 |
| thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=0377-2217&client=summon |
| thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=0377-2217&client=summon |
| thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=0377-2217&client=summon |