A multilevel and multistage efficiency evaluation of innovation systems: A multiobjective DEA approach

•A framework for estimating national and regional innovation efficiency is presented•The proposed DEA-based model is formulated as a multiobjective mathematical program•Multiple objectives refer to different stages and hierarchies of innovation systems•Ordinal regression analysis examines the influe...

Ausführliche Beschreibung

Gespeichert in:

Bibliographische Detailangaben
Veröffentlicht in:	Expert systems with applications Jg. 62; S. 63 - 80
Hauptverfasser:	Carayannis, Elias G., Grigoroudis, Evangelos, Goletsis, Yorgos
Format:	Journal Article
Sprache:	Englisch
Veröffentlicht:	Elsevier Ltd 15.11.2016
Schlagworte:	Computational efficiency Computing time Data envelopment analysis Dynamical systems Dynamics Innovation Innovation systems Mathematical analysis Mathematical models Multilevel efficiency Multiobjective programming Multistage efficiency Ordinal regression analysis Policies Multistage efficiency Innovation systems Ordinal regression analysis Multilevel efficiency Multiobjective programming Data envelopment analysis
ISSN:	0957-4174, 1873-6793
Online-Zugang:	Volltext
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!

Abstract	•A framework for estimating national and regional innovation efficiency is presented•The proposed DEA-based model is formulated as a multiobjective mathematical program•Multiple objectives refer to different stages and hierarchies of innovation systems•Ordinal regression analysis examines the influence of additional variables•Efficiency results show significant differences across countries and regions Evaluating the efficiency of innovation systems can serve as a substantial enabling tool for policymaking serving to identify best practices and develop potential improvements of actions and strategies. It also serves to provide valuable insight in understanding the nature and dynamics of innovation process at its different stages and levels. The main aim of the paper is to present an integrated assessment and classification framework for national and regional innovation efficiency. The proposed model is based on Data Envelopment Analysis and is formulated as a multiobjective mathematical program in order to consider the objectives and constraints of the different stages and levels of the innovation process. Additionally, the model copes with DEA inconsistencies when ratio measures are employed. In the second part of the study, a multicriteria decision aid approach, based on an ordinal regression model, is applied in order to study how environmental factors on innovation and entrepreneurship affect the estimated efficiency scores. The proposed approach is applied to a set of 23 European countries and their 185 corresponding regions. The results show that there are large differences regarding the efficiency scores of the different stages and levels, implying the existence of significant divergences from the expected norm concerning innovation efficiency. The contribution of the paper lies (i) in the proposed multiobjective model, which is able to model the multiple stages and levels of the innovation process and handle ratio measures without requiring the same set of inputs and outputs at different levels and (ii) in the presented application of the model in the efficiency evaluation of innovation systems, including a meta-analysis of the results based on the framework of the Quadruple Innovation Helix. Such an approach may provide a valuable tool for country/region comparison and policy formulation.
AbstractList	Evaluating the efficiency of innovation systems can serve as a substantial enabling tool for policymaking serving to identify best practices and develop potential improvements of actions and strategies. It also serves to provide valuable insight in understanding the nature and dynamics of innovation process at its different stages and levels. The main aim of the paper is to present an integrated assessment and classification framework for national and regional innovation efficiency. The proposed model is based on Data Envelopment Analysis and is formulated as a multiobjective mathematical program in order to consider the objectives and constraints of the different stages and levels of the innovation process. Additionally, the model copes with DEA inconsistencies when ratio measures are employed. In the second part of the study, a multicriteria decision aid approach, based on an ordinal regression model, is applied in order to study how environmental factors on innovation and entrepreneurship affect the estimated efficiency scores. The proposed approach is applied to a set of 23 European countries and their 185 corresponding regions. The results show that there are large differences regarding the efficiency scores of the different stages and levels, implying the existence of significant divergences from the expected norm concerning innovation efficiency. The contribution of the paper lies (i) in the proposed multiobjective model, which is able to model the multiple stages and levels of the innovation process and handle ratio measures without requiring the same set of inputs and outputs at different levels and (ii) in the presented application of the model in the efficiency evaluation of innovation systems, including a meta-analysis of the results based on the framework of the Quadruple Innovation Helix. Such an approach may provide a valuable tool for country/region comparison and policy formulation. •A framework for estimating national and regional innovation efficiency is presented•The proposed DEA-based model is formulated as a multiobjective mathematical program•Multiple objectives refer to different stages and hierarchies of innovation systems•Ordinal regression analysis examines the influence of additional variables•Efficiency results show significant differences across countries and regions Evaluating the efficiency of innovation systems can serve as a substantial enabling tool for policymaking serving to identify best practices and develop potential improvements of actions and strategies. It also serves to provide valuable insight in understanding the nature and dynamics of innovation process at its different stages and levels. The main aim of the paper is to present an integrated assessment and classification framework for national and regional innovation efficiency. The proposed model is based on Data Envelopment Analysis and is formulated as a multiobjective mathematical program in order to consider the objectives and constraints of the different stages and levels of the innovation process. Additionally, the model copes with DEA inconsistencies when ratio measures are employed. In the second part of the study, a multicriteria decision aid approach, based on an ordinal regression model, is applied in order to study how environmental factors on innovation and entrepreneurship affect the estimated efficiency scores. The proposed approach is applied to a set of 23 European countries and their 185 corresponding regions. The results show that there are large differences regarding the efficiency scores of the different stages and levels, implying the existence of significant divergences from the expected norm concerning innovation efficiency. The contribution of the paper lies (i) in the proposed multiobjective model, which is able to model the multiple stages and levels of the innovation process and handle ratio measures without requiring the same set of inputs and outputs at different levels and (ii) in the presented application of the model in the efficiency evaluation of innovation systems, including a meta-analysis of the results based on the framework of the Quadruple Innovation Helix. Such an approach may provide a valuable tool for country/region comparison and policy formulation.
Author	Grigoroudis, Evangelos Goletsis, Yorgos Carayannis, Elias G.
Author_xml	– sequence: 1 givenname: Elias G. surname: Carayannis fullname: Carayannis, Elias G. email: caraye@gwu.edu organization: The George Washington University, Washington, DC 20052, USA – sequence: 2 givenname: Evangelos orcidid: 0000-0001-8613-9350 surname: Grigoroudis fullname: Grigoroudis, Evangelos email: vangelis@ergasya.tuc.gr organization: Technical University of Crete, School of Production Engineering and Management, Chania, GR73100, Greece – sequence: 3 givenname: Yorgos surname: Goletsis fullname: Goletsis, Yorgos email: goletsis@cc.uoi.gr organization: University of Ioannina, Department of Economics, GR45110, Ioannina, Greece
BookMark	eNp9kE1LAzEQhoNUsK3-AU85etmaNJtNVrwUv6HgRc8hnZ1oynZTN-lK_71b15OHwsDMwPtMyDMhoyY0SMglZzPOeHG9nmH8trN5P89YX1ydkDHXSmSFKsWIjFkpVZZzlZ-RSYxr1icYU2PiFnSzq5OvscOa2qYa1pjsB1J0zoPHBvYUO1vvbPKhocFR3zShG7a4jwk38Yb-HQqrNULyHdL7hwW1220bLHyek1Nn64gXf31K3h8f3u6es-Xr08vdYpmBUEXKtIVyXkgpcl3BvOBQQamkgpWW0iEAVJpVGsoCc5DghNQWHbOWV6tc8HwlpuRquNs_-7XDmMzGR8C6tg2GXTRcC1kILZjqo_MhCm2IsUVntq3f2HZvODMHqWZtDlLNQaphffEDpP9B4NOviNRaXx9HbwcU-_93HlsTf91i5dvemKmCP4b_AP32l4c
CitedBy_id	crossref_primary_10_1016_j_egyr_2023_01_010 crossref_primary_10_1007_s13201_022_01626_2 crossref_primary_10_1016_j_eswa_2016_12_015 crossref_primary_10_1080_00472778_2024_2363845 crossref_primary_10_1080_0144929X_2019_1584645 crossref_primary_10_4018_IJSI_301218 crossref_primary_10_1007_s13132_021_00722_z crossref_primary_10_1080_09537325_2022_2157254 crossref_primary_10_3390_ijerph15091983 crossref_primary_10_1057_s41599_025_04614_4 crossref_primary_10_1007_s13132_022_00991_2 crossref_primary_10_1007_s00191_023_00829_3 crossref_primary_10_3390_math9243318 crossref_primary_10_1108_MD_04_2025_340 crossref_primary_10_3390_su141912739 crossref_primary_10_1016_j_eiar_2022_106762 crossref_primary_10_1016_j_cor_2018_02_001 crossref_primary_10_3233_JIFS_17931 crossref_primary_10_1007_s13132_016_0426_0 crossref_primary_10_1016_j_igd_2023_100096 crossref_primary_10_1016_j_techfore_2023_122585 crossref_primary_10_1080_08276331_2019_1643134 crossref_primary_10_1016_j_iedeen_2022_100201 crossref_primary_10_1108_IJIS_07_2021_0118 crossref_primary_10_1007_s00168_025_01416_z crossref_primary_10_1007_s11356_022_21431_3 crossref_primary_10_3390_en15218245 crossref_primary_10_1007_s13762_017_1296_0 crossref_primary_10_3233_JIFS_182943 crossref_primary_10_1007_s11269_020_02727_w crossref_primary_10_1051_e3sconf_202129501051 crossref_primary_10_1007_s11356_022_24494_4 crossref_primary_10_1016_j_ejor_2020_02_023 crossref_primary_10_1007_s13160_023_00608_4 crossref_primary_10_1007_s10479_021_04427_z crossref_primary_10_3390_risks10010006 crossref_primary_10_3390_economies11060163 crossref_primary_10_1080_17509653_2016_1249425 crossref_primary_10_1002_sd_2875 crossref_primary_10_3390_su9091574 crossref_primary_10_1007_s13132_020_00699_1 crossref_primary_10_1016_j_seps_2020_100855 crossref_primary_10_1080_09654313_2019_1680611 crossref_primary_10_1016_j_enconman_2016_12_019 crossref_primary_10_1016_j_ejor_2021_10_030 crossref_primary_10_3390_math10193615 crossref_primary_10_1016_j_techfore_2023_122607 crossref_primary_10_3390_su11195460 crossref_primary_10_1016_j_cie_2019_04_041 crossref_primary_10_3390_joitmc7010062 crossref_primary_10_1080_09537325_2018_1473849 crossref_primary_10_1080_17421772_2020_1701701 crossref_primary_10_1093_scipol_scz005 crossref_primary_10_1016_j_eap_2024_10_038 crossref_primary_10_1007_s10961_024_10174_7 crossref_primary_10_1007_s13132_020_00661_1 crossref_primary_10_3390_su15086695 crossref_primary_10_3390_su14020797 crossref_primary_10_1080_09537325_2023_2238313 crossref_primary_10_1016_j_heliyon_2022_e10168 crossref_primary_10_3390_su17136229 crossref_primary_10_1016_j_techsoc_2022_102172 crossref_primary_10_1016_j_ejor_2020_04_052 crossref_primary_10_3390_su12010031 crossref_primary_10_1111_radm_12300 crossref_primary_10_1111_radm_12662 crossref_primary_10_1093_scipol_scad043 crossref_primary_10_1108_JSTPM_03_2021_0044 crossref_primary_10_1007_s10098_023_02560_w crossref_primary_10_1093_scipol_scab023 crossref_primary_10_1155_2022_1239890 crossref_primary_10_1080_09537325_2024_2389140 crossref_primary_10_1109_TEM_2021_3128192 crossref_primary_10_3390_su14073903 crossref_primary_10_1016_j_heliyon_2022_e11925 crossref_primary_10_1108_IJESM_10_2020_0016 crossref_primary_10_3390_systems10020023 crossref_primary_10_1016_j_seps_2021_101177 crossref_primary_10_1109_TEM_2023_3310198 crossref_primary_10_18778_1508_2008_26_01 crossref_primary_10_1080_00128775_2023_2167722 crossref_primary_10_1016_j_compchemeng_2020_106761 crossref_primary_10_1007_s10479_019_03404_x crossref_primary_10_1016_j_ejor_2018_08_044 crossref_primary_10_1016_j_jclepro_2020_124603 crossref_primary_10_1016_j_joi_2020_101049 crossref_primary_10_1007_s10961_019_09735_y crossref_primary_10_1155_2020_8094247 crossref_primary_10_1186_s13731_021_00159_3 crossref_primary_10_1016_j_eswa_2023_122338 crossref_primary_10_3390_su13137220 crossref_primary_10_3390_systems11070338 crossref_primary_10_1007_s11024_021_09453_6 crossref_primary_10_1007_s40092_018_0258_6 crossref_primary_10_1007_s11573_018_0902_z crossref_primary_10_1155_2020_2906293 crossref_primary_10_1016_j_techfore_2017_03_008 crossref_primary_10_1016_j_jclepro_2025_146328 crossref_primary_10_1371_journal_pone_0274875 crossref_primary_10_1108_IJIS_11_2022_0230 crossref_primary_10_1007_s10729_023_09661_4 crossref_primary_10_1016_j_eswa_2019_113137 crossref_primary_10_3390_su16166908 crossref_primary_10_1007_s10961_022_09963_9 crossref_primary_10_1016_j_seps_2019_02_005 crossref_primary_10_3846_ijspm_2025_23234 crossref_primary_10_1080_03155986_2022_2104573 crossref_primary_10_1108_MD_05_2022_0567 crossref_primary_10_1155_2021_9946098 crossref_primary_10_3390_electronics13245001 crossref_primary_10_1002_mde_3150 crossref_primary_10_3390_su12187509 crossref_primary_10_1016_j_cam_2019_112597 crossref_primary_10_1016_j_eswa_2022_118393 crossref_primary_10_1109_TEM_2025_3592861 crossref_primary_10_1007_s13132_023_01728_5 crossref_primary_10_1007_s12063_022_00280_w crossref_primary_10_1016_j_techfore_2021_120787 crossref_primary_10_1016_j_eswa_2023_121109 crossref_primary_10_3390_math12060884 crossref_primary_10_1016_j_jclepro_2022_134549 crossref_primary_10_1016_j_jclepro_2020_120108 crossref_primary_10_1080_1331677X_2022_2120043 crossref_primary_10_1155_2022_9822339
Cites_doi	10.1016/S0305-0548(03)00095-9 10.1016/j.technovation.2013.03.013 10.1111/j.1467-9957.2012.02286.x 10.1016/j.respol.2008.07.003 10.1023/A:1018977111455 10.1016/j.eswa.2010.06.024 10.1504/IJIRD.2008.016861 10.3390/su7055120 10.1016/S0377-2217(00)00035-7 10.1016/S0038-0121(99)00012-9 10.1016/j.ejor.2006.11.041 10.1016/S0048-7333(01)00152-4 10.1016/j.sbspro.2012.09.1057 10.1016/j.sbspro.2012.09.165 10.1016/j.eswa.2015.10.032 10.1504/IJTM.2009.023374 10.1016/j.omega.2012.06.003 10.1016/j.eswa.2012.04.005 10.1023/A:1018625424184 10.1093/oep/gpr015 10.1016/S0048-7333(99)00055-4 10.1080/00343400802251494 10.1016/S0038-0121(02)00046-0 10.1007/BF02459261 10.1111/j.1460-8545.2004.00101.x 10.1016/j.cor.2003.08.019 10.1080/02692171.2014.896880 10.1016/j.respol.2011.07.001 10.1504/IJSSOC.2010.030564 10.1016/j.ejor.2014.02.039 10.1016/j.eswa.2015.12.022 10.1016/j.measurement.2013.11.043 10.1023/A:1026402922367 10.1007/s00168-014-0604-6 10.1007/s11192-007-1896-4 10.1080/00343400601120270 10.1016/j.eswa.2013.01.052 10.1142/S0217595910002752 10.1111/radm.12067 10.1287/mnsc.45.9.1270 10.1080/00343404.2010.497479 10.5172/impp.2011.13.3.341 10.1016/j.respol.2013.03.012 10.1016/j.eswa.2014.02.014 10.1016/j.ejor.2015.03.013 10.1007/s12351-015-0176-y 10.1016/S0166-4972(01)00047-5 10.1016/0377-2217(82)90155-2 10.1016/j.asoc.2014.06.057 10.1016/j.respol.2006.11.004 10.1016/j.apm.2007.11.018 10.1016/S0377-2217(03)00182-6 10.1016/0167-6377(84)90057-9
ContentType	Journal Article
Copyright	2016 Elsevier Ltd
Copyright_xml	– notice: 2016 Elsevier Ltd
DBID	AAYXX CITATION 7SC 8FD JQ2 L7M L~C L~D
DOI	10.1016/j.eswa.2016.06.017
DatabaseName	CrossRef Computer and Information Systems Abstracts Technology Research Database ProQuest Computer Science Collection Advanced Technologies Database with Aerospace Computer and Information Systems Abstracts Academic Computer and Information Systems Abstracts Professional
DatabaseTitle	CrossRef Computer and Information Systems Abstracts Technology Research Database Computer and Information Systems Abstracts – Academic Advanced Technologies Database with Aerospace ProQuest Computer Science Collection Computer and Information Systems Abstracts Professional
DatabaseTitleList	Computer and Information Systems Abstracts
DeliveryMethod	fulltext_linktorsrc
Discipline	Computer Science
EISSN	1873-6793
EndPage	80
ExternalDocumentID	10_1016_j_eswa_2016_06_017 S0957417416302974
GroupedDBID	--K --M .DC .~1 0R~ 13V 1B1 1RT 1~. 1~5 4.4 457 4G. 5GY 5VS 7-5 71M 8P~ 9JN 9JO AAAKF AABNK AACTN AAEDT AAEDW AAIAV AAIKJ AAKOC AALRI AAOAW AAQFI AARIN AAXUO AAYFN ABBOA ABFNM ABMAC ABMVD ABUCO ABYKQ ACDAQ ACGFS ACHRH ACNTT ACRLP ACZNC ADBBV ADEZE ADTZH AEBSH AECPX AEKER AENEX AFKWA AFTJW AGHFR AGJBL AGUBO AGUMN AGYEJ AHHHB AHJVU AHZHX AIALX AIEXJ AIKHN AITUG AJBFU AJOXV ALEQD ALMA_UNASSIGNED_HOLDINGS AMFUW AMRAJ AOUOD APLSM AXJTR BJAXD BKOJK BLXMC BNSAS CS3 DU5 EBS EFJIC EFLBG EJD EO8 EO9 EP2 EP3 F5P FDB FIRID FNPLU FYGXN G-Q GBLVA GBOLZ HAMUX IHE J1W JJJVA KOM LG9 LY1 LY7 M41 MO0 N9A O-L O9- OAUVE OZT P-8 P-9 P2P PC. PQQKQ Q38 RIG ROL RPZ SDF SDG SDP SDS SES SPC SPCBC SSB SSD SSL SST SSV SSZ T5K TN5 ~G- 29G 9DU AAAKG AAQXK AATTM AAXKI AAYWO AAYXX ABJNI ABKBG ABUFD ABWVN ABXDB ACLOT ACNNM ACRPL ACVFH ADCNI ADJOM ADMUD ADNMO AEIPS AEUPX AFJKZ AFPUW AGQPQ AIGII AIIUN AKBMS AKRWK AKYEP ANKPU APXCP ASPBG AVWKF AZFZN CITATION EFKBS FEDTE FGOYB G-2 HLZ HVGLF HZ~ R2- SBC SET SEW WUQ XPP ZMT ~HD 7SC 8FD JQ2 L7M L~C L~D
ID	FETCH-LOGICAL-c376t-8ac92655348dc261cdc9757cb855fecccd80d8c96e4c5cf358aef0aa1db4314b3
ISICitedReferencesCount	130
ISICitedReferencesURI	http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000380626000005&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
ISSN	0957-4174
IngestDate	Wed Oct 01 10:07:42 EDT 2025 Tue Nov 18 20:42:36 EST 2025 Sat Nov 29 04:44:46 EST 2025 Fri Feb 23 02:29:04 EST 2024
IsPeerReviewed	true
IsScholarly	true
Keywords	Multistage efficiency Innovation systems Ordinal regression analysis Multilevel efficiency Multiobjective programming Data envelopment analysis
Language	English
LinkModel	OpenURL
MergedId	FETCHMERGED-LOGICAL-c376t-8ac92655348dc261cdc9757cb855fecccd80d8c96e4c5cf358aef0aa1db4314b3
Notes	ObjectType-Article-1 SourceType-Scholarly Journals-1 ObjectType-Feature-2 content type line 23
ORCID	0000-0001-8613-9350
PQID	1835638307
PQPubID	23500
PageCount	18
ParticipantIDs	proquest_miscellaneous_1835638307 crossref_primary_10_1016_j_eswa_2016_06_017 crossref_citationtrail_10_1016_j_eswa_2016_06_017 elsevier_sciencedirect_doi_10_1016_j_eswa_2016_06_017
PublicationCentury	2000
PublicationDate	2016-11-15
PublicationDateYYYYMMDD	2016-11-15
PublicationDate_xml	– month: 11 year: 2016 text: 2016-11-15 day: 15
PublicationDecade	2010
PublicationTitle	Expert systems with applications
PublicationYear	2016
Publisher	Elsevier Ltd
Publisher_xml	– name: Elsevier Ltd
References	Chun, Woo, Seo, Ko (bib0019) 2015; 7 Matei, Aldea (bib0050) 2012; 62 Chilingerian, Sherman (bib0017) 2011; 164 Shyu, Chiang (bib0062) 2012; 39 Carayannis, Goletsis, Grigoroudis (bib0011) 2015; 15 Kou, Chen, Wang, Shao (bib0045) 2016; 46 Färe, Grosskopf (bib0030) 2000; 34 Mahroum, Al-Saleh (bib0049) 2013; 33 Kao (bib0041) 2014; 239 Emrouznejad, Amin (bib0027) 2009; 33 Pittaway, Robertson, Munir, Denyer, Neely (bib0057) 2004; 5-6 Cook, Chai, Doyle, Green (bib0021) 1998; 10 Lewis, Sexton (bib0046) 2004; 31 Etzkowitz, Leydesdorff (bib0028) 2000; 29 Charron, N. (2013). The european quality of government index: Summary of 2013 data, sensitivity analysis and final results, available at Siskos, Yannacopoulos (bib0063) 1985; 5 Zabala-Iturriagagoitia, Voigt, Gutierrez-Gracia, Jimenez-Saez (bib0070) 2007; 41 Ebrahimnejad, Tavana, Lotfi, Shahverdi, Yousefpour (bib0025) 2014; 49 Furman, Porter, Stern (bib0032) 2002; 31 Zhang (bib0071) 2013; 30 Kaihua, Mingting (bib0040) 2014; 52 Rousseau, Rousseau (bib0058) 1997; 40 . Afzal (bib0001) 2014; 28 Cruz-Cázares, Bayona-Sáez, García-Marco (bib0022) 2013; 42 Cullmann, Schmidt-Ehmcke, Zloczysti (bib0023) 2011; 64 Cai (bib0005) 2011 Cook, Green (bib0020) 2005; 32 Hollanders, Celikel-Esser (bib0036) 2007 Nasierowski, Arcelus (bib0053) 2003; 37 Pan, Hung, Lu (bib0056) 2010; 27 Wang, Huang (bib0067) 2007; 36 Choi, Sang-Hyun, Cha (bib0018) 2013; 40 Färe, Primont (bib0029) 1984; 3 Cai, Hanley (bib0006) 2012 Bosco, Brugnoli (bib0003) 2010 Broekel, Rogge, Brenner (bib0004) 2013 Fritsch, Slavtchev (bib0031) 2011; 45 Garcia, Chavez (bib0033) 2014; 41 Kao, Chan, Wu (bib0043) 2014; 24 Wang, Gopal, Zionts (bib0066) 1997; 73 Murro (bib0052) 2012; 81 Liu, Lu, Ho (bib0047) 2015; 45 Cummins, Zi (bib0024) 1998; 10 Jacquet-Lagrèze, Siskos (bib0038) 1982; 10 Schumpeter (bib0059) 1934 Guan, Chen (bib0035) 2012; 41 Jacquet-Lagrèze, Siskos (bib0039) 2001; 130 Wang, Chin (bib0068) 2010; 37 Carayannis, Alexander (bib0007) 2002; 22 Castelli, Pesenti, Ukovich (bib0013) 2004; 154 Kotsemir (bib0044) 2013 Seiford, Zhu (bib0060) 1999; 45 Carrillo, Jorge (bib0012) 2016; 50 (bib0026) 2014 Hu, Mathews (bib0037) 2008; 37 Nasierowski, Arcelus (bib0054) 2012; 58 Kao, Hwang (bib0042) 2008; 185 Olesen, Petersen, Podinovski (bib0055) 2015; 245 Chen, Hu, Yang (bib0015) 2011; 13 Wu, Zhou, Liang (bib0069) 2010; 2 Siskos, Grigoroudis, Matsatsinis (bib0064) 2005 Tidd, Bessant (bib0065) 2009 Chen, Guan (bib0016) 2010; 46 Sharma, Thomas (bib0061) 2008; 76 Carayannis, Campbell (bib0008) 2009; 46 Carayannis, Provance (bib0010) 2008; 1 Andersson, Mahroum (bib0002) 2008 Lv (bib0048) 2011; 143 Matthews (bib0051) 2013; 41 Garcia (10.1016/j.eswa.2016.06.017_bib0033) 2014; 41 Hu (10.1016/j.eswa.2016.06.017_bib0037) 2008; 37 Furman (10.1016/j.eswa.2016.06.017_bib0032) 2002; 31 Wang (10.1016/j.eswa.2016.06.017_bib0068) 2010; 37 Cruz-Cázares (10.1016/j.eswa.2016.06.017_bib0022) 2013; 42 Ebrahimnejad (10.1016/j.eswa.2016.06.017_bib0025) 2014; 49 Kao (10.1016/j.eswa.2016.06.017_bib0043) 2014; 24 Kotsemir (10.1016/j.eswa.2016.06.017_bib0044) 2013 Murro (10.1016/j.eswa.2016.06.017_bib0052) 2012; 81 Liu (10.1016/j.eswa.2016.06.017_bib0047) 2015; 45 Matthews (10.1016/j.eswa.2016.06.017_bib0051) 2013; 41 Andersson (10.1016/j.eswa.2016.06.017_bib0002) 2008 (10.1016/j.eswa.2016.06.017_bib0026) 2014 Seiford (10.1016/j.eswa.2016.06.017_bib0060) 1999; 45 Chen (10.1016/j.eswa.2016.06.017_bib0015) 2011; 13 Zabala-Iturriagagoitia (10.1016/j.eswa.2016.06.017_bib0070) 2007; 41 Olesen (10.1016/j.eswa.2016.06.017_bib0055) 2015; 245 Carayannis (10.1016/j.eswa.2016.06.017_bib0007) 2002; 22 Färe (10.1016/j.eswa.2016.06.017_bib0029) 1984; 3 Lv (10.1016/j.eswa.2016.06.017_bib0048) 2011; 143 Nasierowski (10.1016/j.eswa.2016.06.017_bib0053) 2003; 37 Schumpeter (10.1016/j.eswa.2016.06.017_bib0059) 1934 Matei (10.1016/j.eswa.2016.06.017_bib0050) 2012; 62 Bosco (10.1016/j.eswa.2016.06.017_bib0003) 2010 Pan (10.1016/j.eswa.2016.06.017_bib0056) 2010; 27 Jacquet-Lagrèze (10.1016/j.eswa.2016.06.017_bib0038) 1982; 10 Hollanders (10.1016/j.eswa.2016.06.017_bib0036) 2007 Kou (10.1016/j.eswa.2016.06.017_bib0045) 2016; 46 Tidd (10.1016/j.eswa.2016.06.017_bib0065) 2009 Broekel (10.1016/j.eswa.2016.06.017_bib0004) 2013 Cai (10.1016/j.eswa.2016.06.017_bib0006) 2012 Rousseau (10.1016/j.eswa.2016.06.017_bib0058) 1997; 40 Cook (10.1016/j.eswa.2016.06.017_bib0021) 1998; 10 Carayannis (10.1016/j.eswa.2016.06.017_bib0010) 2008; 1 Choi (10.1016/j.eswa.2016.06.017_bib0018) 2013; 40 Fritsch (10.1016/j.eswa.2016.06.017_bib0031) 2011; 45 Siskos (10.1016/j.eswa.2016.06.017_bib0064) 2005 Carayannis (10.1016/j.eswa.2016.06.017_bib0011) 2015; 15 10.1016/j.eswa.2016.06.017_bib0014 Cook (10.1016/j.eswa.2016.06.017_bib0020) 2005; 32 Wu (10.1016/j.eswa.2016.06.017_bib0069) 2010; 2 Färe (10.1016/j.eswa.2016.06.017_bib0030) 2000; 34 Guan (10.1016/j.eswa.2016.06.017_bib0035) 2012; 41 Etzkowitz (10.1016/j.eswa.2016.06.017_bib0028) 2000; 29 Kao (10.1016/j.eswa.2016.06.017_bib0042) 2008; 185 Carrillo (10.1016/j.eswa.2016.06.017_bib0012) 2016; 50 Zhang (10.1016/j.eswa.2016.06.017_bib0071) 2013; 30 Chen (10.1016/j.eswa.2016.06.017_bib0016) 2010; 46 Cai (10.1016/j.eswa.2016.06.017_bib0005) 2011 Sharma (10.1016/j.eswa.2016.06.017_bib0061) 2008; 76 Kao (10.1016/j.eswa.2016.06.017_bib0041) 2014; 239 Lewis (10.1016/j.eswa.2016.06.017_bib0046) 2004; 31 Castelli (10.1016/j.eswa.2016.06.017_bib0013) 2004; 154 Wang (10.1016/j.eswa.2016.06.017_bib0066) 1997; 73 Afzal (10.1016/j.eswa.2016.06.017_bib0001) 2014; 28 Chun (10.1016/j.eswa.2016.06.017_bib0019) 2015; 7 Siskos (10.1016/j.eswa.2016.06.017_bib0063) 1985; 5 Cummins (10.1016/j.eswa.2016.06.017_bib0024) 1998; 10 Chilingerian (10.1016/j.eswa.2016.06.017_bib0017) 2011; 164 Mahroum (10.1016/j.eswa.2016.06.017_bib0049) 2013; 33 Nasierowski (10.1016/j.eswa.2016.06.017_bib0054) 2012; 58 Emrouznejad (10.1016/j.eswa.2016.06.017_bib0027) 2009; 33 Carayannis (10.1016/j.eswa.2016.06.017_bib0008) 2009; 46 Kaihua (10.1016/j.eswa.2016.06.017_bib0040) 2014; 52 Cullmann (10.1016/j.eswa.2016.06.017_bib0023) 2011; 64 Wang (10.1016/j.eswa.2016.06.017_bib0067) 2007; 36 Jacquet-Lagrèze (10.1016/j.eswa.2016.06.017_bib0039) 2001; 130 Pittaway (10.1016/j.eswa.2016.06.017_bib0057) 2004; 5-6 Shyu (10.1016/j.eswa.2016.06.017_bib0062) 2012; 39
References_xml	– volume: 22 start-page: 625 year: 2002 end-page: 643 ident: bib0007 article-title: Is technological learning a firm core competence, when, how and why? A longitudinal, multi-industry study of firm technological learning and market performance publication-title: Technovation – year: 2014 ident: bib0026 article-title: Regional innovation scoreboard – volume: 31 start-page: 899 year: 2002 end-page: 933 ident: bib0032 article-title: The determinants of national innovative capacity publication-title: Research Policy – volume: 37 start-page: 1465 year: 2008 end-page: 1479 ident: bib0037 article-title: China's national innovative capacity publication-title: Research Policy – volume: 49 start-page: 308 year: 2014 end-page: 319 ident: bib0025 article-title: A three-stage Data Envelopment Analysis model with application to banking industry publication-title: Measurement – volume: 50 start-page: 130 year: 2016 end-page: 139 ident: bib0012 article-title: A multiobjective DEA approach to ranking alternatives publication-title: Expert System with Applications – volume: 32 start-page: 813 year: 2005 end-page: 823 ident: bib0020 article-title: Evaluating power plant efficiency: A hierarchical model publication-title: Computers and Operations Research – volume: 52 start-page: 627 year: 2014 end-page: 657 ident: bib0040 article-title: Staged efficiency and its determinants of regional innovation systems: A two-step analytical procedure publication-title: The Annals of Regional Science – volume: 37 start-page: 8799 year: 2010 end-page: 8808 ident: bib0068 article-title: Some alternative DEA models for two-stage process publication-title: Expert Systems with Applications – year: 2010 ident: bib0003 publication-title: Regional efficiency, innovation and productivity, 2010 RSA Conference, Pcs, Hungary – volume: 33 start-page: 320 year: 2013 end-page: 332 ident: bib0049 article-title: Towards a functional framework for measuring national innovation efficacy publication-title: Technovation – volume: 130 start-page: 233 year: 2001 end-page: 245 ident: bib0039 article-title: Preference disaggregation: 20 years of MCDA experience publication-title: European Journal of Operational Research – year: 2012 ident: bib0006 article-title: Building BRICS – volume: 45 start-page: 317 year: 2015 end-page: 338 ident: bib0047 article-title: National characteristics: Innovation systems from the process efficiency perspective publication-title: R&D Management – year: 2009 ident: bib0065 article-title: Managing innovation: Integrating technological, market, and organizational change – volume: 13 start-page: 341 year: 2011 end-page: 360 ident: bib0015 article-title: An international comparison of R&D efficiency of multiple innovative outputs: The role of the national innovation system publication-title: Innovation – volume: 40 start-page: 4511 year: 2013 end-page: 4518 ident: bib0018 article-title: The effects of network characteristics on performance of innovation clusters publication-title: Expert Systems with Applications – volume: 41 start-page: 5636 year: 2014 end-page: 5646 ident: bib0033 article-title: Network-based innovation systems: A capital base for the Monterrey city-region, Mexico publication-title: Expert Systems with Applications – volume: 41 start-page: 661 year: 2007 end-page: 672 ident: bib0070 article-title: Regional innovation systems: How to assess performance publication-title: Regional Studies – volume: 45 start-page: 1270 year: 1999 end-page: 1288 ident: bib0060 article-title: Profitability and marketability of the top 55 publication-title: Management Science – volume: 29 start-page: 109 year: 2000 end-page: 123 ident: bib0028 article-title: The dynamics of innovation: From national systems and ‘mode 2’ to a triple helix of university-industry-government relations publication-title: Research Policy – volume: 76 start-page: 483 year: 2008 end-page: 501 ident: bib0061 article-title: Inter-country R&D efficiency analysis: An application of data envelopment analysis publication-title: Scientometrics – volume: 37 start-page: 215 year: 2003 end-page: 234 ident: bib0053 article-title: On the efficiency of national innovation systems publication-title: Socio-Economic Planning Sciences – volume: 39 start-page: 11494 year: 2012 end-page: 11502 ident: bib0062 article-title: Measuring the true managerial efficiency of bank branches in Taiwan: A three-stage DEA analysis publication-title: Expert Systems with Applications – volume: 30 start-page: 23 year: 2013 end-page: 29 ident: bib0071 article-title: International comparison of national innovation system efficiency publication-title: Tech Monitor – volume: 10 start-page: 177 year: 1998 end-page: 198 ident: bib0021 article-title: Hierarchies and groups in DEA publication-title: Journal of Productivity Analysis – volume: 33 start-page: 486 year: 2009 end-page: 498 ident: bib0027 article-title: DEA models for ratio data: Convexity consideration publication-title: Applied Mathematical Modelling – volume: 34 start-page: 35 year: 2000 end-page: 49 ident: bib0030 article-title: Network DEA publication-title: Socio-Economic Planning Sciences – year: 2013 ident: bib0044 article-title: Measuring national innovation systems efficiency: A review of DEA approach publication-title: WP BRP 16/STI/2013, Higher School of Economics, Moscow – year: 2013 ident: bib0004 article-title: The innovation efficiency of German regions – volume: 36 start-page: 260 year: 2007 end-page: 273 ident: bib0067 article-title: Relative efficiency of R&D activities: A cross-country study accounting for environmental factors in the DEA approach publication-title: Research Policy – year: 2007 ident: bib0036 article-title: Measuring innovation efficiency – volume: 24 start-page: 406 year: 2014 end-page: 413 ident: bib0043 article-title: A multi-objective programming method for solving network DEA publication-title: Applied Soft Computing – volume: 73 start-page: 191 year: 1997 end-page: 213 ident: bib0066 article-title: Use of Data Envelopment Analysis in assessing Information Technology impact on firm performance publication-title: Annals of Operations Research – volume: 27 start-page: 369 year: 2010 end-page: 392 ident: bib0056 article-title: DEA performance measurement of the national innovation system in Asia and Europe publication-title: Asia-Pacific Journal of Operational Research – volume: 143 start-page: 109 year: 2011 end-page: 114 ident: bib0048 article-title: A KPCA and DEA model for region innovation efficiency publication-title: Advanced research on electronic commerce, web application, and communication, Communications in Computer and Information Science – volume: 1 start-page: 90 year: 2008 end-page: 107 ident: bib0010 article-title: Measuring firm innovativeness: Towards a composite innovation index built on firm innovative posture, propensity and performance attributes publication-title: International Journal of Innovation and Regional Development – volume: 154 start-page: 465 year: 2004 end-page: 476 ident: bib0013 article-title: DEA-like models for the efficiency evaluation of hierarchically structured units publication-title: European Journal of Operational Research – volume: 7 start-page: 5120 year: 2015 end-page: 5138 ident: bib0019 article-title: Labor union effects on innovation and commercialization productivity: An integrated propensity score matching and two-stage data envelopment analysis publication-title: Sustainability – volume: 10 start-page: 151 year: 1982 end-page: 164 ident: bib0038 article-title: Assessing a set of additive utility functions for multicriteria decision making: The UTA method publication-title: European Journal of Operational Research – year: 2011 ident: bib0005 article-title: Factors affecting the efficiency of the BRICSs' national innovation systems – volume: 239 start-page: 1 year: 2014 end-page: 16 ident: bib0041 article-title: Network data envelopment analysis: A review publication-title: European Journal of Operational Research – volume: 46 start-page: 355 year: 2010 end-page: 377 ident: bib0016 article-title: Measuring the efficiency of China's regional innovation systems: Application of network Data Envelopment Analysis (DEA) publication-title: Regional Studies – start-page: 297 year: 2005 end-page: 344 ident: bib0064 article-title: UTA methods publication-title: Multiple criteria analysis: State of the art surveys – volume: 58 start-page: 792 year: 2012 end-page: 801 ident: bib0054 article-title: About efficiency of innovations: What can be learned from the Innovation Union Scoreboard index publication-title: Procedia – Social and Behavioral Sciences – volume: 10 start-page: 131 year: 1998 end-page: 152 ident: bib0024 article-title: Comparison of frontier efficiency methods: An application to the U.S. life insurance industry publication-title: Journal of Productivity Analysis – volume: 5 start-page: 39 year: 1985 end-page: 53 ident: bib0063 article-title: UTASTAR: An ordinal regression method for building additive value functions publication-title: Investigação Operacional – reference: Charron, N. (2013). The european quality of government index: Summary of 2013 data, sensitivity analysis and final results, available at: – volume: 164 start-page: 445 year: 2011 end-page: 493 ident: bib0017 article-title: Healthcare applications: From hospitals to physicians, from productive efficiency to quality frontiers publication-title: Handbook on data envelopment analysis – volume: 28 start-page: 507 year: 2014 end-page: 523 ident: bib0001 article-title: An empirical investigation of the National Innovation System (NIS) using Data Envelopment Analysis (DEA) and the TOBIT model publication-title: International Review of Applied Economics – volume: 64 start-page: 176 year: 2011 end-page: 196 ident: bib0023 article-title: R&D efficiency and barriers to entry: A two stage semi-parametric DEA approach publication-title: Oxford Economic Papers – volume: 3 start-page: 257 year: 1984 end-page: 260 ident: bib0029 article-title: Efficiency measures for multiplant firms publication-title: Operations Research Letters – volume: 185 start-page: 418 year: 2008 end-page: 429 ident: bib0042 article-title: Efficiency decomposition in two-stage data envelopment analysis: An application to non-life insurance companies in Taiwan publication-title: European Journal of Operational Research – volume: 41 start-page: 207 year: 2013 end-page: 215 ident: bib0051 article-title: Risk management and managerial efficiency in Chinese banks: A network DEA framework publication-title: Omega – volume: 2 start-page: 85 year: 2010 end-page: 99 ident: bib0069 article-title: Measuring the performance of Chinese regional innovation systems with two-stage DEA-based model publication-title: International Journal of Sustainable Society – volume: 41 start-page: 102 year: 2012 end-page: 115 ident: bib0035 article-title: Modeling the relative efficiency of national innovation systems publication-title: Research Policy – volume: 42 start-page: 1239 year: 2013 end-page: 1250 ident: bib0022 article-title: You can't manage right what you can't measure well: Technological innovation efficiency publication-title: Research Policy – reference: . – volume: 40 start-page: 45 year: 1997 end-page: 56 ident: bib0058 article-title: Data Envelopment Analysis as a tool for constructing scientometric indicators publication-title: Scientometrics – volume: 245 start-page: 446 year: 2015 end-page: 462 ident: bib0055 article-title: Efficiency analysis with ratio measures publication-title: European Journal of Operational Research – year: 2008 ident: bib0002 article-title: Policy relevant Nordic innovation indicators – volume: 46 start-page: 201 year: 2009 end-page: 234 ident: bib0008 article-title: ‘Mode 3’ and ‘Quadruple Helix’: Toward a 21st century fractal innovation ecosystem publication-title: International Journal of Technology Management – volume: 81 start-page: 293 year: 2012 end-page: 323 ident: bib0052 article-title: The determinants of innovation: What is the role of risk? publication-title: The Manchester School – year: 1934 ident: bib0059 article-title: The theory of economic development – volume: 46 start-page: 494 year: 2016 end-page: 510 ident: bib0045 article-title: Measuring efficiencies of multi-period and multi-division systems associated with DEA: An application to OECD countries’ national innovation systems publication-title: Expert Systems with Applications – volume: 45 start-page: 905 year: 2011 end-page: 918 ident: bib0031 article-title: Determinants of the efficiency of regional innovation systems publication-title: Regional Studies – volume: 31 start-page: 1365 year: 2004 end-page: 1410 ident: bib0046 article-title: Network DEA: Efficiency analysis of organizations with complex internal structure publication-title: Computers & Operations Research – volume: 62 start-page: 968 year: 2012 end-page: 974 ident: bib0050 article-title: Ranking national innovation systems according to their technical efficiency publication-title: Procedia – Social and Behavioral Sciences – volume: 5-6 start-page: 137 year: 2004 end-page: 168 ident: bib0057 article-title: Networking and innovation: A systematic review of the evidence publication-title: International Journal of Management Reviews – volume: 15 start-page: 253 year: 2015 end-page: 274 ident: bib0011 article-title: Multi-level multi-stage efficiency measurement: The case of innovation systems publication-title: Operational Research: An International Journal – volume: 31 start-page: 1365 issue: 9 year: 2004 ident: 10.1016/j.eswa.2016.06.017_bib0046 article-title: Network DEA: Efficiency analysis of organizations with complex internal structure publication-title: Computers & Operations Research doi: 10.1016/S0305-0548(03)00095-9 – volume: 33 start-page: 320 issue: 10-11 year: 2013 ident: 10.1016/j.eswa.2016.06.017_bib0049 article-title: Towards a functional framework for measuring national innovation efficacy publication-title: Technovation doi: 10.1016/j.technovation.2013.03.013 – volume: 81 start-page: 293 issue: 3 year: 2012 ident: 10.1016/j.eswa.2016.06.017_bib0052 article-title: The determinants of innovation: What is the role of risk? publication-title: The Manchester School doi: 10.1111/j.1467-9957.2012.02286.x – volume: 37 start-page: 1465 issue: 9 year: 2008 ident: 10.1016/j.eswa.2016.06.017_bib0037 article-title: China's national innovative capacity publication-title: Research Policy doi: 10.1016/j.respol.2008.07.003 – volume: 73 start-page: 191 year: 1997 ident: 10.1016/j.eswa.2016.06.017_bib0066 article-title: Use of Data Envelopment Analysis in assessing Information Technology impact on firm performance publication-title: Annals of Operations Research doi: 10.1023/A:1018977111455 – volume: 37 start-page: 8799 issue: 12 year: 2010 ident: 10.1016/j.eswa.2016.06.017_bib0068 article-title: Some alternative DEA models for two-stage process publication-title: Expert Systems with Applications doi: 10.1016/j.eswa.2010.06.024 – volume: 1 start-page: 90 issue: 1 year: 2008 ident: 10.1016/j.eswa.2016.06.017_bib0010 article-title: Measuring firm innovativeness: Towards a composite innovation index built on firm innovative posture, propensity and performance attributes publication-title: International Journal of Innovation and Regional Development doi: 10.1504/IJIRD.2008.016861 – year: 2010 ident: 10.1016/j.eswa.2016.06.017_bib0003 – volume: 7 start-page: 5120 year: 2015 ident: 10.1016/j.eswa.2016.06.017_bib0019 article-title: Labor union effects on innovation and commercialization productivity: An integrated propensity score matching and two-stage data envelopment analysis publication-title: Sustainability doi: 10.3390/su7055120 – start-page: 297 year: 2005 ident: 10.1016/j.eswa.2016.06.017_bib0064 article-title: UTA methods – volume: 130 start-page: 233 issue: 2 year: 2001 ident: 10.1016/j.eswa.2016.06.017_bib0039 article-title: Preference disaggregation: 20 years of MCDA experience publication-title: European Journal of Operational Research doi: 10.1016/S0377-2217(00)00035-7 – volume: 34 start-page: 35 issue: 1 year: 2000 ident: 10.1016/j.eswa.2016.06.017_bib0030 article-title: Network DEA publication-title: Socio-Economic Planning Sciences doi: 10.1016/S0038-0121(99)00012-9 – volume: 185 start-page: 418 issue: 1 year: 2008 ident: 10.1016/j.eswa.2016.06.017_bib0042 article-title: Efficiency decomposition in two-stage data envelopment analysis: An application to non-life insurance companies in Taiwan publication-title: European Journal of Operational Research doi: 10.1016/j.ejor.2006.11.041 – volume: 31 start-page: 899 issue: 6 year: 2002 ident: 10.1016/j.eswa.2016.06.017_bib0032 article-title: The determinants of national innovative capacity publication-title: Research Policy doi: 10.1016/S0048-7333(01)00152-4 – volume: 58 start-page: 792 year: 2012 ident: 10.1016/j.eswa.2016.06.017_bib0054 article-title: About efficiency of innovations: What can be learned from the Innovation Union Scoreboard index publication-title: Procedia – Social and Behavioral Sciences doi: 10.1016/j.sbspro.2012.09.1057 – volume: 62 start-page: 968 year: 2012 ident: 10.1016/j.eswa.2016.06.017_bib0050 article-title: Ranking national innovation systems according to their technical efficiency publication-title: Procedia – Social and Behavioral Sciences doi: 10.1016/j.sbspro.2012.09.165 – volume: 46 start-page: 494 issue: 15 year: 2016 ident: 10.1016/j.eswa.2016.06.017_bib0045 article-title: Measuring efficiencies of multi-period and multi-division systems associated with DEA: An application to OECD countries’ national innovation systems publication-title: Expert Systems with Applications doi: 10.1016/j.eswa.2015.10.032 – volume: 46 start-page: 201 issue: 3/4 year: 2009 ident: 10.1016/j.eswa.2016.06.017_bib0008 article-title: ‘Mode 3’ and ‘Quadruple Helix’: Toward a 21st century fractal innovation ecosystem publication-title: International Journal of Technology Management doi: 10.1504/IJTM.2009.023374 – volume: 41 start-page: 207 issue: 2 year: 2013 ident: 10.1016/j.eswa.2016.06.017_bib0051 article-title: Risk management and managerial efficiency in Chinese banks: A network DEA framework publication-title: Omega doi: 10.1016/j.omega.2012.06.003 – volume: 30 start-page: 23 issue: 2 year: 2013 ident: 10.1016/j.eswa.2016.06.017_bib0071 article-title: International comparison of national innovation system efficiency publication-title: Tech Monitor – year: 2013 ident: 10.1016/j.eswa.2016.06.017_bib0044 article-title: Measuring national innovation systems efficiency: A review of DEA approach publication-title: WP BRP 16/STI/2013, Higher School of Economics, Moscow – volume: 39 start-page: 11494 issue: 13 year: 2012 ident: 10.1016/j.eswa.2016.06.017_bib0062 article-title: Measuring the true managerial efficiency of bank branches in Taiwan: A three-stage DEA analysis publication-title: Expert Systems with Applications doi: 10.1016/j.eswa.2012.04.005 – volume: 10 start-page: 177 issue: 2 year: 1998 ident: 10.1016/j.eswa.2016.06.017_bib0021 article-title: Hierarchies and groups in DEA publication-title: Journal of Productivity Analysis doi: 10.1023/A:1018625424184 – volume: 64 start-page: 176 issue: 1 year: 2011 ident: 10.1016/j.eswa.2016.06.017_bib0023 article-title: R&D efficiency and barriers to entry: A two stage semi-parametric DEA approach publication-title: Oxford Economic Papers doi: 10.1093/oep/gpr015 – volume: 29 start-page: 109 issue: 2 year: 2000 ident: 10.1016/j.eswa.2016.06.017_bib0028 article-title: The dynamics of innovation: From national systems and ‘mode 2’ to a triple helix of university-industry-government relations publication-title: Research Policy doi: 10.1016/S0048-7333(99)00055-4 – volume: 45 start-page: 905 issue: 7 year: 2011 ident: 10.1016/j.eswa.2016.06.017_bib0031 article-title: Determinants of the efficiency of regional innovation systems publication-title: Regional Studies doi: 10.1080/00343400802251494 – volume: 37 start-page: 215 issue: 3 year: 2003 ident: 10.1016/j.eswa.2016.06.017_bib0053 article-title: On the efficiency of national innovation systems publication-title: Socio-Economic Planning Sciences doi: 10.1016/S0038-0121(02)00046-0 – volume: 40 start-page: 45 issue: 1 year: 1997 ident: 10.1016/j.eswa.2016.06.017_bib0058 article-title: Data Envelopment Analysis as a tool for constructing scientometric indicators publication-title: Scientometrics doi: 10.1007/BF02459261 – volume: 5-6 start-page: 137 issue: 3-4 year: 2004 ident: 10.1016/j.eswa.2016.06.017_bib0057 article-title: Networking and innovation: A systematic review of the evidence publication-title: International Journal of Management Reviews doi: 10.1111/j.1460-8545.2004.00101.x – volume: 32 start-page: 813 issue: 4 year: 2005 ident: 10.1016/j.eswa.2016.06.017_bib0020 article-title: Evaluating power plant efficiency: A hierarchical model publication-title: Computers and Operations Research doi: 10.1016/j.cor.2003.08.019 – year: 2007 ident: 10.1016/j.eswa.2016.06.017_bib0036 – volume: 28 start-page: 507 issue: 4 year: 2014 ident: 10.1016/j.eswa.2016.06.017_bib0001 article-title: An empirical investigation of the National Innovation System (NIS) using Data Envelopment Analysis (DEA) and the TOBIT model publication-title: International Review of Applied Economics doi: 10.1080/02692171.2014.896880 – volume: 5 start-page: 39 issue: 1 year: 1985 ident: 10.1016/j.eswa.2016.06.017_bib0063 article-title: UTASTAR: An ordinal regression method for building additive value functions publication-title: Investigação Operacional – year: 2009 ident: 10.1016/j.eswa.2016.06.017_bib0065 – volume: 41 start-page: 102 issue: 1 year: 2012 ident: 10.1016/j.eswa.2016.06.017_bib0035 article-title: Modeling the relative efficiency of national innovation systems publication-title: Research Policy doi: 10.1016/j.respol.2011.07.001 – volume: 2 start-page: 85 issue: 1 year: 2010 ident: 10.1016/j.eswa.2016.06.017_bib0069 article-title: Measuring the performance of Chinese regional innovation systems with two-stage DEA-based model publication-title: International Journal of Sustainable Society doi: 10.1504/IJSSOC.2010.030564 – volume: 239 start-page: 1 issue: 1 year: 2014 ident: 10.1016/j.eswa.2016.06.017_bib0041 article-title: Network data envelopment analysis: A review publication-title: European Journal of Operational Research doi: 10.1016/j.ejor.2014.02.039 – volume: 50 start-page: 130 year: 2016 ident: 10.1016/j.eswa.2016.06.017_bib0012 article-title: A multiobjective DEA approach to ranking alternatives publication-title: Expert System with Applications doi: 10.1016/j.eswa.2015.12.022 – volume: 49 start-page: 308 year: 2014 ident: 10.1016/j.eswa.2016.06.017_bib0025 article-title: A three-stage Data Envelopment Analysis model with application to banking industry publication-title: Measurement doi: 10.1016/j.measurement.2013.11.043 – volume: 143 start-page: 109 year: 2011 ident: 10.1016/j.eswa.2016.06.017_bib0048 article-title: A KPCA and DEA model for region innovation efficiency – volume: 10 start-page: 131 issue: 2 year: 1998 ident: 10.1016/j.eswa.2016.06.017_bib0024 article-title: Comparison of frontier efficiency methods: An application to the U.S. life insurance industry publication-title: Journal of Productivity Analysis doi: 10.1023/A:1026402922367 – volume: 52 start-page: 627 issue: 2 year: 2014 ident: 10.1016/j.eswa.2016.06.017_bib0040 article-title: Staged efficiency and its determinants of regional innovation systems: A two-step analytical procedure publication-title: The Annals of Regional Science doi: 10.1007/s00168-014-0604-6 – volume: 76 start-page: 483 issue: 3 year: 2008 ident: 10.1016/j.eswa.2016.06.017_bib0061 article-title: Inter-country R&D efficiency analysis: An application of data envelopment analysis publication-title: Scientometrics doi: 10.1007/s11192-007-1896-4 – volume: 41 start-page: 661 issue: 5 year: 2007 ident: 10.1016/j.eswa.2016.06.017_bib0070 article-title: Regional innovation systems: How to assess performance publication-title: Regional Studies doi: 10.1080/00343400601120270 – year: 1934 ident: 10.1016/j.eswa.2016.06.017_bib0059 – volume: 40 start-page: 4511 issue: 11 year: 2013 ident: 10.1016/j.eswa.2016.06.017_bib0018 article-title: The effects of network characteristics on performance of innovation clusters publication-title: Expert Systems with Applications doi: 10.1016/j.eswa.2013.01.052 – volume: 27 start-page: 369 issue: 3 year: 2010 ident: 10.1016/j.eswa.2016.06.017_bib0056 article-title: DEA performance measurement of the national innovation system in Asia and Europe publication-title: Asia-Pacific Journal of Operational Research doi: 10.1142/S0217595910002752 – year: 2012 ident: 10.1016/j.eswa.2016.06.017_bib0006 – volume: 45 start-page: 317 issue: 4 year: 2015 ident: 10.1016/j.eswa.2016.06.017_bib0047 article-title: National characteristics: Innovation systems from the process efficiency perspective publication-title: R&D Management doi: 10.1111/radm.12067 – volume: 45 start-page: 1270 issue: 9 year: 1999 ident: 10.1016/j.eswa.2016.06.017_bib0060 article-title: Profitability and marketability of the top 55U.S. commercial banks publication-title: Management Science doi: 10.1287/mnsc.45.9.1270 – year: 2008 ident: 10.1016/j.eswa.2016.06.017_bib0002 – year: 2014 ident: 10.1016/j.eswa.2016.06.017_bib0026 – year: 2011 ident: 10.1016/j.eswa.2016.06.017_bib0005 – volume: 46 start-page: 355 issue: 3 year: 2010 ident: 10.1016/j.eswa.2016.06.017_bib0016 article-title: Measuring the efficiency of China's regional innovation systems: Application of network Data Envelopment Analysis (DEA) publication-title: Regional Studies doi: 10.1080/00343404.2010.497479 – volume: 13 start-page: 341 issue: 3 year: 2011 ident: 10.1016/j.eswa.2016.06.017_bib0015 article-title: An international comparison of R&D efficiency of multiple innovative outputs: The role of the national innovation system publication-title: Innovation doi: 10.5172/impp.2011.13.3.341 – volume: 42 start-page: 1239 issue: 6-7 year: 2013 ident: 10.1016/j.eswa.2016.06.017_bib0022 article-title: You can't manage right what you can't measure well: Technological innovation efficiency publication-title: Research Policy doi: 10.1016/j.respol.2013.03.012 – ident: 10.1016/j.eswa.2016.06.017_bib0014 – volume: 41 start-page: 5636 issue: 12 year: 2014 ident: 10.1016/j.eswa.2016.06.017_bib0033 article-title: Network-based innovation systems: A capital base for the Monterrey city-region, Mexico publication-title: Expert Systems with Applications doi: 10.1016/j.eswa.2014.02.014 – volume: 164 start-page: 445 year: 2011 ident: 10.1016/j.eswa.2016.06.017_bib0017 article-title: Healthcare applications: From hospitals to physicians, from productive efficiency to quality frontiers – volume: 245 start-page: 446 issue: 2 year: 2015 ident: 10.1016/j.eswa.2016.06.017_bib0055 article-title: Efficiency analysis with ratio measures publication-title: European Journal of Operational Research doi: 10.1016/j.ejor.2015.03.013 – volume: 15 start-page: 253 issue: 2 year: 2015 ident: 10.1016/j.eswa.2016.06.017_bib0011 article-title: Multi-level multi-stage efficiency measurement: The case of innovation systems publication-title: Operational Research: An International Journal doi: 10.1007/s12351-015-0176-y – volume: 22 start-page: 625 issue: 10 year: 2002 ident: 10.1016/j.eswa.2016.06.017_bib0007 article-title: Is technological learning a firm core competence, when, how and why? A longitudinal, multi-industry study of firm technological learning and market performance publication-title: Technovation doi: 10.1016/S0166-4972(01)00047-5 – volume: 10 start-page: 151 issue: 2 year: 1982 ident: 10.1016/j.eswa.2016.06.017_bib0038 article-title: Assessing a set of additive utility functions for multicriteria decision making: The UTA method publication-title: European Journal of Operational Research doi: 10.1016/0377-2217(82)90155-2 – volume: 24 start-page: 406 year: 2014 ident: 10.1016/j.eswa.2016.06.017_bib0043 article-title: A multi-objective programming method for solving network DEA publication-title: Applied Soft Computing doi: 10.1016/j.asoc.2014.06.057 – volume: 36 start-page: 260 issue: 2 year: 2007 ident: 10.1016/j.eswa.2016.06.017_bib0067 article-title: Relative efficiency of R&D activities: A cross-country study accounting for environmental factors in the DEA approach publication-title: Research Policy doi: 10.1016/j.respol.2006.11.004 – year: 2013 ident: 10.1016/j.eswa.2016.06.017_bib0004 – volume: 33 start-page: 486 issue: 1 year: 2009 ident: 10.1016/j.eswa.2016.06.017_bib0027 article-title: DEA models for ratio data: Convexity consideration publication-title: Applied Mathematical Modelling doi: 10.1016/j.apm.2007.11.018 – volume: 154 start-page: 465 issue: 2 year: 2004 ident: 10.1016/j.eswa.2016.06.017_bib0013 article-title: DEA-like models for the efficiency evaluation of hierarchically structured units publication-title: European Journal of Operational Research doi: 10.1016/S0377-2217(03)00182-6 – volume: 3 start-page: 257 issue: 5 year: 1984 ident: 10.1016/j.eswa.2016.06.017_bib0029 article-title: Efficiency measures for multiplant firms publication-title: Operations Research Letters doi: 10.1016/0167-6377(84)90057-9
SSID	ssj0017007
Score	2.5384078
Snippet	•A framework for estimating national and regional innovation efficiency is presented•The proposed DEA-based model is formulated as a multiobjective... Evaluating the efficiency of innovation systems can serve as a substantial enabling tool for policymaking serving to identify best practices and develop...
SourceID	proquest crossref elsevier
SourceType	Aggregation Database Enrichment Source Index Database Publisher
StartPage	63
SubjectTerms	Computational efficiency Computing time Data envelopment analysis Dynamical systems Dynamics Innovation Innovation systems Mathematical analysis Mathematical models Multilevel efficiency Multiobjective programming Multistage efficiency Ordinal regression analysis Policies
Title	A multilevel and multistage efficiency evaluation of innovation systems: A multiobjective DEA approach
URI	https://dx.doi.org/10.1016/j.eswa.2016.06.017 https://www.proquest.com/docview/1835638307
Volume	62
WOSCitedRecordID	wos000380626000005&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
hasFullText	1
inHoldings	1
isFullTextHit
isPrint
journalDatabaseRights	– providerCode: PRVESC databaseName: Elsevier SD Freedom Collection Journals 2021 customDbUrl: eissn: 1873-6793 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0017007 issn: 0957-4174 databaseCode: AIEXJ dateStart: 19950101 isFulltext: true titleUrlDefault: https://www.sciencedirect.com providerName: Elsevier
link	http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwtV3Nb9MwFLdKx4EL32gbHzIS4jIF1WtcJ9wi6AaoKhw6VE6W4zhVqyouSdttJ_51nmM7WSeYxoFL1KZ5SeX3y_vw-0LoDVExy1KaB5SlaRDKQRiInMRBSGVE-iKVqp48933ExuNoOo2_dTq_fC3MdsmKIrq4iFf_ldVwDphtSmf_gd3NTeEEfAamwxHYDsdbMT6xSYJLkw1Uhwbqr2AEzursjXn9Ml9eafNtu0b44aiut3NlS9ZrWp0urFg8-jhMmi7kO3v6pmHy2pO6grkrofE20lGKSzMlqRIup0xU7XSv03I-06XeZOB41j9vTeXDUjfkpxpQVs2reir7D13O9M6uBRmY8j1bt9lsP7IgJHZCj5fETi5bUerknlPKvT-Ke7vzsHinqnPTQ4oM6l6sthh0t7f2-Cs_ORuN-GQ4nbxd_QzM2DETnnczWO6gvWNG46iL9pLPw-mXJhDFerbi3v9dV3dlUwSvP_Zvts01LV-bLpOH6L7zOXBisfIIdVTxGD3w8zywE-9PUJ7gFjoYoINb6OAWOriFDtY5bqGDHf_fY3ejBjgYgIM9cJ6is5Ph5MOnwM3hCCSon3UQCRkfDyjth1EmweOWmYwZZTKNKM1BBMgs6mWRjAcqlFTmfRoJlfeEIFkK5mmY9p-hbqELtY-wMVBTlTFQqmC6huBPg0kKxCG4Jbkk6QEifgW5dE3qzayUJffZiAtuVp2bVecmJZOwA3TU0Kxsi5Ybr6aeMdwZmdZ45ACqG-leey5ykMAmrCYKpTcVB6VIQYuBsjy8xTXP0b32fXiBuutyo16iu3IL7CxfOfj9BnJfsBo
linkProvider	Elsevier
openUrl	ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=A+multilevel+and+multistage+efficiency+evaluation+of+innovation+systems%3A+A+multiobjective+DEA+approach&rft.jtitle=Expert+systems+with+applications&rft.au=Carayannisa%2C+Elias+G&rft.au=Grigoroudisb%2C+Evangelos&rft.au=Goletsisc%2C+Yorgos&rft.date=2016-11-15&rft.issn=0957-4174&rft.volume=62&rft.spage=63&rft.epage=80&rft_id=info:doi/10.1016%2Fj.eswa.2016.06.017&rft.externalDBID=NO_FULL_TEXT
thumbnail_l	http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=0957-4174&client=summon
thumbnail_m	http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=0957-4174&client=summon
thumbnail_s	http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=0957-4174&client=summon