Routine Outcome Monitoring (ROM) and Feedback: Research Review and Recommendations

To provide a research review of the components and outcomes of routine outcome monitoring (ROM) and recommendations for research and therapeutic practice. A narrative review of the three phases of ROM - data collection, feeding back data, and adapting therapy - and an overview of patient outcomes fr...

Ausführliche Beschreibung

Gespeichert in:

Bibliographische Detailangaben
Veröffentlicht in:	Psychotherapy research Jg. 33; H. 7; S. 841 - 855
Hauptverfasser:	Barkham, Michael, De Jong, Kim, Delgadillo, Jaime, Lutz, Wolfgang
Format:	Journal Article
Sprache:	Englisch
Veröffentlicht:	England Routledge 03.10.2023 Taylor & Francis Ltd
Schlagworte:	Clinical outcomes clinical support tools Data collection deterioration Feedback Graphs measurement-based care Medical treatment outcome measures Patients psychotherapy outcome ROM routine outcome monitoring Therapy Treatment methods feedback ROM measurement-based care clinical support tools deterioration outcome measures psychotherapy outcome routine outcome monitoring
ISSN:	1050-3307, 1468-4381, 1468-4381
Online-Zugang:	Volltext
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!

Abstract	To provide a research review of the components and outcomes of routine outcome monitoring (ROM) and recommendations for research and therapeutic practice. A narrative review of the three phases of ROM - data collection, feeding back data, and adapting therapy - and an overview of patient outcomes from 11 meta-analytic studies. Patients support ROM when its purpose is clear and integrated within therapy. Greater frequency of data collection is more important for shorter-term therapies, and use of graphs, greater specificity of feedback, and alerts are helpful. Overall effects on patient outcomes are statistically significant (g ≈ 0.15) and increase when clinical support tools (CSTs) are used for not-on-track cases (g ≈ 0.36-0.53). Effects are additive to standard effects of psychological therapies. Organizational, personnel, and resource issues remain the greatest obstacles to the successful adoption of ROM. ROM offers a low-cost method for enhancing patient outcomes, on average resulting in an ≈ 8% advantage (success rate difference; SRD) over standard care. CSTs are particularly effective for not-on-track patients (SRD between ≈ 20% and 29%), but ROM does not work for all patients and successful implementation is a major challenge, along with securing appropriate cultural adaptations.
AbstractList	To provide a research review of the components and outcomes of routine outcome monitoring (ROM) and recommendations for research and therapeutic practice.OBJECTIVETo provide a research review of the components and outcomes of routine outcome monitoring (ROM) and recommendations for research and therapeutic practice.A narrative review of the three phases of ROM - data collection, feeding back data, and adapting therapy - and an overview of patient outcomes from 11 meta-analytic studies.METHODA narrative review of the three phases of ROM - data collection, feeding back data, and adapting therapy - and an overview of patient outcomes from 11 meta-analytic studies.Patients support ROM when its purpose is clear and integrated within therapy. Greater frequency of data collection is more important for shorter-term therapies, and use of graphs, greater specificity of feedback, and alerts are helpful. Overall effects on patient outcomes are statistically significant (g ≈ 0.15) and increase when clinical support tools (CSTs) are used for not-on-track cases (g ≈ 0.36-0.53). Effects are additive to standard effects of psychological therapies. Organizational, personnel, and resource issues remain the greatest obstacles to the successful adoption of ROM.RESULTSPatients support ROM when its purpose is clear and integrated within therapy. Greater frequency of data collection is more important for shorter-term therapies, and use of graphs, greater specificity of feedback, and alerts are helpful. Overall effects on patient outcomes are statistically significant (g ≈ 0.15) and increase when clinical support tools (CSTs) are used for not-on-track cases (g ≈ 0.36-0.53). Effects are additive to standard effects of psychological therapies. Organizational, personnel, and resource issues remain the greatest obstacles to the successful adoption of ROM.ROM offers a low-cost method for enhancing patient outcomes, on average resulting in an ≈ 8% advantage (success rate difference; SRD) over standard care. CSTs are particularly effective for not-on-track patients (SRD between ≈ 20% and 29%), but ROM does not work for all patients and successful implementation is a major challenge, along with securing appropriate cultural adaptations.CONCLUSIONROM offers a low-cost method for enhancing patient outcomes, on average resulting in an ≈ 8% advantage (success rate difference; SRD) over standard care. CSTs are particularly effective for not-on-track patients (SRD between ≈ 20% and 29%), but ROM does not work for all patients and successful implementation is a major challenge, along with securing appropriate cultural adaptations. To provide a research review of the components and outcomes of routine outcome monitoring (ROM) and recommendations for research and therapeutic practice. A narrative review of the three phases of ROM - data collection, feeding back data, and adapting therapy - and an overview of patient outcomes from 11 meta-analytic studies. Patients support ROM when its purpose is clear and integrated within therapy. Greater frequency of data collection is more important for shorter-term therapies, and use of graphs, greater specificity of feedback, and alerts are helpful. Overall effects on patient outcomes are statistically significant ( ≈ 0.15) and increase when clinical support tools (CSTs) are used for not-on-track cases ( ≈ 0.36-0.53). Effects are additive to standard effects of psychological therapies. Organizational, personnel, and resource issues remain the greatest obstacles to the successful adoption of ROM. ROM offers a low-cost method for enhancing patient outcomes, on average resulting in an ≈ 8% advantage (success rate difference; SRD) over standard care. CSTs are particularly effective for not-on-track patients (SRD between ≈ 20% and 29%), but ROM does not work for all patients and successful implementation is a major challenge, along with securing appropriate cultural adaptations. ObjectiveTo provide a research review of the components and outcomes of routine outcome monitoring (ROM) and recommendations for research and therapeutic practice.MethodA narrative review of the three phases of ROM – data collection, feeding back data, and adapting therapy – and an overview of patient outcomes from 11 meta-analytic studies.ResultsPatients support ROM when its purpose is clear and integrated within therapy. Greater frequency of data collection is more important for shorter-term therapies, and use of graphs, greater specificity of feedback, and alerts are helpful. Overall effects on patient outcomes are statistically significant (g ≈ 0.15) and increase when clinical support tools (CSTs) are used for not-on-track cases (g ≈ 0.36–0.53). Effects are additive to standard effects of psychological therapies. Organizational, personnel, and resource issues remain the greatest obstacles to the successful adoption of ROM.ConclusionROM offers a low-cost method for enhancing patient outcomes, on average resulting in an ≈ 8% advantage (success rate difference; SRD) over standard care. CSTs are particularly effective for not-on-track patients (SRD between ≈ 20% and 29%), but ROM does not work for all patients and successful implementation is a major challenge, along with securing appropriate cultural adaptations. To provide a research review of the components and outcomes of routine outcome monitoring (ROM) and recommendations for research and therapeutic practice. A narrative review of the three phases of ROM - data collection, feeding back data, and adapting therapy - and an overview of patient outcomes from 11 meta-analytic studies. Patients support ROM when its purpose is clear and integrated within therapy. Greater frequency of data collection is more important for shorter-term therapies, and use of graphs, greater specificity of feedback, and alerts are helpful. Overall effects on patient outcomes are statistically significant (g ≈ 0.15) and increase when clinical support tools (CSTs) are used for not-on-track cases (g ≈ 0.36-0.53). Effects are additive to standard effects of psychological therapies. Organizational, personnel, and resource issues remain the greatest obstacles to the successful adoption of ROM. ROM offers a low-cost method for enhancing patient outcomes, on average resulting in an ≈ 8% advantage (success rate difference; SRD) over standard care. CSTs are particularly effective for not-on-track patients (SRD between ≈ 20% and 29%), but ROM does not work for all patients and successful implementation is a major challenge, along with securing appropriate cultural adaptations.
Author	Barkham, Michael De Jong, Kim Delgadillo, Jaime Lutz, Wolfgang
Author_xml	– sequence: 1 givenname: Michael orcidid: 0000-0003-1687-6376 surname: Barkham fullname: Barkham, Michael email: m.barkham@sheffield.ac.uk organization: University of Sheffield – sequence: 2 givenname: Kim orcidid: 0000-0002-7621-9290 surname: De Jong fullname: De Jong, Kim organization: Leiden University – sequence: 3 givenname: Jaime orcidid: 0000-0001-5349-230X surname: Delgadillo fullname: Delgadillo, Jaime organization: University of Sheffield – sequence: 4 givenname: Wolfgang orcidid: 0000-0002-5141-3847 surname: Lutz fullname: Lutz, Wolfgang organization: University of Trier
BackLink	https://www.ncbi.nlm.nih.gov/pubmed/36931228$$D View this record in MEDLINE/PubMed
BookMark	eNqFkUtP3DAUha0KVGDoTyiK1A0sMlzbycShGxAqDwk0UtSuLce5aQ2JTW0HxL-vh5nZsKArX8nfOfdxDsiOdRYJ-UphTkHAKYUSOIdqzoDxOaOCUlp8Ivu0WIi84ILupDox-QraIwchPADQSgB8Jnt8UXPKmNgnTeOmaCxmyylqN2J276yJzhv7OztulvcnmbJddoXYtUo_nmUNBlRe_0nFs8GXt98Gk3JE26lonA2HZLdXQ8Avm3dGfl39-Hl5k98tr28vL-5yXUIVcy3aPrkKqGtKRckVUBSt4KVgQrSalxyg50JXiKqqioWq-7agrCt6VKprGZ-R47Xvk3d_JwxRjiZoHAZl0U1BMsHSxguoV-i3d-iDm7xN0yWqKOuKinTMGTnaUFM7YiefvBmVf5XbayXg-xrQ3oXgsZfaxLelo1dmkBTkKhu5zUauspGbbJK6fKfeNvif7nytM7Z3flQvzg-djOp1cL73ymoTJP_Y4h9pS6KS
CitedBy_id	crossref_primary_10_1007_s10488_023_01340_4 crossref_primary_10_1002_cpp_70060 crossref_primary_10_1007_s10608_025_10663_5 crossref_primary_10_1007_s11136_024_03749_2 crossref_primary_10_1080_10503307_2024_2328304 crossref_primary_10_1055_a_2382_7598 crossref_primary_10_1007_s10488_024_01389_9 crossref_primary_10_1016_j_copsyc_2024_101958 crossref_primary_10_1177_17456916231226308 crossref_primary_10_3389_fdgth_2024_1387139 crossref_primary_10_1007_s10488_024_01426_7 crossref_primary_10_1080_10826084_2024_2447437 crossref_primary_10_1111_dar_14007 crossref_primary_10_1080_10503307_2025_2465432 crossref_primary_10_32872_cpe_11971 crossref_primary_10_32872_cpe_12421 crossref_primary_10_1007_s00278_023_00699_x crossref_primary_10_1002_wps_21342 crossref_primary_10_1080_10503307_2024_2320331 crossref_primary_10_3389_fpubh_2025_1557029 crossref_primary_10_1007_s10488_023_01314_6 crossref_primary_10_1080_10503307_2023_2283528 crossref_primary_10_1002_wps_21303 crossref_primary_10_1016_j_jad_2025_119839 crossref_primary_10_3389_fdgth_2025_1638539 crossref_primary_10_1038_s41598_025_14923_y crossref_primary_10_1111_dar_14095 crossref_primary_10_1186_s12888_025_06897_y crossref_primary_10_1111_hex_14137 crossref_primary_10_1007_s10862_024_10182_9 crossref_primary_10_1111_dar_13962 crossref_primary_10_1038_s44159_025_00472_8 crossref_primary_10_1186_s40337_025_01290_2 crossref_primary_10_1055_a_2517_2349 crossref_primary_10_1007_s10488_024_01402_1 crossref_primary_10_1002_cpp_70015 crossref_primary_10_1016_j_ijmedinf_2024_105485 crossref_primary_10_1002_capr_12799 crossref_primary_10_1007_s00278_023_00703_4 crossref_primary_10_1007_s10488_024_01348_4 crossref_primary_10_1080_28367138_2024_2444883 crossref_primary_10_1111_1467_6427_12485 crossref_primary_10_1038_s41390_023_02918_2 crossref_primary_10_1007_s41347_025_00532_z crossref_primary_10_1080_10503307_2024_2310635 crossref_primary_10_18863_pgy_1414793 crossref_primary_10_1007_s11136_024_03844_4 crossref_primary_10_1055_a_2589_1965 crossref_primary_10_1080_10503307_2025_2553636 crossref_primary_10_1016_j_brat_2023_104443 crossref_primary_10_1002_wps_21204 crossref_primary_10_1002_wps_21326 crossref_primary_10_1007_s10488_024_01350_w crossref_primary_10_1055_a_2426_9877 crossref_primary_10_1007_s10488_024_01351_9 crossref_primary_10_1177_10443894251345187 crossref_primary_10_2196_63234 crossref_primary_10_1007_s10488_023_01330_6 crossref_primary_10_1080_16506073_2024_2368520 crossref_primary_10_1080_10503307_2025_2485154 crossref_primary_10_1038_s43856_024_00626_4 crossref_primary_10_1159_000539022 crossref_primary_10_1016_j_jpsychires_2025_03_046 crossref_primary_10_1007_s10488_024_01403_0 crossref_primary_10_1016_j_jaac_2023_11_010 crossref_primary_10_1007_s10488_024_01381_3 crossref_primary_10_1016_j_drugpo_2025_104744 crossref_primary_10_18863_pgy_1518900 crossref_primary_10_32872_cpe_11967 crossref_primary_10_1007_s10488_025_01455_w crossref_primary_10_1016_j_copsyc_2025_102110 crossref_primary_10_1016_j_brat_2025_104691 crossref_primary_10_1038_s41598_024_52803_z crossref_primary_10_1007_s10488_023_01304_8 crossref_primary_10_1080_13284207_2024_2347648 crossref_primary_10_1002_capr_12694 crossref_primary_10_1002_cpp_2939 crossref_primary_10_1111_jmft_12702 crossref_primary_10_1177_20552076241260513
Cites_doi	10.1037/gdn0000026 10.1080/13691457.2019.1602029 10.1007/s10862-009-9142-4 10.1037/pst0000026 10.1111/bjc.12322 10.1037/pro0000203 10.1136/bmjqs-2013-002524 10.1007/s11136-020-02550-1 10.1111/jep.13457 10.1016/j.brat.2021.103873 10.1007/s11136-021-02825-1 10.1037/ccp0000642 10.1017/S1754470X15000598 10.1521/pedi_2017_31_297 10.1192/bjp.bp.108.053967 10.1002/jclp.23408 10.1037/ccp0000549 10.1007/s10488-019-00968-5 10.1007/s10597-010-9307-3 10.1002/jclp.23345 10.1037/0022-006X.73.5.904 10.1080/10503307.2015.1053553 10.1177/1534650116668273 10.1111/papt.12400 10.1001/jamapsychiatry.2018.3329 10.1016/j.brat.2019.103438 10.1037/a0016062 10.1037/0003-066X.51.10.1059 10.1007/s00127-018-1589-8 10.1371/journal.pone.0019070 10.1037/tep0000298 10.1016/j.cpr.2021.102002 10.1007/s10488-022-01236-9 10.1097/CHI.0b013e3181825af8 10.1037/ccp0000747 10.1002/jclp.23319 10.1080/08039488.2019.1642383 10.1016/j.cbpra.2013.04.002 10.1007/s10488-022-01194-2 10.1080/10503307.2013.787497 10.1037/a0019247 10.1037/ser0000347 10.1080/10503307.2021.2015637 10.1037/ser0000629 10.1016/j.jsat.2011.09.003 10.1080/10503307.2019.1630780 10.1080/10503307.2012.673023 10.1037/cap0000181 10.1037/pst0000439 10.1186/s12888-018-1838-0 10.1037/a0037659 10.1080/10503307.2015.1009862 10.1016/S2589-7500(21)00018-2 10.1007/s10566-020-09574-1 10.3109/09540261.2014.977234 10.1080/10503307.2021.1930244 10.1007/s10488-014-0600-2 10.1007/s10488-015-0710-5 10.1016/S2215-0366(20)30488-0 10.1186/s12888-016-0811-z 10.1177/0011000005285875 10.1016/j.brat.2015.11.004 10.1007/s10488-016-0763-0 10.1111/papt.12032 10.1093/clipsy.bpg025 10.1080/10503307.2022.2141589 10.1016/j.socscimed.2021.113818 10.1002/jclp.20108 10.1159/000503765 10.1146/annurev-clinpsy-071720-014821 10.1037/12141-000 10.1002/mpr.1411 10.3389/fpsyg.2016.00604 10.1002/jclp.22529 10.1146/annurev-clinpsy-050817-084833 10.1007/s10488-014-0587-8 10.1037/tep0000148 10.1080/10503307.2020.1776413 10.1007/s11136-018-1968-3 10.2466/02.07.17.PR0.110.2.639-644 10.1037/0003-066X.61.4.271 10.1080/10503307.2017.1326645 10.1111/j.1365-2753.2010.01543.x 10.1037/ccp0000277 10.1176/appi.ps.201400141 10.1007/s11136-020-02664-6 10.1080/10503307.2013.817696 10.1037/cou0000420 10.7249/RR3078 10.1186/s41687-018-0061-6 10.1037/cou0000286 10.1037/11281-000 10.1002/jclp.20107 10.3102/0013189X20912798 10.1037/pst0000167 10.1080/10503307.2018.1517949 10.1016/j.cpr.2017.04.005
ContentType	Journal Article
Copyright	2023 The Author(s). Published by Informa UK Limited, trading as Taylor & Francis Group 2023 2023 The Author(s). Published by Informa UK Limited, trading as Taylor & Francis Group. This work is licensed under the Creative Commons Attribution License http://creativecommons.org/licenses/by/4.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.
Copyright_xml	– notice: 2023 The Author(s). Published by Informa UK Limited, trading as Taylor & Francis Group 2023 – notice: 2023 The Author(s). Published by Informa UK Limited, trading as Taylor & Francis Group. This work is licensed under the Creative Commons Attribution License http://creativecommons.org/licenses/by/4.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.
DBID	0YH AAYXX CITATION NPM 8BJ FQK JBE 7X8
DOI	10.1080/10503307.2023.2181114
DatabaseName	Taylor & Francis Open Access CrossRef PubMed International Bibliography of the Social Sciences (IBSS) International Bibliography of the Social Sciences International Bibliography of the Social Sciences MEDLINE - Academic
DatabaseTitle	CrossRef PubMed International Bibliography of the Social Sciences (IBSS) MEDLINE - Academic
DatabaseTitleList	MEDLINE - Academic PubMed International Bibliography of the Social Sciences (IBSS)
Database_xml	– sequence: 1 dbid: NPM name: PubMed url: http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed sourceTypes: Index Database – sequence: 2 dbid: 0YH name: Taylor & Francis Open Access url: https://www.tandfonline.com sourceTypes: Publisher – sequence: 3 dbid: 7X8 name: MEDLINE - Academic url: https://search.proquest.com/medline sourceTypes: Aggregation Database
DeliveryMethod	fulltext_linktorsrc
EISSN	1468-4381
EndPage	855
ExternalDocumentID	36931228 10_1080_10503307_2023_2181114 2181114
Genre	Research Article Journal Article
GroupedDBID	--- .7I .QK 0BK 0R~ 0YH 123 29P 2DF 4.4 53G 5VS AAGDL AAGZJ AAHIA AAMFJ AAMIU AAPUL AATTQ AAZMC ABCCY ABDBF ABFIM ABIVO ABJNI ABLIJ ABLJU ABPEM ABTAI ABXUL ABXYU ABZLS ACGEJ ACGFO ACGFS ACGOD ACHQT ACTIO ACTOA ACUHS ADAHI ADCVX ADKVQ ADXPE AECIN AEFOU AEGXH AEISY AEKEX AEMXT AEOZL AEPSL AEYOC AEZRU AFRVT AGDLA AGMYJ AGRBW AHDZW AIAGR AIJEM AIYEW AJWEG AKBVH ALMA_UNASSIGNED_HOLDINGS ALQZU AQTUD AVBZW AWYRJ BEJHT BLEHA BMOTO BOHLJ CCCUG CQ1 CS3 DGFLZ DKSSO DU5 EBD EBS EMOBN ESX E~B E~C F5P G-F GTTXZ H13 HF~ HZ~ IPNFZ J.O KYCEM LJTGL M4Z NA5 NW- O9- P2P PQQKQ RIG RNANH ROSJB RSYQP RWL S-F STATR SV3 TAE TASJS TBQAZ TDBHL TEH TFH TFL TFW TNJ TNTFI TRJHH TUROJ TUS UT5 UT9 VAE WH7 ~01 ~S~ AAYXX CITATION 07M 1TA 4B3 9M8 AACLK AAIFK AASXD AAYMM ABGQD ABITY ABLUQ ABYAV ACIKQ ACVBB ADDRM ADYSH AEBKF AFLWG AFUSO BTBAK C5A CAG CKOZC COF C~T DAOCQ DEWOD DTEEQ DYOWO EJD JEUJS L7Y NPM PNGSA PPYGK RNI ROL RZO TBH THLUP UA1 8BJ FQK JBE 7X8
ID	FETCH-LOGICAL-c507t-c8bfedb809911853a01e8b8358288bc35300f38c7eea7746a9fb412d4feaadb23
IEDL.DBID	0YH
ISICitedReferencesCount	107
ISICitedReferencesURI	http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000952461800001&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
ISSN	1050-3307 1468-4381
IngestDate	Thu Oct 02 12:09:26 EDT 2025 Fri Nov 14 18:45:30 EST 2025 Mon Jul 21 05:56:54 EDT 2025 Sat Nov 29 04:59:39 EST 2025 Tue Nov 18 21:41:10 EST 2025 Mon Oct 20 23:45:21 EDT 2025
IsDoiOpenAccess	true
IsOpenAccess	true
IsPeerReviewed	true
IsScholarly	true
Issue	7
Keywords	feedback ROM measurement-based care clinical support tools deterioration outcome measures psychotherapy outcome routine outcome monitoring
Language	English
License	open-access: http://creativecommons.org/licenses/by/4.0/: This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. The terms on which this article has been published allow the posting of the Accepted Manuscript in a repository by the author(s) or with their consent.
LinkModel	DirectLink
MergedId	FETCHMERGED-LOGICAL-c507t-c8bfedb809911853a01e8b8358288bc35300f38c7eea7746a9fb412d4feaadb23
Notes	ObjectType-Article-1 SourceType-Scholarly Journals-1 ObjectType-Feature-2 content type line 14 ObjectType-Article-2 ObjectType-Feature-3 content type line 23 ObjectType-Review-1
ORCID	0000-0002-7621-9290 0000-0001-5349-230X 0000-0002-5141-3847 0000-0003-1687-6376
OpenAccessLink	https://www.tandfonline.com/doi/abs/10.1080/10503307.2023.2181114
PMID	36931228
PQID	2845971803
PQPubID	31397
PageCount	15
ParticipantIDs	proquest_miscellaneous_2820016092 pubmed_primary_36931228 crossref_primary_10_1080_10503307_2023_2181114 proquest_journals_2845971803 crossref_citationtrail_10_1080_10503307_2023_2181114 informaworld_taylorfrancis_310_1080_10503307_2023_2181114
PublicationCentury	2000
PublicationDate	2023-10-03
PublicationDateYYYYMMDD	2023-10-03
PublicationDate_xml	– month: 10 year: 2023 text: 2023-10-03 day: 03
PublicationDecade	2020
PublicationPlace	England
PublicationPlace_xml	– name: England – name: Abingdon
PublicationTitle	Psychotherapy research
PublicationTitleAlternate	Psychother Res
PublicationYear	2023
Publisher	Routledge Taylor & Francis Ltd
Publisher_xml	– name: Routledge – name: Taylor & Francis Ltd
References	CIT0072 CIT0071 CIT0074 CIT0073 CIT0076 CIT0075 CIT0078 CIT0111 CIT0077 CIT0110 Lutz W. (CIT0070) 2021 CIT0113 CIT0079 CIT0112 CIT0083 CIT0082 CIT0085 CIT0084 CIT0087 CIT0086 CIT0001 CIT0088 Castonguay L. G. (CIT0025) 2013 CIT0081 Kendrick T. (CIT0055) 2016; 7 CIT0003 Lutz W. (CIT0069) 2023 CIT0002 CIT0005 CIT0004 Bugatti M. (CIT0022) 2022 CIT0006 Rousmaniere T. (CIT0089) 2017 CIT0009 CIT0008 CIT0094 CIT0093 CIT0096 CIT0095 CIT0098 CIT0097 CIT0012 CIT0099 CIT0090 CIT0092 CIT0091 CIT0014 CIT0013 CIT0016 CIT0015 CIT0018 CIT0017 CIT0019 CIT0021 CIT0020 CIT0023 Bergman H. (CIT0010) 2018; 8 CIT0024 CIT0027 CIT0026 CIT0029 CIT0028 CIT0030 CIT0032 CIT0034 CIT0033 Duncan B. L. (CIT0039) 2003; 3 CIT0036 CIT0035 CIT0038 CIT0041 CIT0040 CIT0043 CIT0042 CIT0045 CIT0044 CIT0047 CIT0046 CIT0049 CIT0048 Drapeau M. (CIT0037) 2012; 2 CIT0050 Barkham M. (CIT0007) 2021 CIT0052 Miller S. D. (CIT0080) 2003; 2 De Jong K. (CIT0031) 2023 CIT0051 CIT0054 CIT0053 CIT0056 Bertolino B. (CIT0011) 2012 CIT0058 CIT0057 Lambert M. J. (CIT0062) 2015 CIT0059 CIT0061 CIT0060 CIT0065 CIT0064 CIT0067 CIT0100 CIT0066 CIT0109 Lambert M. J. (CIT0063) 2013 CIT0102 CIT0068 CIT0101 CIT0104 CIT0103 CIT0106 CIT0105 CIT0108 CIT0107
References_xml	– ident: CIT0098 doi: 10.1037/gdn0000026 – ident: CIT0075 doi: 10.1080/13691457.2019.1602029 – start-page: 89 volume-title: Bergin and Garfield’s handbook of psychotherapy and behavior change year: 2021 ident: CIT0070 – ident: CIT0051 doi: 10.1007/s10862-009-9142-4 – ident: CIT0040 doi: 10.1037/pst0000026 – ident: CIT0008 doi: 10.1111/bjc.12322 – volume-title: Clinical support tool manual (brief version-40) year: 2015 ident: CIT0062 – ident: CIT0087 doi: 10.1037/pro0000203 – ident: CIT0019 doi: 10.1136/bmjqs-2013-002524 – ident: CIT0100 doi: 10.1007/s11136-020-02550-1 – ident: CIT0109 doi: 10.1111/jep.13457 – ident: CIT0035 doi: 10.1016/j.brat.2021.103873 – ident: CIT0076 doi: 10.1007/s11136-021-02825-1 – ident: CIT0068 doi: 10.1037/ccp0000642 – ident: CIT0106 doi: 10.1017/S1754470X15000598 – ident: CIT0032 doi: 10.1521/pedi_2017_31_297 – ident: CIT0057 doi: 10.1192/bjp.bp.108.053967 – volume-title: Administration and scoring manual: Outcome questionnaire OQ®-45.2 year: 2013 ident: CIT0063 – ident: CIT0036 doi: 10.1002/jclp.23408 – ident: CIT0053 doi: 10.1037/ccp0000549 – ident: CIT0090 doi: 10.1007/s10488-019-00968-5 – ident: CIT0067 doi: 10.1007/s10597-010-9307-3 – ident: CIT0082 doi: 10.1002/jclp.23345 – ident: CIT0071 doi: 10.1037/0022-006X.73.5.904 – ident: CIT0072 doi: 10.1080/10503307.2015.1053553 – ident: CIT0058 doi: 10.1177/1534650116668273 – ident: CIT0044 doi: 10.1111/papt.12400 – ident: CIT0066 doi: 10.1001/jamapsychiatry.2018.3329 – volume: 3 start-page: 3 issue: 1 year: 2003 ident: CIT0039 publication-title: Journal of Brief Therapy – ident: CIT0073 doi: 10.1016/j.brat.2019.103438 – volume-title: ICCE manuals on feedback-informed treatment (Vol. 1–6) year: 2012 ident: CIT0011 – volume-title: Deliberate practice for psychotherapists: A guide to improving clinical effectiveness year: 2017 ident: CIT0089 – ident: CIT0003 doi: 10.1037/a0016062 – ident: CIT0052 doi: 10.1037/0003-066X.51.10.1059 – ident: CIT0079 doi: 10.1007/s00127-018-1589-8 – ident: CIT0045 doi: 10.1371/journal.pone.0019070 – ident: CIT0027 doi: 10.1037/tep0000298 – ident: CIT0030 doi: 10.1016/j.cpr.2021.102002 – ident: CIT0088 doi: 10.1007/s10488-022-01236-9 – ident: CIT0012 doi: 10.1097/CHI.0b013e3181825af8 – ident: CIT0034 doi: 10.1037/ccp0000747 – ident: CIT0091 doi: 10.1002/jclp.23319 – ident: CIT0013 doi: 10.1080/08039488.2019.1642383 – volume-title: Becoming better therapists: Advancing training and supervision in psychotherapy year: 2023 ident: CIT0069 – ident: CIT0009 doi: 10.1016/j.cbpra.2013.04.002 – ident: CIT0050 doi: 10.1007/s10488-022-01194-2 – ident: CIT0097 doi: 10.1080/10503307.2013.787497 – ident: CIT0096 doi: 10.1037/a0019247 – ident: CIT0113 doi: 10.1037/ser0000347 – ident: CIT0018 doi: 10.1080/10503307.2021.2015637 – ident: CIT0004 doi: 10.1037/ser0000629 – start-page: 1 year: 2022 ident: CIT0022 publication-title: Psychotherapy Research – ident: CIT0028 doi: 10.1016/j.jsat.2011.09.003 – ident: CIT0015 doi: 10.1080/10503307.2019.1630780 – start-page: 85 volume-title: Bergin and Garfield’s handbook of psychotherapy and behavior change year: 2013 ident: CIT0025 – ident: CIT0033 doi: 10.1080/10503307.2012.673023 – ident: CIT0104 doi: 10.1037/cap0000181 – ident: CIT0016 doi: 10.1037/pst0000439 – ident: CIT0056 doi: 10.1186/s12888-018-1838-0 – ident: CIT0101 doi: 10.1037/a0037659 – ident: CIT0111 doi: 10.1080/10503307.2015.1009862 – ident: CIT0014 doi: 10.1016/S2589-7500(21)00018-2 – ident: CIT0108 doi: 10.1007/s10566-020-09574-1 – ident: CIT0023 doi: 10.3109/09540261.2014.977234 – ident: CIT0081 doi: 10.1080/10503307.2021.1930244 – volume-title: Routine outcome monitoring and feedback in psychological therapies year: 2023 ident: CIT0031 – ident: CIT0105 – ident: CIT0041 doi: 10.1007/s10488-014-0600-2 – ident: CIT0046 doi: 10.1007/s10488-015-0710-5 – ident: CIT0005 doi: 10.1016/S2215-0366(20)30488-0 – ident: CIT0107 doi: 10.1186/s12888-016-0811-z – ident: CIT0001 doi: 10.1177/0011000005285875 – ident: CIT0085 doi: 10.1016/j.brat.2015.11.004 – ident: CIT0054 doi: 10.1007/s10488-016-0763-0 – ident: CIT0029 doi: 10.1111/papt.12032 – ident: CIT0064 doi: 10.1093/clipsy.bpg025 – volume: 2 start-page: 1 year: 2012 ident: CIT0037 publication-title: Integrating Science and Practice – ident: CIT0006 doi: 10.1080/10503307.2022.2141589 – volume: 7 start-page: CD011119 issue: 7 year: 2016 ident: CIT0055 publication-title: The Cochrane Database of Systematic Reviews – ident: CIT0038 doi: 10.1016/j.socscimed.2021.113818 – start-page: 135 volume-title: Bergin and Garfield’s handbook of psychotherapy and behavior change year: 2021 ident: CIT0007 – ident: CIT0048 doi: 10.1002/jclp.20108 – ident: CIT0095 doi: 10.1159/000503765 – ident: CIT0074 doi: 10.1146/annurev-clinpsy-071720-014821 – ident: CIT0061 doi: 10.1037/12141-000 – ident: CIT0042 doi: 10.1002/mpr.1411 – ident: CIT0093 doi: 10.3389/fpsyg.2016.00604 – ident: CIT0112 doi: 10.1002/jclp.22529 – ident: CIT0026 doi: 10.1146/annurev-clinpsy-050817-084833 – ident: CIT0078 doi: 10.1007/s10488-014-0587-8 – ident: CIT0086 doi: 10.1037/tep0000148 – volume: 2 start-page: 91 issue: 2 year: 2003 ident: CIT0080 publication-title: Journal of Brief Therapy – ident: CIT0021 doi: 10.1080/10503307.2020.1776413 – ident: CIT0102 doi: 10.1007/s11136-018-1968-3 – ident: CIT0110 doi: 10.2466/02.07.17.PR0.110.2.639-644 – ident: CIT0002 doi: 10.1037/0003-066X.61.4.271 – ident: CIT0099 doi: 10.1080/10503307.2017.1326645 – ident: CIT0024 doi: 10.1111/j.1365-2753.2010.01543.x – ident: CIT0043 doi: 10.1037/ccp0000277 – ident: CIT0060 doi: 10.1176/appi.ps.201400141 – ident: CIT0094 doi: 10.1007/s11136-020-02664-6 – ident: CIT0017 doi: 10.1080/10503307.2013.817696 – ident: CIT0084 doi: 10.1037/cou0000420 – ident: CIT0049 doi: 10.7249/RR3078 – ident: CIT0047 doi: 10.1186/s41687-018-0061-6 – ident: CIT0020 doi: 10.1037/cou0000286 – ident: CIT0077 doi: 10.1037/11281-000 – ident: CIT0092 doi: 10.1002/jclp.20107 – ident: CIT0059 doi: 10.3102/0013189X20912798 – ident: CIT0065 doi: 10.1037/pst0000167 – ident: CIT0083 doi: 10.1080/10503307.2018.1517949 – ident: CIT0103 doi: 10.1016/j.cpr.2017.04.005 – volume: 8 start-page: CD011729 year: 2018 ident: CIT0010 publication-title: Cochrane Database of Systematic Reviews
SSID	ssj0017800
Score	2.6248229
SecondaryResourceType	review_article
Snippet	To provide a research review of the components and outcomes of routine outcome monitoring (ROM) and recommendations for research and therapeutic practice. A... ObjectiveTo provide a research review of the components and outcomes of routine outcome monitoring (ROM) and recommendations for research and therapeutic... To provide a research review of the components and outcomes of routine outcome monitoring (ROM) and recommendations for research and therapeutic...
SourceID	proquest pubmed crossref informaworld
SourceType	Aggregation Database Index Database Enrichment Source Publisher
StartPage	841
SubjectTerms	Clinical outcomes clinical support tools Data collection deterioration Feedback Graphs measurement-based care Medical treatment outcome measures Patients psychotherapy outcome ROM routine outcome monitoring Therapy Treatment methods
Title	Routine Outcome Monitoring (ROM) and Feedback: Research Review and Recommendations
URI	https://www.tandfonline.com/doi/abs/10.1080/10503307.2023.2181114 https://www.ncbi.nlm.nih.gov/pubmed/36931228 https://www.proquest.com/docview/2845971803 https://www.proquest.com/docview/2820016092
Volume	33
WOSCitedRecordID	wos000952461800001&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
hasFullText	1
inHoldings	1
isFullTextHit
isPrint
journalDatabaseRights	– providerCode: PRVAWR databaseName: Taylor & Francis Online Journals customDbUrl: eissn: 1468-4381 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0017800 issn: 1050-3307 databaseCode: TFW dateStart: 19910701 isFulltext: true titleUrlDefault: https://www.tandfonline.com providerName: Taylor & Francis
link	http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwrR3LTsMwLELAgQsP8SoMFCQOcNjUJGVNuSHExAEGmoYYp8ppEwnBNkQ7vh-7TSc4IA5waVWldtM4ju3YsRk7jijpdoaamwMANFAgaUOkcgqmQorLLBamqlpyE_f7ejRK7n00YeHDKsmGdnWiiGqtJuYGUzQRcXgn31sYd6j0d4dklKBS1ksSTROyv8Kn67kjIdZhnZDgDJcbhGkO8fyE5pt4-pa89GcVtBJFvbV_-Il1tur1UH5RT5wNtmAnm2xA8UGIit_NSsRmec3xtPXHTwZ3t6ccP8d7KPAMZC_nvAnb47WHoWole3Y8tr5WU7HFHnpXw8vrti-60M5QNSzbmTYOsWjUHAXJcgiF1UbTgVqtTabOVBg6JG9sLaDq2IXEmUjIPHIWIDdSbbPFyXRidxkHG0YGhFFKiQhUrF03xykjQSTO5bIbsKgZ6zTzGcmpMMZrKnzi0maQUhqk1A9SwDpzsLc6JcdvAMlXQqZltRfi6sIlqfoFttVQPfXcXaQo0tEOEzpUATuaNyNfkrMFJnY6o3dkVcM7kQHbqWfLvLeqmyAfSL33h47tsxV6rOIKVYstlu8ze8CWs4_yuXg_rJgAr_FI43XYe_wEt3cAnw
linkProvider	Taylor & Francis
linkToHtml	http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwrR3LTsMwLEKABBce4jUYECQOcNjUNF2bckOIaYg9pGmI3aKkTSQE69DW8f3YfUzbYdoBTj2kdlM7ju3YsQm59bDodgSWm1VKgYOiwpryeIzJVMBxNwqYzrqWtINuVwyH4eJdGEyrRB_a5oUisr0ahRsPo8uUOHhi8M0J6tj7u45KimEv660G6Fqsnz9ovs8jCYFw8ooEDdhvAKa8xbMKzZJ-WqpeutoGzXRRc_8__uKA7BWWKH3Ml84h2TDJEeljhhDgor1ZCugMzWUeD__oXb_XuafwPdoEladV9PlAy8Q9mscYslH0aEcjU3Rrmh6Tt-bz4KlVK9ou1CIwDtNaJLQFLAJsR4baXDnMCC3wSq0QOuIN7jgWGBwYo8B49FVotcfc2LNGqVi7_IRsJuPEnBGqjONpxTTnnHmKB8L6MSwaV7HQ2tj1K8QriS2joiY5tsb4kqwoXVoSSSKRZEGkCqnPwb7zohzrAMJFTso0Ow2xeesSydfAVku2y0K-pxKUOnhiTDi8Qm7mwyCZGG5RiRnP8B036-IduhVymi-X-Wy5H4IkuOL8DxO7JjutQact2y_d1wuyi0NZliGvks10MjOXZDv6ST-mk6tMIn4BaoMCzw
linkToPdf	http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwrR3LTsMwLEIDIS48xKs8g8QBDpuaprQpNwRUIMaGEAhuUdImEoJtiHV8P3abTuww7QCnHlK7qWPHduzYhByHWHQ7A8vNKqXAQVFJU4U8x2QqWPEgi5kuu5a0405HvL4mDy6bcOjSKtGHtlWhiHKvRuH-zG2dEQdPjL35cQtbf7dQRzFsZT0PpnOETP6UvowDCbHwq4IEZ7DdAEx9iWcamgn1NFG8dLoJWqqidOUffmKVLDs7lF5UjLNG5kx_nTxifhCgot1RAdgMrSQej_7oyWP3_pTC52gKCk-r7P2c1ml7tIowlKPoz_Z6xvVqGm6Q5_T66fKm6ZouNDMwDYtmJrQFLAIsR4a6XPnMCC3wQq0QOuNn3PctLG9sjALTMVKJ1SEL8tAapXId8E3S6A_6ZptQZfxQK6Y55yxUPBY2yoFlAsUSa_Mg8khY01pmriI5Nsb4kMwVLq2JJJFI0hHJI60x2GdVkmMWQPJ7IWVRnoXYqnGJ5DNg9-pVl066hxJUOvhhTPjcI0fjYZBLDLaovhmM8J2g7OGdBB7ZqrhlPFseJSAHgdj5w8QOyeLDVSrbt527XbKEI2WKId8jjeJrZPbJQvZdvA2_Dkp5-AFNGAGB
openUrl	ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Routine+Outcome+Monitoring+%28ROM%29+and+Feedback%3A+Research+Review+and+Recommendations&rft.jtitle=Psychotherapy+research&rft.au=Barkham%2C+Michael&rft.au=Kim+De+Jong&rft.au=Delgadillo%2C+Jaime&rft.au=Lutz%2C+Wolfgang&rft.date=2023-10-03&rft.pub=Taylor+%26+Francis+Ltd&rft.issn=1050-3307&rft.eissn=1468-4381&rft.volume=33&rft.issue=7&rft.spage=841&rft.epage=855&rft_id=info:doi/10.1080%2F10503307.2023.2181114&rft.externalDBID=NO_FULL_TEXT
thumbnail_l	http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1050-3307&client=summon
thumbnail_m	http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1050-3307&client=summon
thumbnail_s	http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1050-3307&client=summon