Analyzing acoustic and prosodic fluctuations in free speech to predict psychosis onset in high-risk youths

The diagnosis and treatment of psychiatric disorders depends on the analysis of behavior through language by a clinical specialist. This analysis is subjective in nature and could benefit from automated, objective acoustic and linguistic processing methods. This integrated approach would convey a ri...

Full description

Saved in:
Bibliographic Details
Published in:Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference Vol. 2020; pp. 5575 - 5579
Main Authors: Agurto, Carla, Pietrowicz, Mary, Norel, Raquel, Eyigoz, Elif K., Stanislawski, Emma, Cecchi, Guillermo, Corcoran, Cheryl
Format: Conference Proceeding Journal Article
Language:English
Published: IEEE 01.07.2020
ISSN:2694-0604, 1558-4615, 2694-0604
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Abstract The diagnosis and treatment of psychiatric disorders depends on the analysis of behavior through language by a clinical specialist. This analysis is subjective in nature and could benefit from automated, objective acoustic and linguistic processing methods. This integrated approach would convey a richer representation of patient speech, particularly for expression of emotion. In this work, we explore the potential of acoustic and prosodic metrics to infer clinical variables and predict psychosis, a condition which produces measurable derailment and tangentiality in patient language. To that purpose, we analyzed the recordings of 32 young patients at high risk of developing clinical psychosis. The subjects were evaluated using the Structured Interview for Prodromal Syndromes/Scale of Prodromal Symptoms (SIPS/SOPS) criteria. To analyze the recordings, we examined the variation of different acoustic and prosodic metrics across time. This preliminary analysis shows that these features can infer negative symptom severity ratings (i.e., SIPS-Btotal), obtaining a Pearson correlation of 0.77 for all the subjects after cross-validated evaluation. In addition, these features can predict development of psychosis with high accuracy above 90%, outperforming classification using clinical variables only. This improved predictive power ultimately can help provide early treatment and improve quality of life for those at risk for developing psychosis.
AbstractList The diagnosis and treatment of psychiatric disorders depends on the analysis of behavior through language by a clinical specialist. This analysis is subjective in nature and could benefit from automated, objective acoustic and linguistic processing methods. This integrated approach would convey a richer representation of patient speech, particularly for expression of emotion. In this work, we explore the potential of acoustic and prosodic metrics to infer clinical variables and predict psychosis, a condition which produces measurable derailment and tangentiality in patient language. To that purpose, we analyzed the recordings of 32 young patients at high risk of developing clinical psychosis. The subjects were evaluated using the Structured Interview for Prodromal Syndromes/Scale of Prodromal Symptoms (SIPS/SOPS) criteria. To analyze the recordings, we examined the variation of different acoustic and prosodic metrics across time. This preliminary analysis shows that these features can infer negative symptom severity ratings (i.e., SIPS-Btotal), obtaining a Pearson correlation of 0.77 for all the subjects after cross-validated evaluation. In addition, these features can predict development of psychosis with high accuracy above 90%, outperforming classification using clinical variables only. This improved predictive power ultimately can help provide early treatment and improve quality of life for those at risk for developing psychosis.
The diagnosis and treatment of psychiatric disorders depends on the analysis of behavior through language by a clinical specialist. This analysis is subjective in nature and could benefit from automated, objective acoustic and linguistic processing methods. This integrated approach would convey a richer representation of patient speech, particularly for expression of emotion. In this work, we explore the potential of acoustic and prosodic metrics to infer clinical variables and predict psychosis, a condition which produces measurable derailment and tangentiality in patient language. To that purpose, we analyzed the recordings of 32 young patients at high risk of developing clinical psychosis. The subjects were evaluated using the Structured Interview for Prodromal Syndromes/Scale of Prodromal Symptoms (SIPS/SOPS) criteria. To analyze the recordings, we examined the variation of different acoustic and prosodic metrics across time. This preliminary analysis shows that these features can infer negative symptom severity ratings (i.e., SIPS-Btotal), obtaining a Pearson correlation of 0.77 for all the subjects after cross-validated evaluation. In addition, these features can predict development of psychosis with high accuracy above 90%, outperforming classification using clinical variables only. This improved predictive power ultimately can help provide early treatment and improve quality of life for those at risk for developing psychosis.The diagnosis and treatment of psychiatric disorders depends on the analysis of behavior through language by a clinical specialist. This analysis is subjective in nature and could benefit from automated, objective acoustic and linguistic processing methods. This integrated approach would convey a richer representation of patient speech, particularly for expression of emotion. In this work, we explore the potential of acoustic and prosodic metrics to infer clinical variables and predict psychosis, a condition which produces measurable derailment and tangentiality in patient language. To that purpose, we analyzed the recordings of 32 young patients at high risk of developing clinical psychosis. The subjects were evaluated using the Structured Interview for Prodromal Syndromes/Scale of Prodromal Symptoms (SIPS/SOPS) criteria. To analyze the recordings, we examined the variation of different acoustic and prosodic metrics across time. This preliminary analysis shows that these features can infer negative symptom severity ratings (i.e., SIPS-Btotal), obtaining a Pearson correlation of 0.77 for all the subjects after cross-validated evaluation. In addition, these features can predict development of psychosis with high accuracy above 90%, outperforming classification using clinical variables only. This improved predictive power ultimately can help provide early treatment and improve quality of life for those at risk for developing psychosis.
Author Norel, Raquel
Stanislawski, Emma
Corcoran, Cheryl
Cecchi, Guillermo
Pietrowicz, Mary
Agurto, Carla
Eyigoz, Elif K.
Author_xml – sequence: 1
  givenname: Carla
  surname: Agurto
  fullname: Agurto, Carla
  organization: Computational Biology Center,T.J. Watson IBM Research Laboratory,New York
– sequence: 2
  givenname: Mary
  surname: Pietrowicz
  fullname: Pietrowicz, Mary
  organization: Computational Biology Center,T.J. Watson IBM Research Laboratory,New York
– sequence: 3
  givenname: Raquel
  surname: Norel
  fullname: Norel, Raquel
  organization: Computational Biology Center,T.J. Watson IBM Research Laboratory,New York
– sequence: 4
  givenname: Elif K.
  surname: Eyigoz
  fullname: Eyigoz, Elif K.
  organization: Computational Biology Center,T.J. Watson IBM Research Laboratory,New York
– sequence: 5
  givenname: Emma
  surname: Stanislawski
  fullname: Stanislawski, Emma
  organization: Icahn School of Medicine at Mount Sinai,Department of Psychiatry
– sequence: 6
  givenname: Guillermo
  surname: Cecchi
  fullname: Cecchi, Guillermo
  organization: Computational Biology Center,T.J. Watson IBM Research Laboratory,New York
– sequence: 7
  givenname: Cheryl
  surname: Corcoran
  fullname: Corcoran, Cheryl
  organization: Icahn School of Medicine at Mount Sinai and Bronx VA MIRECC,Department of Psychiatry
BookMark eNotkMtOwzAQRQ0qEm3hC5CQl2xSbMd2nGWpykMqYgPryHEmjUvqhNhZhK_HqF3NHenMlc4s0Mx1DhC6p2RFKckft-9PG85jWjHCyCqnmVScXqAFzZiiNM8JvURzKoRKuKRihuZM5jwhkvBrtPD-QOIZEXSODmun2-nXuj3Wpht9sAZrV-F-6HxXxaVuRxNGHWznPLYO1wMA9j2AaXDoIgeRCrj3k2k6bz2OHIR_srH7Jhms_8ZTN4bG36CrWrcebs9zib6et5-b12T38fK2We8SyxQPCaREl4KDASUZiSqKyYxGvbIUSpBKAOSG5VWtlcpKXSrNhEllVYKQFdNZukQPp97o8DOCD8XRegNtqx1Ew4JxrhRnNKURvTuhFgCKfrBHPUzF-Z3pHywda8I
ContentType Conference Proceeding
Journal Article
DBID 6IE
6IH
CBEJK
ESBDL
RIE
RIO
7X8
DOI 10.1109/EMBC44109.2020.9176841
DatabaseName IEEE Electronic Library (IEL) Conference Proceedings
IEEE Proceedings Order Plan (POP) 1998-present by volume
IEEE Xplore All Conference Proceedings
IEEE Xplore Open Access Journals
IEEE Electronic Library (IEL)
IEEE Proceedings Order Plans (POP) 1998-present
MEDLINE - Academic
DatabaseTitle MEDLINE - Academic
DatabaseTitleList
MEDLINE - Academic
Database_xml – sequence: 1
  dbid: RIE
  name: IEEE Electronic Library (IEL)
  url: https://ieeexplore.ieee.org/
  sourceTypes: Publisher
– sequence: 2
  dbid: 7X8
  name: MEDLINE - Academic
  url: https://search.proquest.com/medline
  sourceTypes: Aggregation Database
DeliveryMethod fulltext_linktorsrc
Discipline Engineering
EISBN 1728119901
9781728119908
EISSN 1558-4615
2694-0604
EndPage 5579
ExternalDocumentID 9176841
Genre orig-research
GroupedDBID 6IE
6IF
6IH
AAJGR
ACGFS
AFFNX
ALMA_UNASSIGNED_HOLDINGS
CBEJK
ESBDL
M43
RIE
RIO
RNS
7X8
ID FETCH-LOGICAL-i284t-e30ab54ece862099082671841bb5850d5ee9c29dfa887bab8a25c36dbe56d2a73
IEDL.DBID RIE
ISICitedReferencesCount 22
ISICitedReferencesURI http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000621592205213&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
ISSN 2694-0604
IngestDate Wed Oct 01 10:24:26 EDT 2025
Wed Aug 27 02:33:48 EDT 2025
IsDoiOpenAccess true
IsOpenAccess true
IsPeerReviewed true
IsScholarly true
Language English
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-i284t-e30ab54ece862099082671841bb5850d5ee9c29dfa887bab8a25c36dbe56d2a73
Notes ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 23
OpenAccessLink https://ieeexplore.ieee.org/document/9176841
PQID 2448842131
PQPubID 23479
PageCount 5
ParticipantIDs proquest_miscellaneous_2448842131
ieee_primary_9176841
PublicationCentury 2000
PublicationDate 2020-07-01
PublicationDateYYYYMMDD 2020-07-01
PublicationDate_xml – month: 07
  year: 2020
  text: 2020-07-01
  day: 01
PublicationDecade 2020
PublicationTitle Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference
PublicationTitleAbbrev EMBC
PublicationYear 2020
Publisher IEEE
Publisher_xml – name: IEEE
SSID ssj0020051
ssib061542107
ssib053545923
ssib042469959
Score 2.2609277
Snippet The diagnosis and treatment of psychiatric disorders depends on the analysis of behavior through language by a clinical specialist. This analysis is subjective...
SourceID proquest
ieee
SourceType Aggregation Database
Publisher
StartPage 5575
Title Analyzing acoustic and prosodic fluctuations in free speech to predict psychosis onset in high-risk youths
URI https://ieeexplore.ieee.org/document/9176841
https://www.proquest.com/docview/2448842131
Volume 2020
WOSCitedRecordID wos000621592205213&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV1LSwMxEA61eNCLj1asjxLBo2l3s6_karF4sfSg0NuSTWZxRbaluxX01zvJrlXQi7cEEgizw8x8O_PNEHLNucqljnImlOEslCpmKvYUA4GRXORpEwrjhk0ks5lYLOS8Q262XBgAcMVnMLJLl8s3S72xv8rGCC1iYVnqO0mSNFytLbiy2tUygH1Pju8ebifo6T3LReHeqL3ZjlD5ZXedM5ke_O8Zh6T_zcqj862_OSIdKI_J_o-Ggj3y4nqMfOCaoqVzg7qoKg3Fd1RLg5v8dWMZI07ZaFHSfA1AqxWAfqb1Es_ZvE1NG25WVVTUFlvX9qTta8xsITp9t1P3qj55mt49Tu5ZO02BFeiCagaBp7IoBA0IYmw6DIEFOqbQzzKEDJ6JAKTm0uQK7U6mMqF4pIPYZBDFhqskOCHdclnCKaES_EBpzYNM-qFWvjIYRqE1wMMSIU4yID0rtXTVNMxIW4ENyNWX2FNUYpuZUCWgMFKMMYQIuR_4Z39fPSd79js2dbIXpFuvN3BJdvVbXVTrIerDQgydPnwCPXS39Q
linkProvider IEEE
linkToHtml http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV3dS8MwEA9jCuqLH5s4PyP4aLc2_Vjy6phM3MYeJuytpMkVK9KOtRP0r_fS1inoi28pJBAux939eve7I-SGMRkL5ccWl5pZnpCBJQNbWsAxkvNtpT2uy2ET_emULxZi1iC3Gy4MAJTFZ9A1yzKXrzO1Nr_KeggtAm5Y6lu-5zGnYmtt4JXRr5oD7NiiN5zcDdDX24aNwuxufbYeovLL8pbu5H7_fxc5IO1vXh6dbTzOIWlAekT2frQUbJGXssvIB64p2rpyVBeVqaZ4jzzT-BG_rg1npFQ3mqQ0XgHQfAmgnmmR4T6TuSloxc7Kk5yacuvC7DSdjS1Tik7fzdy9vE2e7ofzwciq5ylYCTqhwgLXlpHvgQKEMSYhhtACXZPnRBGCBlv7AEIxoWOJlieSEZfMV26gI_ADzWTfPSbNNEvhhFABjiuVYm4kHE9JR2oMpNAe4GaBIKffIS0jtXBZtcwIa4F1yPWX2ENUY5ObkCmgMEKMMjjHN3Wd07-PXpGd0XwyDscP08czsmvetKqaPSfNYrWGC7Kt3ookX12WWvEJnrq6VA
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=proceeding&rft.title=Proceedings+of+the+annual+international+conference+of+the+IEEE+Engineering+in+Medicine+and+Biology+Society&rft.atitle=Analyzing+acoustic+and+prosodic+fluctuations+in+free+speech+to+predict+psychosis+onset+in+high-risk+youths&rft.au=Agurto%2C+Carla&rft.au=Pietrowicz%2C+Mary&rft.au=Norel%2C+Raquel&rft.au=Eyigoz%2C+Elif+K.&rft.date=2020-07-01&rft.pub=IEEE&rft.eissn=1558-4615&rft.spage=5575&rft.epage=5579&rft_id=info:doi/10.1109%2FEMBC44109.2020.9176841&rft.externalDocID=9176841
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=2694-0604&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=2694-0604&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=2694-0604&client=summon