View in EDS

Usability Comparison Among Healthy Participants of an Anthropomorphic Digital Human and a Text-Based Chatbot as a Responder to Questions on Mental Health: Randomized Controlled Trial

Saved in:
Bibliographic Details
Title: Usability Comparison Among Healthy Participants of an Anthropomorphic Digital Human and a Text-Based Chatbot as a Responder to Questions on Mental Health: Randomized Controlled Trial
Authors: Thunström, Almira Osmanovic, Carlsen, Hanne Krage, Ali, Lilas, Larson, Tomas, Hellström, Andreas, 1972, Steingrimsson, Steinn
Source: JMIR Human Factors. 11
Subject Terms: digital health, artificial intelligence, mental health service, mental illnesses, mental disease, mental health services, chatbots, algorithm, chat-bots, algorithms, system usability, mental diseases, chat-bot, AI, natural language processing, ML, mental health, interface, text-only chatbot, voice-only chatbot, machine learning, chatbot, NLP, usability, mental illness
Description: Background: The use of chatbots in mental health support has increased exponentially in recent years, with studies showing that they may be effective in treating mental health problems. More recently, the use of visual avatars called digital humans has been introduced. Digital humans have the capability to use facial expressions as another dimension in human-computer interactions. It is important to study the difference in emotional response and usability preferences between text-based chatbots and digital humans for interacting with mental health services. Objective: This study aims to explore to what extent a digital human interface and a text-only chatbot interface differed in usability when tested by healthy participants, using BETSY (Behavior, Emotion, Therapy System, and You) which uses 2 distinct interfaces: a digital human with anthropomorphic features and a text-only user interface. We also set out to explore how chatbot-generated conversations on mental health (specific to each interface) affected self-reported feelings and biometrics. Methods: We explored to what extent a digital human with anthropomorphic features differed from a traditional text-only chatbot regarding perception of usability through the System Usability Scale, emotional reactions through electroencephalography, and feelings of closeness. Healthy participants (n=45) were randomized to 2 groups that used a digital human with anthropomorphic features (n=25) or a text-only chatbot with no such features (n=20). The groups were compared by linear regression analysis and t tests. Results: No differences were observed between the text-only and digital human groups regarding demographic features. The mean System Usability Scale score was 75.34 (SD 10.01; range 57-90) for the text-only chatbot versus 64.80 (SD 14.14; range 40-90) for the digital human interface. Both groups scored their respective chatbot interfaces as average or above average in usability. Women were more likely to report feeling annoyed by BETSY.
File Description: electronic
Access URL: https://research.chalmers.se/publication/541305
https://research.chalmers.se/publication/541305/file/541305_Fulltext.pdf
Database: SwePub
FullText Text:
  Availability: 0
CustomLinks:
  – Url: https://research.chalmers.se/publication/541305#
    Name: EDS - SwePub (s4221598)
    Category: fullText
    Text: View record in SwePub
  – Url: http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?cmd=search&db=pmc&term=2292-9495[TA]+AND+[PG]+AND+2024[PDAT]
    Name: FREE - PubMed Central (ISSN based link)
    Category: fullText
    Text: Full Text
    Icon: https://imageserver.ebscohost.com/NetImages/iconPdf.gif
    MouseOverText: Check this PubMed for the article full text.
  – Url: https://resolver.ebscohost.com/openurl?sid=EBSCO:edsswe&genre=article&issn=22929495&ISBN=&volume=11&issue=&date=20240101&spage=&pages=&title=JMIR Human Factors&atitle=Usability%20Comparison%20Among%20Healthy%20Participants%20of%20an%20Anthropomorphic%20Digital%20Human%20and%20a%20Text-Based%20Chatbot%20as%20a%20Responder%20to%20Questions%20on%20Mental%20Health%3A%20Randomized%20Controlled%20Trial&aulast=Thunstr%C3%B6m%2C%20Almira%20Osmanovic&id=DOI:10.2196/54581
    Name: Full Text Finder
    Category: fullText
    Text: Full Text Finder
    Icon: https://imageserver.ebscohost.com/branding/images/FTF.gif
    MouseOverText: Full Text Finder
  – Url: https://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=EBSCO&SrcAuth=EBSCO&DestApp=WOS&ServiceName=TransferToWoS&DestLinkType=GeneralSearchSummary&Func=Links&author=Thunstr%C3%B6m%20AO
    Name: ISI
    Category: fullText
    Text: Nájsť tento článok vo Web of Science
    Icon: https://imagesrvr.epnet.com/ls/20docs.gif
    MouseOverText: Nájsť tento článok vo Web of Science
Header DbId: edsswe
DbLabel: SwePub
An: edsswe.oai.research.chalmers.se.6a0b4ac6.82c4.4bd9.a5af.2610464473e6
RelevancyScore: 1014
AccessLevel: 6
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 1014.41540527344
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Usability Comparison Among Healthy Participants of an Anthropomorphic Digital Human and a Text-Based Chatbot as a Responder to Questions on Mental Health: Randomized Controlled Trial
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Thunström%2C+Almira+Osmanovic%22">Thunström, Almira Osmanovic</searchLink><br /><searchLink fieldCode="AR" term="%22Carlsen%2C+Hanne+Krage%22">Carlsen, Hanne Krage</searchLink><br /><searchLink fieldCode="AR" term="%22Ali%2C+Lilas%22">Ali, Lilas</searchLink><br /><searchLink fieldCode="AR" term="%22Larson%2C+Tomas%22">Larson, Tomas</searchLink><br /><searchLink fieldCode="AR" term="%22Hellström%2C+Andreas%22">Hellström, Andreas</searchLink>, 1972<br /><searchLink fieldCode="AR" term="%22Steingrimsson%2C+Steinn%22">Steingrimsson, Steinn</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <i>JMIR Human Factors</i>. 11
– Name: Subject
  Label: Subject Terms
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22digital+health%22">digital health</searchLink><br /><searchLink fieldCode="DE" term="%22artificial+intelligence%22">artificial intelligence</searchLink><br /><searchLink fieldCode="DE" term="%22mental+health+service%22">mental health service</searchLink><br /><searchLink fieldCode="DE" term="%22mental+illnesses%22">mental illnesses</searchLink><br /><searchLink fieldCode="DE" term="%22mental+disease%22">mental disease</searchLink><br /><searchLink fieldCode="DE" term="%22mental+health+services%22">mental health services</searchLink><br /><searchLink fieldCode="DE" term="%22chatbots%22">chatbots</searchLink><br /><searchLink fieldCode="DE" term="%22algorithm%22">algorithm</searchLink><br /><searchLink fieldCode="DE" term="%22chat-bots%22">chat-bots</searchLink><br /><searchLink fieldCode="DE" term="%22algorithms%22">algorithms</searchLink><br /><searchLink fieldCode="DE" term="%22system+usability%22">system usability</searchLink><br /><searchLink fieldCode="DE" term="%22mental+diseases%22">mental diseases</searchLink><br /><searchLink fieldCode="DE" term="%22chat-bot%22">chat-bot</searchLink><br /><searchLink fieldCode="DE" term="%22AI%22">AI</searchLink><br /><searchLink fieldCode="DE" term="%22natural+language+processing%22">natural language processing</searchLink><br /><searchLink fieldCode="DE" term="%22ML%22">ML</searchLink><br /><searchLink fieldCode="DE" term="%22mental+health%22">mental health</searchLink><br /><searchLink fieldCode="DE" term="%22interface%22">interface</searchLink><br /><searchLink fieldCode="DE" term="%22text-only+chatbot%22">text-only chatbot</searchLink><br /><searchLink fieldCode="DE" term="%22voice-only+chatbot%22">voice-only chatbot</searchLink><br /><searchLink fieldCode="DE" term="%22machine+learning%22">machine learning</searchLink><br /><searchLink fieldCode="DE" term="%22chatbot%22">chatbot</searchLink><br /><searchLink fieldCode="DE" term="%22NLP%22">NLP</searchLink><br /><searchLink fieldCode="DE" term="%22usability%22">usability</searchLink><br /><searchLink fieldCode="DE" term="%22mental+illness%22">mental illness</searchLink>
– Name: Abstract
  Label: Description
  Group: Ab
  Data: Background: The use of chatbots in mental health support has increased exponentially in recent years, with studies showing that they may be effective in treating mental health problems. More recently, the use of visual avatars called digital humans has been introduced. Digital humans have the capability to use facial expressions as another dimension in human-computer interactions. It is important to study the difference in emotional response and usability preferences between text-based chatbots and digital humans for interacting with mental health services. Objective: This study aims to explore to what extent a digital human interface and a text-only chatbot interface differed in usability when tested by healthy participants, using BETSY (Behavior, Emotion, Therapy System, and You) which uses 2 distinct interfaces: a digital human with anthropomorphic features and a text-only user interface. We also set out to explore how chatbot-generated conversations on mental health (specific to each interface) affected self-reported feelings and biometrics. Methods: We explored to what extent a digital human with anthropomorphic features differed from a traditional text-only chatbot regarding perception of usability through the System Usability Scale, emotional reactions through electroencephalography, and feelings of closeness. Healthy participants (n=45) were randomized to 2 groups that used a digital human with anthropomorphic features (n=25) or a text-only chatbot with no such features (n=20). The groups were compared by linear regression analysis and t tests. Results: No differences were observed between the text-only and digital human groups regarding demographic features. The mean System Usability Scale score was 75.34 (SD 10.01; range 57-90) for the text-only chatbot versus 64.80 (SD 14.14; range 40-90) for the digital human interface. Both groups scored their respective chatbot interfaces as average or above average in usability. Women were more likely to report feeling annoyed by BETSY.
– Name: Format
  Label: File Description
  Group: SrcInfo
  Data: electronic
– Name: URL
  Label: Access URL
  Group: URL
  Data: <link linkTarget="URL" linkTerm="https://research.chalmers.se/publication/541305" linkWindow="_blank">https://research.chalmers.se/publication/541305</link><br /><link linkTarget="URL" linkTerm="https://research.chalmers.se/publication/541305/file/541305_Fulltext.pdf" linkWindow="_blank">https://research.chalmers.se/publication/541305/file/541305_Fulltext.pdf</link>
PLink https://erproxy.cvtisr.sk/sfx/access?url=https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=edsswe&AN=edsswe.oai.research.chalmers.se.6a0b4ac6.82c4.4bd9.a5af.2610464473e6
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.2196/54581
    Languages:
      – Text: English
    Subjects:
      – SubjectFull: digital health
        Type: general
      – SubjectFull: artificial intelligence
        Type: general
      – SubjectFull: mental health service
        Type: general
      – SubjectFull: mental illnesses
        Type: general
      – SubjectFull: mental disease
        Type: general
      – SubjectFull: mental health services
        Type: general
      – SubjectFull: chatbots
        Type: general
      – SubjectFull: algorithm
        Type: general
      – SubjectFull: chat-bots
        Type: general
      – SubjectFull: algorithms
        Type: general
      – SubjectFull: system usability
        Type: general
      – SubjectFull: mental diseases
        Type: general
      – SubjectFull: chat-bot
        Type: general
      – SubjectFull: AI
        Type: general
      – SubjectFull: natural language processing
        Type: general
      – SubjectFull: ML
        Type: general
      – SubjectFull: mental health
        Type: general
      – SubjectFull: interface
        Type: general
      – SubjectFull: text-only chatbot
        Type: general
      – SubjectFull: voice-only chatbot
        Type: general
      – SubjectFull: machine learning
        Type: general
      – SubjectFull: chatbot
        Type: general
      – SubjectFull: NLP
        Type: general
      – SubjectFull: usability
        Type: general
      – SubjectFull: mental illness
        Type: general
    Titles:
      – TitleFull: Usability Comparison Among Healthy Participants of an Anthropomorphic Digital Human and a Text-Based Chatbot as a Responder to Questions on Mental Health: Randomized Controlled Trial
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Thunström, Almira Osmanovic
      – PersonEntity:
          Name:
            NameFull: Carlsen, Hanne Krage
      – PersonEntity:
          Name:
            NameFull: Ali, Lilas
      – PersonEntity:
          Name:
            NameFull: Larson, Tomas
      – PersonEntity:
          Name:
            NameFull: Hellström, Andreas
      – PersonEntity:
          Name:
            NameFull: Steingrimsson, Steinn
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 01
              Type: published
              Y: 2024
          Identifiers:
            – Type: issn-print
              Value: 22929495
            – Type: issn-locals
              Value: SWEPUB_FREE
            – Type: issn-locals
              Value: CTH_SWEPUB
          Numbering:
            – Type: volume
              Value: 11
          Titles:
            – TitleFull: JMIR Human Factors
              Type: main
ResultId 1