The narrow search effect and how broadening search promotes belief updating
Information search platforms, from Google to AI-assisted search engines, have transformed information access but may fail to promote a shared factual foundation. We demonstrate that the combination of users' prior beliefs influencing their search terms and the narrow scope of search algorithms...
Saved in:
| Published in: | Proceedings of the National Academy of Sciences - PNAS Vol. 122; no. 13; p. e2408175122 |
|---|---|
| Main Authors: | , |
| Format: | Journal Article |
| Language: | English |
| Published: |
United States
01.04.2025
|
| Subjects: | |
| ISSN: | 1091-6490, 1091-6490 |
| Online Access: | Get more information |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| Abstract | Information search platforms, from Google to AI-assisted search engines, have transformed information access but may fail to promote a shared factual foundation. We demonstrate that the combination of users' prior beliefs influencing their search terms and the narrow scope of search algorithms can limit belief updating from search. We test this "narrow search effect" across 21 studies (14 preregistered) using various topics (e.g., health, financial, societal, political) and platforms (e.g., Google, ChatGPT, AI-powered Bing, our custom-designed search engine and AI chatbot interfaces). We then test user-based and algorithm-based interventions to counter the "narrow search effect" and promote belief updating. Studies 1 to 5 show that users' prior beliefs influence the direction of the search terms, thereby generating narrow search results that limit belief updating. This effect persists across various domains (e.g., beliefs related to coronavirus, nuclear energy, gas prices, crime rates, bitcoin, caffeine, and general food or beverage health concerns; Studies 1a to 1b, 2a to 2g, 3, 4), platforms (e.g., Google-Studies 1a to 1b, 2a to 2g, 4, 5; ChatGPT, Study 3), and extends to consequential choices (Study 5). Studies 6 and 7 demonstrate the limited efficacy of prompting users to correct for the impact of narrow searches on their beliefs themselves. Using our custom-designed search engine and AI chatbot interfaces, Studies 8 and 9 show that modifying algorithms to provide broader results can encourage belief updating. These findings highlight the need for a behaviorally informed approach to the design of search algorithms. |
|---|---|
| AbstractList | Information search platforms, from Google to AI-assisted search engines, have transformed information access but may fail to promote a shared factual foundation. We demonstrate that the combination of users' prior beliefs influencing their search terms and the narrow scope of search algorithms can limit belief updating from search. We test this "narrow search effect" across 21 studies (14 preregistered) using various topics (e.g., health, financial, societal, political) and platforms (e.g., Google, ChatGPT, AI-powered Bing, our custom-designed search engine and AI chatbot interfaces). We then test user-based and algorithm-based interventions to counter the "narrow search effect" and promote belief updating. Studies 1 to 5 show that users' prior beliefs influence the direction of the search terms, thereby generating narrow search results that limit belief updating. This effect persists across various domains (e.g., beliefs related to coronavirus, nuclear energy, gas prices, crime rates, bitcoin, caffeine, and general food or beverage health concerns; Studies 1a to 1b, 2a to 2g, 3, 4), platforms (e.g., Google-Studies 1a to 1b, 2a to 2g, 4, 5; ChatGPT, Study 3), and extends to consequential choices (Study 5). Studies 6 and 7 demonstrate the limited efficacy of prompting users to correct for the impact of narrow searches on their beliefs themselves. Using our custom-designed search engine and AI chatbot interfaces, Studies 8 and 9 show that modifying algorithms to provide broader results can encourage belief updating. These findings highlight the need for a behaviorally informed approach to the design of search algorithms. Information search platforms, from Google to AI-assisted search engines, have transformed information access but may fail to promote a shared factual foundation. We demonstrate that the combination of users' prior beliefs influencing their search terms and the narrow scope of search algorithms can limit belief updating from search. We test this "narrow search effect" across 21 studies (14 preregistered) using various topics (e.g., health, financial, societal, political) and platforms (e.g., Google, ChatGPT, AI-powered Bing, our custom-designed search engine and AI chatbot interfaces). We then test user-based and algorithm-based interventions to counter the "narrow search effect" and promote belief updating. Studies 1 to 5 show that users' prior beliefs influence the direction of the search terms, thereby generating narrow search results that limit belief updating. This effect persists across various domains (e.g., beliefs related to coronavirus, nuclear energy, gas prices, crime rates, bitcoin, caffeine, and general food or beverage health concerns; Studies 1a to 1b, 2a to 2g, 3, 4), platforms (e.g., Google-Studies 1a to 1b, 2a to 2g, 4, 5; ChatGPT, Study 3), and extends to consequential choices (Study 5). Studies 6 and 7 demonstrate the limited efficacy of prompting users to correct for the impact of narrow searches on their beliefs themselves. Using our custom-designed search engine and AI chatbot interfaces, Studies 8 and 9 show that modifying algorithms to provide broader results can encourage belief updating. These findings highlight the need for a behaviorally informed approach to the design of search algorithms.Information search platforms, from Google to AI-assisted search engines, have transformed information access but may fail to promote a shared factual foundation. We demonstrate that the combination of users' prior beliefs influencing their search terms and the narrow scope of search algorithms can limit belief updating from search. We test this "narrow search effect" across 21 studies (14 preregistered) using various topics (e.g., health, financial, societal, political) and platforms (e.g., Google, ChatGPT, AI-powered Bing, our custom-designed search engine and AI chatbot interfaces). We then test user-based and algorithm-based interventions to counter the "narrow search effect" and promote belief updating. Studies 1 to 5 show that users' prior beliefs influence the direction of the search terms, thereby generating narrow search results that limit belief updating. This effect persists across various domains (e.g., beliefs related to coronavirus, nuclear energy, gas prices, crime rates, bitcoin, caffeine, and general food or beverage health concerns; Studies 1a to 1b, 2a to 2g, 3, 4), platforms (e.g., Google-Studies 1a to 1b, 2a to 2g, 4, 5; ChatGPT, Study 3), and extends to consequential choices (Study 5). Studies 6 and 7 demonstrate the limited efficacy of prompting users to correct for the impact of narrow searches on their beliefs themselves. Using our custom-designed search engine and AI chatbot interfaces, Studies 8 and 9 show that modifying algorithms to provide broader results can encourage belief updating. These findings highlight the need for a behaviorally informed approach to the design of search algorithms. |
| Author | Urminsky, Oleg Leung, Eugina |
| Author_xml | – sequence: 1 givenname: Eugina orcidid: 0000-0002-6486-4209 surname: Leung fullname: Leung, Eugina organization: Marketing, Freeman School of Business, Tulane University, New Orleans, LA 70118 – sequence: 2 givenname: Oleg orcidid: 0000-0003-4390-386X surname: Urminsky fullname: Urminsky, Oleg organization: Marketing, Booth School of Business, University of Chicago, Chicago, IL 60637 |
| BackLink | https://www.ncbi.nlm.nih.gov/pubmed/40127267$$D View this record in MEDLINE/PubMed |
| BookMark | eNpNkEtLxEAQhAdZcR969iY5esnaM-lkkqMsvnDBy3oO8-iYSDKJMwnivzfgLniqouuju6k1W7jeEWPXHLYcZHI3OBW2AiHnMuVCnLEVh4LHGRaw-OeXbB3CJwAUaQ4XbInAhRSZXLHXQ02RU97331Eg5U0dUVWRGSPlbFTPU-17Zck17uMEDL7v-pFCpKltqIqmwapxzi_ZeaXaQFdH3bD3x4fD7jnevz297O73sUHAMU51mhYEhivMU0STIMwHDRc8sUIbi0kmKq6sxsSYDCEjKTEz2ipZqFRqsWG3f3vnR74mCmPZNcFQ2ypH_RTKhOdQ5IgCZ_TmiE66I1sOvumU_ylPBYhfx1tfXA |
| CitedBy_id | crossref_primary_10_3389_fpubh_2025_1613553 |
| ContentType | Journal Article |
| DBID | CGR CUY CVF ECM EIF NPM 7X8 |
| DOI | 10.1073/pnas.2408175122 |
| DatabaseName | Medline MEDLINE MEDLINE (Ovid) MEDLINE MEDLINE PubMed MEDLINE - Academic |
| DatabaseTitle | MEDLINE Medline Complete MEDLINE with Full Text PubMed MEDLINE (Ovid) MEDLINE - Academic |
| DatabaseTitleList | MEDLINE MEDLINE - Academic |
| Database_xml | – sequence: 1 dbid: NPM name: PubMed url: http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed sourceTypes: Index Database – sequence: 2 dbid: 7X8 name: MEDLINE - Academic url: https://search.proquest.com/medline sourceTypes: Aggregation Database |
| DeliveryMethod | no_fulltext_linktorsrc |
| Discipline | Sciences (General) |
| EISSN | 1091-6490 |
| ExternalDocumentID | 40127267 |
| Genre | Journal Article |
| GroupedDBID | --- -DZ -~X .55 .GJ 0R~ 123 29P 2AX 2FS 2WC 3O- 4.4 53G 5RE 5VS 692 6TJ 79B 85S AACGO AAFWJ AANCE AAYJJ ABBHK ABOCM ABPLY ABPPZ ABTLG ABXSQ ABZEH ACGOD ACHIC ACIWK ACKIV ACNCT ACPRK ADQXQ ADULT ADXHL AENEX AEUPB AEXZC AFFNX AFHIN AFQQW AFRAH ALMA_UNASSIGNED_HOLDINGS AQVQM AS~ BKOMP CGR CS3 CUY CVF D0L DCCCD DIK DU5 E3Z EBS ECM EIF EJD F5P FRP GX1 H13 HGD HH5 HQ3 HTVGU HYE IPSME JAAYA JBMMH JENOY JHFFW JKQEH JLS JLXEF JPM JSG JST KQ8 L7B LU7 MVM N9A NEJ NHB NPM N~3 O9- OK1 P-O PNE PQQKQ R.V RHI RNA RNS RPM RXW SA0 SJN TAE TN5 UKR VOH W8F WH7 WHG WOQ WOW X7M XSW Y6R YBH YKV YSK ZCA ZCG ~02 ~KM 7X8 |
| ID | FETCH-LOGICAL-c404t-5b559e0c1a48544c340fecc1213d2bcd4362f1adb43cc6406e7746cbda79a57b2 |
| IEDL.DBID | 7X8 |
| ISICitedReferencesCount | 1 |
| ISICitedReferencesURI | http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=001466845700001&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| ISSN | 1091-6490 |
| IngestDate | Thu Oct 02 05:34:19 EDT 2025 Fri Sep 26 01:52:59 EDT 2025 |
| IsDoiOpenAccess | false |
| IsOpenAccess | true |
| IsPeerReviewed | true |
| IsScholarly | true |
| Issue | 13 |
| Keywords | algorithmic search belief updating artificial intelligence confirmation bias |
| Language | English |
| LinkModel | DirectLink |
| MergedId | FETCHMERGED-LOGICAL-c404t-5b559e0c1a48544c340fecc1213d2bcd4362f1adb43cc6406e7746cbda79a57b2 |
| Notes | ObjectType-Article-1 SourceType-Scholarly Journals-1 ObjectType-Feature-2 content type line 23 |
| ORCID | 0000-0002-6486-4209 0000-0003-4390-386X |
| OpenAccessLink | https://www.ncbi.nlm.nih.gov/pmc/articles/12002208 |
| PMID | 40127267 |
| PQID | 3180984424 |
| PQPubID | 23479 |
| ParticipantIDs | proquest_miscellaneous_3180984424 pubmed_primary_40127267 |
| PublicationCentury | 2000 |
| PublicationDate | 2025-Apr 20250401 |
| PublicationDateYYYYMMDD | 2025-04-01 |
| PublicationDate_xml | – month: 04 year: 2025 text: 2025-Apr |
| PublicationDecade | 2020 |
| PublicationPlace | United States |
| PublicationPlace_xml | – name: United States |
| PublicationTitle | Proceedings of the National Academy of Sciences - PNAS |
| PublicationTitleAlternate | Proc Natl Acad Sci U S A |
| PublicationYear | 2025 |
| SSID | ssj0009580 |
| Score | 2.4884434 |
| Snippet | Information search platforms, from Google to AI-assisted search engines, have transformed information access but may fail to promote a shared factual... |
| SourceID | proquest pubmed |
| SourceType | Aggregation Database Index Database |
| StartPage | e2408175122 |
| SubjectTerms | Algorithms Artificial Intelligence Humans Information Seeking Behavior Search Engine |
| Title | The narrow search effect and how broadening search promotes belief updating |
| URI | https://www.ncbi.nlm.nih.gov/pubmed/40127267 https://www.proquest.com/docview/3180984424 |
| Volume | 122 |
| WOSCitedRecordID | wos001466845700001&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| hasFullText | |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| link | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwpV05T8MwFLaAMrAA5SyXjMQAg2kSv1wTQogKCVF1AKlb5RNYnNC0_H6ecwgWJCSWDFHiRM7nd_i9fB8hFzEHYzHxYHEmDSYoAlguJbAoSSNt0KFZm9ViE-l4nE2n-aTdcKvatsrOJtaGWhfK75EPuSeaygAiuCk_mFeN8tXVVkJjlfQ4hjK-pSudZj9Id7OGjSAPWQJ50FH7pHxYOlFde3ovdJ-hV879Lb6s_cxo679vuE022wiT3jaQ6JMV43ZIv13DFb1siaavdskjYoS6moWRNoinTXsHFU7TNzwr54VAw4TurbugrNv3cBxpMHq1dFn6_yPc6x55Gd0_3z2wVlyBKQhgwWKJuYQJVCggiwEUhwAfoDzDm46k0oCezYZCS-BKJej2DQaKiZJapLmIUxntkzVXOHNIqFJpLLgOwSYKDH4Gy60Py3AgG2hpBuS8m7AZgtdXJIQzxbKafU_ZgBw0sz4rG5aNGfiiOELm6A93H5ONyOvy1h01J6RncemaU7KuPhfv1fysRgUex5OnL-Dzwfw |
| linkProvider | ProQuest |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=The+narrow+search+effect+and+how+broadening+search+promotes+belief+updating&rft.jtitle=Proceedings+of+the+National+Academy+of+Sciences+-+PNAS&rft.au=Leung%2C+Eugina&rft.au=Urminsky%2C+Oleg&rft.date=2025-04-01&rft.eissn=1091-6490&rft.volume=122&rft.issue=13&rft.spage=e2408175122&rft_id=info:doi/10.1073%2Fpnas.2408175122&rft_id=info%3Apmid%2F40127267&rft_id=info%3Apmid%2F40127267&rft.externalDocID=40127267 |
| thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1091-6490&client=summon |
| thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1091-6490&client=summon |
| thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1091-6490&client=summon |