Recurrent neural circuits for perceptual grouping

Neurons in the visual cortex are sensitive to context: Responses to stimuli presented within their classical receptive fields (CRFs) are modulated by stimuli in their surrounding extra-classical receptive fields (eCRFs). However, the circuits underlying these contextual effects are not well understo...

Full description

Saved in:
Bibliographic Details
Published in:Journal of vision (Charlottesville, Va.) Vol. 22; no. 14; p. 3185
Main Author: Serre, Thomas
Format: Journal Article
Language:English
Published: Association for Research in Vision and Ophthalmology 05.12.2022
Subjects:
Computer Science
Computer Vision and Pattern Recognition
ISSN:1534-7362, 1534-7362
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Abstract Neurons in the visual cortex are sensitive to context: Responses to stimuli presented within their classical receptive fields (CRFs) are modulated by stimuli in their surrounding extra-classical receptive fields (eCRFs). However, the circuits underlying these contextual effects are not well understood, and little is known about how these circuits drive perception during everyday vision. We tackle these questions by approximating circuit-level eCRF models with a differentiable discrete-time recurrent neural network that is trainable with gradient-descent. After optimizing model synaptic connectivity and dynamics for object contour detection in natural images, the neural-circuit model rivals human observers on the task with far better sample efficiency than state-of-the-art computer vision approaches. Notably, the model also exhibits CRF and eCRF phenomena typically associated with primate vision. The model’s ability to accurately detect object contours also critically depends on these effects, and these contextual effects are not found in ablated versions of the model. Finally, we derive testable predictions about the neural mechanisms responsible for contextual integration and illustrate their importance for accurate and efficient perceptual grouping.
AbstractList Neurons in the visual cortex are sensitive to context: Responses to stimuli presented within their classical receptive fields (CRFs) are modulated by stimuli in their surrounding extra-classical receptive fields (eCRFs). However, the circuits underlying these contextual effects are not well understood, and little is known about how these circuits drive perception during everyday vision. We tackle these questions by approximating circuit-level eCRF models with a differentiable discrete-time recurrent neural network that is trainable with gradient-descent. After optimizing model synaptic connectivity and dynamics for object contour detection in natural images, the neural-circuit model rivals human observers on the task with far better sample efficiency than state-of-the-art computer vision approaches. Notably, the model also exhibits CRF and eCRF phenomena typically associated with primate vision. The model’s ability to accurately detect object contours also critically depends on these effects, and these contextual effects are not found in ablated versions of the model. Finally, we derive testable predictions about the neural mechanisms responsible for contextual integration and illustrate their importance for accurate and efficient perceptual grouping.
Author Serre, Thomas
Author_xml – sequence: 1
  givenname: Thomas
  surname: Serre
  fullname: Serre, Thomas
  organization: Brown University
BackLink https://hal.science/hal-04920007$$DView record in HAL
BookMark eNpNkM1Lw0AUxBepYFu9es7VQ-J7u9kkPZaiVggIoudlP97WlJiETVLwvzehRTzNMMzM4bdii6ZtiLF7hAQxyx-P7SnhPME0EVjIK7ZEKdI4Fxlf_PM3bNX3RwAOEnDJ8J3sGAI1Q9TQGHQd2SrYsRr6yLch6ihY6oZxyg-hHbuqOdyya6_rnu4uumafz08fu31cvr287rZlbBGFjDMviJzJpHOGg0dPVueF4E4bm6d8U5gMLZocjETvJXcchRDSeU1kSINYs4fz75euVReqbx1-VKsrtd-Was4g3XAAyE84dZNz14a27wP5vwGCmuGoCY7iXGGqZjjiFwleWik
ContentType Journal Article
Copyright Distributed under a Creative Commons Attribution 4.0 International License
Copyright_xml – notice: Distributed under a Creative Commons Attribution 4.0 International License
DBID AAYXX
CITATION
1XC
DOI 10.1167/jov.22.14.3185
DatabaseName CrossRef
Hyper Article en Ligne (HAL)
DatabaseTitle CrossRef
DatabaseTitleList
DeliveryMethod fulltext_linktorsrc
Discipline Medicine
Computer Science
EISSN 1534-7362
ExternalDocumentID oai:HAL:hal-04920007v1
10_1167_jov_22_14_3185
GroupedDBID ---
29L
2WC
53G
5GY
5VS
AAFWJ
AAYXX
ABIVO
ACGFO
ADBBV
AENEX
AFPKN
ALMA_UNASSIGNED_HOLDINGS
BAWUL
BCNDV
CITATION
CS3
DIK
DU5
E3Z
EBS
EJD
F5P
FRP
GROUPED_DOAJ
GX1
KQ8
M~E
OK1
OVT
P2P
RNS
RPM
TR2
TRV
W2D
W8F
XSB
1XC
ID FETCH-LOGICAL-c1135-6f3eedb65ddb20f1feca7832dabc74298b61c1b70b51ff52d213335dfaeebea03
ISSN 1534-7362
IngestDate Tue Oct 14 20:02:14 EDT 2025
Sat Nov 29 03:46:23 EST 2025
IsDoiOpenAccess false
IsOpenAccess true
IsPeerReviewed true
IsScholarly true
Issue 14
Language English
License https://creativecommons.org/licenses/by-nc-nd/4.0
Distributed under a Creative Commons Attribution 4.0 International License: http://creativecommons.org/licenses/by/4.0
LinkModel OpenURL
MergedId FETCHMERGED-LOGICAL-c1135-6f3eedb65ddb20f1feca7832dabc74298b61c1b70b51ff52d213335dfaeebea03
ORCID 0000-0003-0846-0039
OpenAccessLink https://doi.org/10.1167/jov.22.14.3185
ParticipantIDs hal_primary_oai_HAL_hal_04920007v1
crossref_primary_10_1167_jov_22_14_3185
PublicationCentury 2000
PublicationDate 2022-12-05
PublicationDateYYYYMMDD 2022-12-05
PublicationDate_xml – month: 12
  year: 2022
  text: 2022-12-05
  day: 05
PublicationDecade 2020
PublicationTitle Journal of vision (Charlottesville, Va.)
PublicationYear 2022
Publisher Association for Research in Vision and Ophthalmology
Publisher_xml – name: Association for Research in Vision and Ophthalmology
SSID ssj0020501
Score 2.3580458
Snippet Neurons in the visual cortex are sensitive to context: Responses to stimuli presented within their classical receptive fields (CRFs) are modulated by stimuli...
SourceID hal
crossref
SourceType Open Access Repository
Index Database
StartPage 3185
SubjectTerms Computer Science
Computer Vision and Pattern Recognition
Title Recurrent neural circuits for perceptual grouping
URI https://hal.science/hal-04920007
Volume 22
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
journalDatabaseRights – providerCode: PRVAON
  databaseName: DOAJ Directory of Open Access Journals
  customDbUrl:
  eissn: 1534-7362
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0020501
  issn: 1534-7362
  databaseCode: DOA
  dateStart: 20010101
  isFulltext: true
  titleUrlDefault: https://www.doaj.org/
  providerName: Directory of Open Access Journals
– providerCode: PRVHPJ
  databaseName: ROAD: Directory of Open Access Scholarly Resources
  customDbUrl:
  eissn: 1534-7362
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0020501
  issn: 1534-7362
  databaseCode: M~E
  dateStart: 20010101
  isFulltext: true
  titleUrlDefault: https://road.issn.org
  providerName: ISSN International Centre
link http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwtV1LS8QwEA66ingRn_imiOCpa5M2TXtcRPGwioiCt5KkDeqhu6zr4snf7kyadre6Bz14KSUkfeRrv0wmM18IOYURRtCcSt8kTPtRETNfKiDDWIZUJhybWRHXvri9TZ6e0ju3m_2b3U5AlGXy8ZEO_xVqKAOwMXX2D3A3F4UCOAfQ4Qiww_FXwN-jB91qLqFWJcp_vIz0O64PYEThsApkwaQRm9BRj1w_7dMq69yu8uKS_GAMRukEMwdtaKzszvgQgHAqV_ZMuJHzJDC7qUnAW-QX-SJ07FjMKXOMydjslxHN8B_mYs8n5hiXhl8Hky5jwM7dumJbAfvbyNTEC9qZSiwyaJ8xBtOVDNsvkiUmeIqBfDefl800O-CBU8mtntxJdUL78_b9W6bI4nPtSbeWxcM6WXNd7vUqKDfIQlFukpUbF_SwRWiDqFch6tWIeoCoN0XUqxHdJo9Xlw8X177b6cLXlIbcj00ItoqKeZ4rFhhqCi0FcG0ulRZgMSQqppoqEShOjeEsZzQMQ54bWcDfJINwh3TKQVnsEg8sQKFRUsfkQWQMS-M8MjRRCar4MKX3yFn90tmwEjTJ5nfvHjmBPmkqoQ75da-fYRlMKzHFS0zo_q8vd0BWpx_dIemMR-_FEVnWk_HL2-jY-kKOLZBfupNNmQ
linkProvider ISSN International Centre
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Recurrent+neural+circuits+for+perceptual+grouping&rft.jtitle=Journal+of+vision+%28Charlottesville%2C+Va.%29&rft.au=Serre%2C+Thomas&rft.date=2022-12-05&rft.issn=1534-7362&rft.eissn=1534-7362&rft.volume=22&rft.issue=14&rft.spage=3185&rft_id=info:doi/10.1167%2Fjov.22.14.3185&rft.externalDBID=n%2Fa&rft.externalDocID=10_1167_jov_22_14_3185
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1534-7362&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1534-7362&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1534-7362&client=summon