An O(m+n)-Space Spatiotemporal Denoising Filter with Cache-Like Memories for Dynamic Vision Sensors

Dynamic vision sensor (DVS) is novel neuromorphic imaging device that generates asynchronous events. Despite the high temporal resolution and high dynamic range features, DVS is faced with background noise problem. Spatiotemporal filter is an effective and hardware-friendly solution for DVS denoisin...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Digest of technical papers - IEEE/ACM International Conference on Computer-Aided Design S. 1 - 9
Hauptverfasser: Zhao, Qinghang, Wang, Jiaqi, Ji, Yixi, Wu, Jinjian, Shi, Guangming
Format: Tagungsbericht
Sprache:Englisch
Veröffentlicht: ACM 27.10.2024
Schlagworte:
ISSN:1558-2434
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Abstract Dynamic vision sensor (DVS) is novel neuromorphic imaging device that generates asynchronous events. Despite the high temporal resolution and high dynamic range features, DVS is faced with background noise problem. Spatiotemporal filter is an effective and hardware-friendly solution for DVS denoising but previous designs have large memory overhead or degraded performance issues. In this paper, we present a lightweight and real-time spatiotemporal denoising filter with set-associative cache-like memories, which has low space complexity of O(m+n) for DVS of m \times n resolution. A two-stage pipeline for memory access with read cancellation feature is proposed to reduce power consumption. Further the bitwidth redundancy for event storage is exploited to minimize the memory footprint. We implemented our design on FPGA and experimental results show that it achieves state-of-the-art performance compared with previous spatiotemporal filters while maintaining low resource utilization and low power consumption of about 125mW to 210mW at 100MHz clock frequency.
AbstractList Dynamic vision sensor (DVS) is novel neuromorphic imaging device that generates asynchronous events. Despite the high temporal resolution and high dynamic range features, DVS is faced with background noise problem. Spatiotemporal filter is an effective and hardware-friendly solution for DVS denoising but previous designs have large memory overhead or degraded performance issues. In this paper, we present a lightweight and real-time spatiotemporal denoising filter with set-associative cache-like memories, which has low space complexity of O(m+n) for DVS of m \times n resolution. A two-stage pipeline for memory access with read cancellation feature is proposed to reduce power consumption. Further the bitwidth redundancy for event storage is exploited to minimize the memory footprint. We implemented our design on FPGA and experimental results show that it achieves state-of-the-art performance compared with previous spatiotemporal filters while maintaining low resource utilization and low power consumption of about 125mW to 210mW at 100MHz clock frequency.
Author Shi, Guangming
Wu, Jinjian
Ji, Yixi
Zhao, Qinghang
Wang, Jiaqi
Author_xml – sequence: 1
  givenname: Qinghang
  surname: Zhao
  fullname: Zhao, Qinghang
  email: qhzhao@xidian.edu.cn
  organization: Xidian University,China
– sequence: 2
  givenname: Jiaqi
  surname: Wang
  fullname: Wang, Jiaqi
  organization: Xidian University,China
– sequence: 3
  givenname: Yixi
  surname: Ji
  fullname: Ji, Yixi
  organization: Xidian University,China
– sequence: 4
  givenname: Jinjian
  surname: Wu
  fullname: Wu, Jinjian
  organization: Xidian University,China
– sequence: 5
  givenname: Guangming
  surname: Shi
  fullname: Shi, Guangming
  organization: Xidian University,China
BookMark eNotj01LAzEYhKMoWOuevXjIUZGtyeb7WFqrQqWHqteSzb5rg7tJSRak_94VvczDwMzAXKKzEAMgdE3JjFIuHphUUjA5-6Wi5AQVRhnNCRmNUuwUTagQuqw44xeoyNnXRBIxBrieIDcPeHPb34e7cnuwDvCog48D9IeYbIeXEKLPPnzile8GSPjbD3u8sG4P5dp_AX6FPiYPGbcx4eUx2N47_DFWYsBbCDmmfIXOW9tlKP45Re-rx7fFc7nePL0s5uvSVoYOpW6U05xJqqTTNbSSaQPKEiqMJWAaq41VdWU50YQpLqSqeatZIxqoWtM4NkU3f7seAHaH5HubjjtKaSX5-P4HEDRXIw
ContentType Conference Proceeding
DBID 6IE
6IH
CBEJK
RIE
RIO
DOI 10.1145/3676536.3676710
DatabaseName IEEE Electronic Library (IEL) Conference Proceedings
IEEE Proceedings Order Plan (POP) 1998-present by volume
IEEE Xplore All Conference Proceedings
IEEE Electronic Library (IEL)
IEEE Proceedings Order Plans (POP) 1998-present
DatabaseTitleList
Database_xml – sequence: 1
  dbid: RIE
  name: IEEE Electronic Library (IEL)
  url: https://ieeexplore.ieee.org/
  sourceTypes: Publisher
DeliveryMethod fulltext_linktorsrc
Discipline Engineering
EISBN 9798400710773
EISSN 1558-2434
EndPage 9
ExternalDocumentID 11126424
Genre orig-research
GrantInformation_xml – fundername: National Natural Science Foundation of China
  grantid: 62104182
  funderid: 10.13039/501100001809
GroupedDBID 6IE
6IF
6IH
6IL
6IN
AAWTH
ABLEC
ADZIZ
ALMA_UNASSIGNED_HOLDINGS
BEFXN
BFFAM
BGNUA
BKEBE
BPEOZ
CBEJK
CHZPO
FEDTE
IEGSK
IJVOP
OCL
RIE
RIL
RIO
ID FETCH-LOGICAL-a291t-8d7c8436176c8bef6389e7a0159a0e9da89a7b2a4080374567b4f83d5de2f9dc3
IEDL.DBID RIE
ISICitedReferencesCount 0
ISICitedReferencesURI http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=001479882200231&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
IngestDate Wed Sep 03 07:09:38 EDT 2025
IsDoiOpenAccess false
IsOpenAccess true
IsPeerReviewed false
IsScholarly false
Language English
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-a291t-8d7c8436176c8bef6389e7a0159a0e9da89a7b2a4080374567b4f83d5de2f9dc3
OpenAccessLink https://dl.acm.org/doi/pdf/10.1145/3676536.3676710
PageCount 9
ParticipantIDs ieee_primary_11126424
PublicationCentury 2000
PublicationDate 2024-Oct.-27
PublicationDateYYYYMMDD 2024-10-27
PublicationDate_xml – month: 10
  year: 2024
  text: 2024-Oct.-27
  day: 27
PublicationDecade 2020
PublicationTitle Digest of technical papers - IEEE/ACM International Conference on Computer-Aided Design
PublicationTitleAbbrev ICCAD
PublicationYear 2024
Publisher ACM
Publisher_xml – name: ACM
SSID ssib060584048
ssj0020286
Score 1.9046147
Snippet Dynamic vision sensor (DVS) is novel neuromorphic imaging device that generates asynchronous events. Despite the high temporal resolution and high dynamic...
SourceID ieee
SourceType Publisher
StartPage 1
SubjectTerms Denoising
Dynamic Vision Sensor
Field programmable gate arrays
FPGA
Memory architecture
Memory management
Noise reduction
Pipeline processing
Power demand
Real-time systems
Spatiotemporal Filter
Spatiotemporal phenomena
Vision sensors
Voltage control
Title An O(m+n)-Space Spatiotemporal Denoising Filter with Cache-Like Memories for Dynamic Vision Sensors
URI https://ieeexplore.ieee.org/document/11126424
WOSCitedRecordID wos001479882200231&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV09T8MwELVoxQALX0V8ywMDCLlNEye2R9RSMZRSqVB1qxz7IkVAgvrB7-fshtKFgS3KFN1Fuvfu7r0j5LodiQCU4YxnyHR4DMC01CkTIcTCWMVTfwxm3BeDgZxM1LASq3stDAD45TNoukc_y7elWbpWWavt9C485DVSEyJZibV-fh433uMBX48QkNTLpPLyafO45ZzJ4ihpeocyp5fdOKbia0lv759fsU8av6o8OlzXmwOyBcUh2d0wFDwi5r6gzzcfd8UtGyEZBjryC9OV_9Q77UJR5q47QHu5G5NT14alHWfqzPr5G9Ant3iL5JkilqXd1bV6Ovb6czpCxlvO5g3y2nt46Tyy6owC06FqL5i0wkgeIVRJjEwhcxgFhEYcoDTmyWqptEhDzRE8RgIBlUh5JiMbWwgzZU10TOpFWcAJoVni_OcCCxp5ZaBTjYADgyk1t5HiOjklDRev6efKKWP6E6qzP96fkx3ME3e1IBQXpL6YLeGSbJuvRT6fXfn8fgMJ4aSU
linkProvider IEEE
linkToHtml http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV3JTsMwELWgIAEXtiJ2fOAAQm6zOLFzRC1VEWmp1FL1Vjn2RIqABHXh-7HdtPTCgVuUUzQTad6bmfcGoVvXZw5EkhKaaqZDAwAiuEgI8yBgUkU0scdghjHrdvloFPVKsbrVwgCAXT6Dmnm0s3xVyLlpldVdo3ehHt1EW-Z0VinXWv4-ZsBHHboaImhaz8PSzcelQd14kwV-WLMeZUYxu3ZOxVaT1v4_v-MAVX91ebi3qjiHaAPyI7S3Zil4jORjjl_vPh_ye9LXdBhw365Mlw5UH7gJeZGZ_gBuZWZQjk0jFjeMrTOJs3fAHbN6q-kz1mgWNxf36vHQKtBxX3PeYjKtorfW06DRJuUhBSK8yJ0Rrpjk1NdgJZQ8gdSgFGBCI4FI6EwpwSPBEk9QDR99piEVS2jKfRUo8NJISf8EVfIih1OE09A40DkKhGaWjkiEhhw6mFxQ5UdUhGeoauI1_lp4ZYyXoTr_4_0N2mkPOvE4fu6-XKBdnTNqKoPHLlFlNpnDFdqW37NsOrm2uf4Bzd6n3Q
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=proceeding&rft.title=Digest+of+technical+papers+-+IEEE%2FACM+International+Conference+on+Computer-Aided+Design&rft.atitle=An+O%28m%2Bn%29-Space+Spatiotemporal+Denoising+Filter+with+Cache-Like+Memories+for+Dynamic+Vision+Sensors&rft.au=Zhao%2C+Qinghang&rft.au=Wang%2C+Jiaqi&rft.au=Ji%2C+Yixi&rft.au=Wu%2C+Jinjian&rft.date=2024-10-27&rft.pub=ACM&rft.eissn=1558-2434&rft.spage=1&rft.epage=9&rft_id=info:doi/10.1145%2F3676536.3676710&rft.externalDocID=11126424