A Single‐Pixel Event Photoactive Device for Real‐Time, In‐Sensor Spatiotemporal Optical Information Processing

The increasing demand for energy‐efficient, sophisticated optical sensing technologies in various applications, from machine vision to optical communication, highlights the necessity for innovations in spatiotemporal information sensing and processing at a nearly single‐pixel scale. Traditional meth...

Full description

Saved in:
Bibliographic Details
Published in:Advanced materials (Weinheim) Vol. 37; no. 1; pp. e2406607 - n/a
Main Authors: Kumar, Mohit, Park, Hayoung, Seo, Hyungtak
Format: Journal Article
Language:English
Published: Germany Wiley Subscription Services, Inc 01.01.2025
Subjects:
Data processing
Energy consumption
event sensing photoactive device
Information processing
in‐sensor processing
Machine vision
Optical data processing
Optical flow (image analysis)
Parallel processing
Pattern recognition
Photometers
Pixels
Position sensing
Sensor arrays
Sensors
short‐term memory
spatiotemporal
Spatiotemporal data
ultralow energy
event sensing photoactive device
short‐term memory
spatiotemporal
ultralow energy
in‐sensor processing
ISSN:0935-9648, 1521-4095, 1521-4095
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:The increasing demand for energy‐efficient, sophisticated optical sensing technologies in various applications, from machine vision to optical communication, highlights the necessity for innovations in spatiotemporal information sensing and processing at a nearly single‐pixel scale. Traditional methods, including multi‐pixel photodetector arrays and event‐based camera systems, often fail to provide rapid, real‐time detection and processing of dynamic events within the sensor. This shortcoming is particularly notable in handling high‐dimensional spatiotemporal data, where the dependency on sequential data input and external processing tools leads to latency, reduced throughput, and heightened energy consumption, thereby impeding real‐time parallel data processing capabilities. Here, a carrier‐selective, single‐pixel, position‐sensitive planar photoactive device that integrates spatiotemporal event sensing with inherent short‐term memory capabilities is introduced. The proof‐of‐concept single‐pixel event photoactive device enables in‐sensor spatiotemporal parallel optical information processing, efficiently managing multibit (>4 bit) data simultaneously and facilitating ultrafast (≈0.4 µs) recognition of input patterns with low energy consumption (25 femtojoules). Additionally, by adjusting the operating speed from continuous to pulsed light illumination, the sensor array can detect trajectories and absolute position of events, offering in‐sensor optical flow detection. This single‐pixel event photodetector marks significant advancement toward developing compact, energy‐efficient, ultrafast sensors suitable for a wide range of in sensor‐based photonic applications. This research introduces a single‐pixel event photoactive device with selective carrier integration that merges spatiotemporal event sensing and built‐in short‐term memory. It processes multibit parallel data and recognizes patterns ultrafast (0.4 µs) with ultralow energy use (25 femtojoules). Adjusting its speed allows trajectory and position detection of events through optical flow sensing.
Bibliography:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
content type line 23
ISSN:0935-9648
1521-4095
1521-4095
DOI:10.1002/adma.202406607