A 240 × 180 130 dB 3 µs Latency Global Shutter Spatiotemporal Vision Sensor Christian Brandli,S t u d e n tM e m b e r ,I E E E

Abstract

Event-based dynamic vision sensors (DVSs) asyn- chronously report log intensity changes. Their high dynamic range, sub-ms latency and sparse output make them useful in applications such as robotics and real-time tracking. However they discard absolute intensity information which is useful for object recognition and classi fication. This paper presents a dynamic and active pixel vision sensor (DA VIS) which addresses this de ficiency by outputting asynchronous DVS events and synchronous global shutter frames concurrently. The active pixel sensor (APS) circuits and the DVS circuits within a pixel share a single photodiode. Measurements from a 240×180 sensor array of 18.5 µm 2 pixels fab- ricated in a 0.18 µm 6M1P CMOS image sensor (CIS) technology show a dynamic range of 130 dB with 11% contrast detection threshold, minimum 3 µs latency, and 3.5% contrast matching for the DVS pathway; and a 51 dB dynamic range with 0.5% FPN for the APS readout.