iVisual: An Intelligent Visual Sensor SoC with 2790fps CMOS Image Sensor and 205GOPS/W Vision Processor

📋 论文概要

该论文提出了一款名为iVisual的智能视觉传感器SoC，集成了2790fps的高速CMOS图像传感器和能效高达205GOPS/W的视觉处理器。解决了传统模拟片上处理精度损失和灵活性不足的问题，以及视觉处理器中并行数据到标量转换的瓶颈。

💡 主要创新点

• 首次将高速CMOS图像传感器（2790fps）与高能效视觉处理器（205GOPS/W）单片集成，实现智能视觉传感。
• 提出了一种高效的视觉处理器架构，通过优化并行处理与决策处理的转换，降低了功耗并提升了能效。

🏷 关键词

📄 原文摘要

in surveillance, healthcare, intelligent vehicle control, human-machine interfaces, etc. Hardware solutions exist for video analysis. Analog on-sensor processing solutions [1] feature image sensor integration. However, the precision loss of analog signal processing prevents those solutions from realizing complex algorithms, and they lack flexibility. Vision processors [2,3] realize high GOPS numbers by combining a processor array for parallel operations and a decision processor for other ones. Converting from parallel data in the processor array to scalar in the decision processor creates a throughput bottleneck. Parallel memory accesses also lead to high power consumption. Privacy is a critical issue in setting up visual sensors because of the danger

👥 作者与机构

Chih-Chi Cheng1, Chia-Hua Lin1, Chung-Te Li1, Samuel Chang1,

Chia-Jung Hsu2, Liang-Gee Chen1 1 National Taiwan University, Taipei, Taiwan, 2UMC, Hsinchu, Taiwan Visual sensors combined with video analysis algorithms can enhance applications