A1m J / F r a m eU n ified Media Application Processor With Dynamic Analog-Digital Mode Recon figuration for Embedded 3D-Media Contents Processing Hyo-Eun Kim, Student Member , IEEE, Jun-Seok Park , Student Member , IEEE, Jae-Sung Y oon, Member , IEEE, Seok-Hoon Kim, Student Member , IEEE

Abstract

In this paper, a uni fied media application pro- cessor (UMAP) is presented for 2D /3D image analysis/synthesis applications on handheld devices . UMAP integrates parallel and sequential processing layers which consist of heterogeneous functional IPs for general media contents processing on today’s ap- plication processors (AP). Ba sed on the heterogeneous many-core platform, UMAP supports not only graphics and vision processing for real-time augmented reality (AR) but also disparity estimation and 3D display synthesis f or 3D-view AR acceleration. A new concept of 3D-view AR which synthesizes 3D display contents from two vertically aligned stereo images and a self-constructed disparity map is introd uced to achieve true realism for next generation mobile devices. For l ow-cost 3D-view AR processing, a homography-based disparity estimation (HDE) algorithm is pro- posed to construct a disparity map between two stereo images with small implementation overhead. For real-time and energy-efficient system organization, workload-balanced 3-stage pipelined archi- tecture and a mix ed-mode feature extraction engine (FEE) are also implemented in UMAP. The 3-stage pipelined system which consists of graphics, vision, and d isplay operatio n stages reduces per-frame exec ution latency, while dynamic analog/digital mode reconfiguration based on mixed-m ode FEE reduces per-frame energy dissipation, so real-time energy-ef ficient 3D-view AR can be realized in UMAP. FEE performs high-speed corner