Focal plane generation of multi-resolution and multi-scale image representation for low-power vision applications

J. Fernández-Berni; R. Carmona-Galán; L. Carranza-González; A. Zarándy; Á. Rodríguez-Vázquez

doi:10.1117/12.883881

20 May 2011 Focal plane generation of multi-resolution and multi-scale image representation for low-power vision applications

J. Fernández-Berni, R. Carmona-Galán, L. Carranza-González, A. Zarándy, Á. Rodríguez-Vázquez

Author Affiliations +

Proceedings Volume 8012, Infrared Technology and Applications XXXVII; 80120E (2011) https://doi.org/10.1117/12.883881
Event: SPIE Defense, Security, and Sensing, 2011, Orlando, Florida, United States

Abstract

Early vision stages represent a considerably heavy computational load. A huge amount of data needs to be processed under strict timing and power requirements. Conventional architectures usually fail to adhere to the specifications in many application fields, especially when autonomous vision-enabled devices are to be implemented, like in lightweight UAVs, robotics or wireless sensor networks. A bioinspired architectural approach can be employed consisting of a hierarchical division of the processing chain, conveying the highest computational demand to the focal plane. There, distributed processing elements, concurrent with the photosensitive devices, influence the image capture and generate a pre-processed representation of the scene where only the information of interest for subsequent stages remains. These focal-plane operators are implemented by analog building blocks, which may individually be a little imprecise, but as a whole render the appropriate image processing very efficiently. As a proof of concept, we have developed a 176x144-pixel smart CMOS imager that delivers lighter but enriched representations of the scene. Each pixel of the array contains a photosensor and some switches and weighted paths allowing reconfigurable resolution and spatial filtering. An energy-based image representation is also supported. These functionalities greatly simplify the operation of the subsequent digital processor implementing the high level logic of the vision algorithm. The resulting figures, 5.6mW@30fps, permit the integration of the smart image sensor with a wireless interface module (Imote2 from Memsic Corp.) for the development of vision-enabled WSN applications.

Citation Download Citation

J. Fernández-Berni, R. Carmona-Galán, L. Carranza-González, A. Zarándy, and Á. Rodríguez-Vázquez "Focal plane generation of multi-resolution and multi-scale image representation for low-power vision applications", Proc. SPIE 8012, Infrared Technology and Applications XXXVII, 80120E (20 May 2011); https://doi.org/10.1117/12.883881

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
8 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Diffusion

Image processing

Sensor networks

Prototyping

Analog electronics

Image filtering

Gaussian filters

Show All Keywords

Keywords/Phrases

Search In:

Publication Years