NeTra-V: toward an object-based video representation

Yining Deng; Debargha Mukherjee; B. S. Manjunath

doi:10.1117/12.298443

23 December 1997 NeTra-V: toward an object-based video representation

Yining Deng, Debargha Mukherjee, B. S. Manjunath

Proceedings Volume 3312, Storage and Retrieval for Image and Video Databases VI; (1997) https://doi.org/10.1117/12.298443
Event: Photonics West '98 Electronic Imaging, 1998, San Jose, CA, United States

Abstract

There is a growing need for new representations of video that allow not only compact storage of data but also content-based functionalities such as search and manipulation of objects. We present here a prototype system, called NeTra-V, that is currently being developed to address some of these content related issues. The system has a two-stage video processing structure: a global feature extraction and clustering stage, and a local feature extraction and object-based representation stage. Key aspects of the system include a new spatio-temporal segmentation and object-tracking scheme, and a hierarchical object-based video representation model. The spatio-temporal segmentation scheme combines the color/texture image segmentation and affine motion estimation techniques. Experimental results show that the proposed approach can handle large motion. The output of the segmentation, the alpha plane as it is referred to in the MPEG-4 terminology, can be used to compute local image properties. This local information forms the low-level content description module in our video representation. Experimental results illustrating spatio- temporal segmentation and tracking are provided.

Citation Download Citation

Yining Deng, Debargha Mukherjee, and B. S. Manjunath "NeTra-V: toward an object-based video representation", Proc. SPIE 3312, Storage and Retrieval for Image and Video Databases VI, (23 December 1997); https://doi.org/10.1117/12.298443

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available