Activity-based video indexing and search

Yang Chen; Qin Jiang; Swarup Medasani; David Allen; Tsai-ching Lu

doi:10.1117/12.850491

28 April 2010 Activity based video indexing and search

Yang Chen, Qin Jiang, Swarup Medasani, David Allen, Tsai-ching Lu

Proceedings Volume 7708, Mobile Multimedia/Image Processing, Security, and Applications 2010; 77080K (2010) https://doi.org/10.1117/12.850491
Event: SPIE Defense, Security, and Sensing, 2010, Orlando, Florida, United States

Abstract

We describe a method for searching videos in large video databases based on the activity contents present in the videos. Being able to search videos based on the contents (such as human activities) has many applications such as security, surveillance, and other commercial applications such as on-line video search. Conventional video content-based retrieval (CBR) systems are either feature based or semantics based, with the former trying to model the dynamics video contents using the statistics of image features, and the latter relying on automated scene understanding of the video contents. Neither approach has been successful. Our approach is inspired by the success of visual vocabulary of "Video Google" by Sivic and Zisserman, and the work of Nister and Stewenius who showed that building a visual vocabulary tree can improve the performance in both scalability and retrieval accuracy for 2-D images. We apply visual vocabulary and vocabulary tree approach to spatio-temporal video descriptors for video indexing, and take advantage of the discrimination power of these descriptors as well as the scalability of vocabulary tree for indexing. Furthermore, this approach does not rely on any model-based activity recognition. In fact, training of the vocabulary tree is done off-line using unlabeled data with unsupervised learning. Therefore the approach is widely applicable. Experimental results using standard human activity recognition videos will be presented that demonstrate the feasibility of this approach.

Citation Download Citation

Yang Chen, Qin Jiang, Swarup Medasani, David Allen, and Tsai-ching Lu "Activity based video indexing and search", Proc. SPIE 7708, Mobile Multimedia/Image Processing, Security, and Applications 2010, 77080K (28 April 2010); https://doi.org/10.1117/12.850491

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available