Exploiting semantics for scheduling real-time data collection from sensors to maximize event detection

Ronen Vaisenberg; Sharad Mehrotra; Deva Ramanan

doi:10.1117/12.816255

19 January 2009 Exploiting semantics for scheduling real-time data collection from sensors to maximize event detection

Ronen Vaisenberg, Sharad Mehrotra, Deva Ramanan

Proceedings Volume 7253, Multimedia Computing and Networking 2009; 72530B (2009) https://doi.org/10.1117/12.816255
Event: IS&T/SPIE Electronic Imaging, 2009, San Jose, California, United States

Abstract

A distributed camera network allows for many compelling applications such as large-scale tracking or event detection. In most practical systems, resources are constrained. Although one would like to probe every camera at every time instant and store every frame, this is simply not feasible. Constraints arise from network bandwidth restrictions, I/O and disk usage from writing images, and CPU usage needed to extract features from the images. Assume that, due to resource constraints, only a subset of sensors can be probed at any given time unit. This paper examines the problem of selecting the "best" subset of sensors to probe under some user-specified objective - e.g., detecting as much motion as possible. With this objective, we would like to probe a camera when we expect motion, but would not like to waste resources on a non-active camera. The main idea behind our approach is the use of sensor semantics to guide the scheduling of resources. We learn a dynamic probabilistic model of motion correlations between cameras, and use the model to guide resource allocation for our sensor network. Although previous work has leveraged probabilistic models for sensor-scheduling, our work is distinct in its focus on real-time building-monitoring using a camera network. We validate our approach on a sensor network of a dozen cameras spread throughout a university building, recording measurements of unscripted human activity over a two week period. We automatically learnt a semantic model of typical behaviors, and show that one can significantly improve effciency of resource allocation by exploiting this model.

Citation Download Citation

Ronen Vaisenberg, Sharad Mehrotra, and Deva Ramanan "Exploiting semantics for scheduling real-time data collection from sensors to maximize event detection", Proc. SPIE 7253, Multimedia Computing and Networking 2009, 72530B (19 January 2009); https://doi.org/10.1117/12.816255

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available