Comparison of kernel based PDF estimation methods

David E. Freund; Philippe Burlina; Amit Banerjee; Erik Justen

doi:10.1117/12.819115

4 May 2009 Comparison of kernel based PDF estimation methods

David E. Freund, Philippe Burlina, Amit Banerjee, Erik Justen

Proceedings Volume 7335, Automatic Target Recognition XIX; 733508 (2009) https://doi.org/10.1117/12.819115
Event: SPIE Defense, Security, and Sensing, 2009, Orlando, Florida, United States

Abstract

There are a number of challenging estimation, tracking, and decision theoretic problems that require the estimation of Probability Density Functions (PDFs). When using a traditional parametric approach, the functional model of the PDF is assumed to be known. However, these models often do not capture the complexity of the underlying distribution. Furthermore, the problems of validating the model and estimating its parameters are often complicated by the sparsity of prior examples. The need for exemplars grows exponentially with the dimension of the feature space. These methods may yield PDFs that do not generalize well to unseen data because these tend to overfit or underfit the training exemplars. We investigate and compare alternate approaches for estimating a PDF and consider instead kernel based estimation methods which generalize the Parzen estimator and use a Linear Mixture of Kernels (LMK) model. The methods reported here are derived from machine learning methods such as the Support Vector Machines and the Relevance Vector Machines. These PDF estimators provide the following benefits: (a) they are data driven; (b) they do not overfit the data and consequently have good generalization properties; (c) they can accommodate highly irregular and multi-modal data distributions; (d) they provide a sparse and succinct description of the underlying data which leads to efficient computation and communication. Comparative experimental results are provided illustrating these properties using simulated Mixture of Gaussian-distributed data.

Citation Download Citation

David E. Freund, Philippe Burlina, Amit Banerjee, and Erik Justen "Comparison of kernel based PDF estimation methods", Proc. SPIE 7335, Automatic Target Recognition XIX, 733508 (4 May 2009); https://doi.org/10.1117/12.819115

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available