Where academic tradition
meets the exciting future

You are here: TUCS > PUBLICATIONS > Publication Search > A Generative Model and a Gener...

A Generative Model and a Generalized Trust Region Newton Method for Noise Reduction

Seppo Pulkkinen, Marko M. Mäkelä, Napsu Karmitsa, A Generative Model and a Generalized Trust Region Newton Method for Noise Reduction. Computational Optimization and Applications 57(1), 129–165, 2014.

http://dx.doi.org/10.1007/s10589-013-9581-4

Abstract:

In practical applications related to, for instance, machine learning, data mining and pattern recognition, one is commonly dealing with noisy data lying near some low-dimensional manifold. A well-established tool for extracting the intrinsically low-dimensional structure from such data is principal component analysis (PCA). Due to the inherent limitations of this linear method, its extensions to extraction of nonlinear structures have attracted increasing research interest in recent years. Assuming a generative model for noisy data, we develop a probabilistic approach for separating the data-generating nonlinear functions from noise. We demonstrate that ridges of the marginal density induced by the model are viable estimators for the generating functions. For projecting a given point onto a ridge of its estimated marginal density, we develop a generalized trust region Newton method and prove its convergence to a ridge point. Accuracy of the model and computational efficiency of the projection method are assessed via numerical experiments where we utilize Gaussian kernels for nonparametric estimation of the underlying densities of the test datasets.

BibTeX entry:

@ARTICLE{jPuMxKa14a,
  title = {A Generative Model and a Generalized Trust Region Newton Method for Noise Reduction},
  author = {Pulkkinen, Seppo and Mäkelä, Marko M. and Karmitsa, Napsu},
  journal = {Computational Optimization and Applications},
  volume = {57},
  number = {1},
  publisher = {Springer},
  pages = {129–165},
  year = {2014},
  keywords = {Principal manifold; Noise reduction; Generative model; Ridge; Density estimation; Trust region; Newton method},
}

Belongs to TUCS Research Unit(s): Turku Optimization Group (TOpGroup)

Publication Forum rating of this publication: level 1

Edit publication