Where academic tradition
meets the exciting future

You are here: TUCS > PUBLICATIONS > Publication Search > Fast and Simple Gradient-Based...

Fast and Simple Gradient-Based Optimization for Semi-Supervised Support Vector Machines

Fabian Gieseke, Antti Airola, Tapio Pahikkala, Oliver Kramer, Fast and Simple Gradient-Based Optimization for Semi-Supervised Support Vector Machines. Neurocomputing 123, 23–32, 2014.

http://dx.doi.org/10.1016/j.neucom.2012.12.056

Abstract:

One of the main learning tasks in machine learning is the one of classifying data items. The basis for such a task is usually a training set consisting of labeled patterns. In real-world settings, however, such labeled data are usually scarce, and the corresponding models might yield unsatisfying results. Unlabeled data, on the other hand, can often be obtained in huge quantities without much additional effort. A prominent research direction in the field of machine learning is semi-supervised support vector machines. This type of binary classification approach aims at taking the additional information provided by the unlabeled patterns into account to reveal more information about the structure of the data at hand. In some cases, this can yield significantly better classification results compared to a straightforward application of supervised models. One drawback, however, is the fact that generating such models requires solving difficult non-convex optimization tasks. In this work, we present a simple but effective gradient-based optimization framework to address the induced problems. The resulting method can be implemented easily using black-box optimization engines and yields excellent classification and runtime results on both sparse and non-sparse data sets.

BibTeX entry:

@ARTICLE{jGiAiPaKr14a,
  title = {Fast and Simple Gradient-Based Optimization for Semi-Supervised Support Vector Machines},
  author = {Gieseke, Fabian and Airola, Antti and Pahikkala, Tapio and Kramer, Oliver},
  journal = {Neurocomputing},
  volume = {123},
  pages = {23–32},
  year = {2014},
  ISSN = {0925-2312},
}

Belongs to TUCS Research Unit(s): Algorithmics and Computational Intelligence Group (ACI)

Publication Forum rating of this publication: level 1

Edit publication