Where academic tradition
meets the exciting future

New Bundle Method for Clusterwise Linear Regression Utilizing Support Vector Machines

Kaisa Joki, Adil M. Bagirov, Napsu Karmitsa, Marko M. Mäkelä, Sona Taheri, New Bundle Method for Clusterwise Linear Regression Utilizing Support Vector Machines. TUCS Technical Reports 1190, TUCS, 2017.

Abstract:

Clusterwise linear regression (CLR) aims to simultaneously partition a data into a given number of clusters and find regression coefficients for each cluster. In this paper, we propose a novel approach to solve the CLR problem. The main idea is to utilize the support vector machine (SVM) approach to model the CLR problem by using the SVM for regression to approximate each cluster. This new formulation of CLR is represented as an unconstrained nonsmooth optimization problem, where the objective function is a difference of convex (DC) functions. A method based on the combination of the incremental algorithm and the double bundle method for DC optimization is designed to solve it. Numerical experiments are made to validate the reliability of the new formulation and the efficiency of the proposed method. The results show that the SVM approach is beneficial in solving CLR problems, especially, when there are outliers in data.

Files:

Full publication in PDF-format

BibTeX entry:

@TECHREPORT{tJoBaKaMxTa17b,
  title = {New Bundle Method for Clusterwise Linear Regression Utilizing Support Vector Machines},
  author = {Joki, Kaisa and Bagirov, Adil M. and Karmitsa, Napsu and Mäkelä, Marko M. and Taheri, Sona},
  number = {1190},
  series = {TUCS Technical Reports},
  publisher = {TUCS},
  year = {2017},
  ISBN = {978-952-12-3653-2},
}

Belongs to TUCS Research Unit(s): Turku Optimization Group (TOpGroup)

Edit publication