• TUCS Publication Series
• How to Publish in TUCS Series
• Publication Search
• Publication Graph
• Publication Input
• Publication Input Guide
• JuFo Browser

Large Scale Training Methods for Linear RankRLS

Antti Airola, Tapio Pahikkala, Tapio Salakoski, Large Scale Training Methods for Linear RankRLS. In: Eyke Fürnkranz Johannes Hüllermeier (Ed.), ECML/PKDD-10 Workshop on Preference Learning, 2010.

Abstract:

RankRLS is a recently proposed state-of-the-art method for learning ranking functions by minimizing a pairwise ranking error. The method can be trained by solving a system of linear equations. In this work, we investigate the use of conjugate gradient and regularization by iteration for linear RankRLS training on very large and high dimensional, but sparse data sets. Such data is typically encountered for example in applications where natural language based data is used. We show that even though a pairwise loss function is optimized when training RankRLS, the computational complexity of the proposed methods, when learning from data with utility scores, is O(tms), where t is the required number of iterations, m the number of training examples and s the average number of non-zero features per example. In addition, the complexity of learning from pairwise preferences is O(tms+tl), where l is the number of observed preferences in the training set. In the experiments, it is further confirmed that restricting the number of conjugate gradient iterations has a regularizing effect and that the number of iterations that provides optimal results is, in practice, a small constant. Thus, the use of regularization by iteration, while providing similar performance as the more well-known Tikhonov regularization, results in a tremendous reduction in the computational cost of training and parameter selection.

Files:

Full publication in PDF-format

BibTeX entry:

@INPROCEEDINGS{inpAiPaSa10a,
  title = {Large Scale Training Methods for Linear RankRLS},
  booktitle = {ECML/PKDD-10 Workshop on Preference Learning},
  author = {Airola, Antti and Pahikkala, Tapio and Salakoski, Tapio},
  editor = {Hüllermeier, Eyke Fürnkranz Johannes},
  year = {2010},
  keywords = {RankRLS, ranking, preference learning, regularized least-squares, machine learning},
}

Belongs to TUCS Research Unit(s): Turku BioNLP Group

Edit publication