Where academic tradition
meets the exciting future

You are here: TUCS > PUBLICATIONS > Publication Search > Matrix Representations, Linear...

Matrix Representations, Linear Transformations, and Kernels for Disambiguation in Natural Language

Tapio Pahikkala, Sampo Pyysalo, Jorma Boberg, Jouni Järvinen, Tapio Salakoski, Matrix Representations, Linear Transformations, and Kernels for Disambiguation in Natural Language. Machine Learning 74(2), 133–158, 2009.

Abstract:

In the application of machine learning methods with natural language inputs, the words and their positions in the input text are some of the most important features. In this article, we introduce a framework based on a word-position matrix representation of text, linear feature transformations of the word-position matrices, and kernel functions constructed from the transformations. We consider two categories of transformations, one based on word similarities and the second on their positions, which can be applied simultaneously in the framework in an elegant way. We show how word and positional similarities obtained by applying previously proposed techniques, such as latent semantic analysis, can be incorporated as transformations in the framework. We also introduce novel ways to determine word and positional similarities. We further present efficient algorithms for computing kernel functions incorporating the transformations on the word-position matrices, and, more importantly, introduce a highly efficient method for prediction. The framework is particularly suitable to natural language disambiguation tasks where the aim is to select for a single word a particular property from a set of candidates based on the context of the word. We demonstrate the applicability of the framework to this type of tasks using context-sensitive spelling error correction on the Reuters News corpus as a model problem.

Files:

Full publication in PDF-format

BibTeX entry:

@ARTICLE{jPaPyBoJaSa08a,
  title = {Matrix Representations, Linear Transformations, and Kernels for Disambiguation in Natural Language},
  author = {Pahikkala, Tapio and Pyysalo, Sampo and Boberg, Jorma and Järvinen, Jouni and Salakoski, Tapio},
  journal = {Machine Learning},
  volume = {74},
  number = {2},
  pages = {133–158},
  year = {2009},
  keywords = {Kernel methods, Linear transformations, Natural language processing, Disambiguation},
}

Belongs to TUCS Research Unit(s): Algorithmics and Computational Intelligence Group (ACI), Turku BioNLP Group

Publication Forum rating of this publication: level 3

Edit publication