Learning bounds via sample width for classifiers on finite metric spaces

Martin Anthony, Joel Ratsaby

Research output: Contribution to journalArticlepeer-review

Abstract

In a recent paper [M. Anthony, J. Ratsaby, Maximal width learning of binary functions, Theoretical Computer Science 411 (2010) 138-147] the notion of sample width for binary classifiers mapping from the real line was introduced, and it was shown that the performance of such classifiers could be quantified in terms of this quantity. This paper considers how to generalize the notion of sample width so that we can apply it where the classifiers map from some finite metric space. By relating the learning problem to one involving the domination numbers of certain graphs, we obtain generalization error bounds that depend on the sample width and on certain measures of 'density' of the underlying metric space. We also discuss how to employ a greedy set-covering heuristic to bound generalization error.

Original languageAmerican English
Pages (from-to)2-10
Number of pages9
JournalTheoretical Computer Science
Volume529
DOIs
StatePublished - 1 Jan 2014

Keywords

  • Generalization error
  • Learning algorithms
  • Machine learning

All Science Journal Classification (ASJC) codes

  • Theoretical Computer Science
  • General Computer Science

Fingerprint

Dive into the research topics of 'Learning bounds via sample width for classifiers on finite metric spaces'. Together they form a unique fingerprint.

Cite this