The maximum cosine framework for deriving perceptron based linear classifiers

Nader H. Bshouty, Catherine A. Haddad-Zaknoon

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

In this work, we introduce a mathematical framework, called the Maximum Cosine Framework or MCF, for deriving new linear classifiers. The method is based on selecting an appropriate bound on the cosine of the angle between the target function and the algorithm’s. To justify its correctness, we use the MCF to show how to regenerate the update rule of Aggressive ROMMA [5]. Moreover, we construct a cosine bound from which we build the Maximum Cosine Perceptron algorithm or, for short, the MCP algorithm. We prove that the MCP shares the same mistake bound like the Perceptron [6]. In addition, we demonstrate the promising performance of the MCP on a real dataset. Our experiments show that, under the restriction of single pass learning, the MCP algorithm outperforms PA [1] and Aggressive ROMMA.

Original languageEnglish
Title of host publicationAlgorithmic Learning Theory - 27th International Conference, ALT 2016, Proceedings
EditorsHans Ulrich Simon, Sandra Zilles, Ronald Ortner
Pages207-222
Number of pages16
DOIs
StatePublished - 2016
Event27th International Conference on Algorithmic Learning Theory, ALT 2016 - Bari, Italy
Duration: 19 Oct 201621 Oct 2016

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume9925 LNAI

Conference

Conference27th International Conference on Algorithmic Learning Theory, ALT 2016
Country/TerritoryItaly
CityBari
Period19/10/1621/10/16

Keywords

  • Linear classifiers
  • Online learning
  • Perceptron

All Science Journal Classification (ASJC) codes

  • Theoretical Computer Science
  • General Computer Science

Cite this