Efficient learning with partially observed attributes

Nicolò Cesa-Bianchi, Shai Shalev-Shwartz, Ohad Shamir

Research output: Contribution to journalArticlepeer-review

Abstract

We investigate three variants of budgeted learning, a setting in which the learner is allowed to access a limited number of attributes from training or test examples. In the "local budget" setting, where a constraint is imposed on the number of available attributes per training example, we design and analyze an efficient algorithm for learning linear predictors that actively samples the attributes of each training instance. Our analysis bounds the number of additional examples sufficient to compensate for the lack of full information on the training set. This result is complemented by a general lower bound for the easier "global budget" setting, where it is only the overall number of accessible training attributes that is being constrained. In the third, "prediction on a budget" setting, when the constraint is on the number of available attributes per test example, we show that there are cases in which there exists a linear predictor with zero error but it is statistically impossible to achieve arbitrary accuracy without full information on test examples. Finally, we run simple experiments on a digit recognition problem that reveal that our algorithm has a good performance against both partial information and full information baselines.

Original languageAmerican English
Pages (from-to)2857-2878
Number of pages22
JournalJournal of Machine Learning Research
Volume12
StatePublished - Oct 2011

Keywords

  • Budgeted learning
  • Learning theory
  • Learning with partial information
  • Linear predictors
  • Statistical learning

All Science Journal Classification (ASJC) codes

  • Software
  • Artificial Intelligence
  • Control and Systems Engineering
  • Statistics and Probability

Fingerprint

Dive into the research topics of 'Efficient learning with partially observed attributes'. Together they form a unique fingerprint.

Cite this