Bagged structure learning of Bayesian networks

Research output: Contribution to journalConference articlepeer-review


We present a novel approach for density estimation using Bayesian networks when faced with scarce and partially observed data. Our approach relies on Efron's bootstrap frame-work, and replaces the standard model selection score by a bootstrap aggregation objective aimed at sifting out bad decisions during the learning procedure. Unlike previous bootstrap or MCMC based approaches that are only aimed at recovering specific structural features, we learn a concrete density model that can be used for probabilistic generalization. To make use of our objective when some of the data is missing, we propose a bagged structural EM procedure that does not incur the heavy computational cost typically associated with a bootstrap-based approach. We compare our bagged objective to the Bayesian score and the Bayesian information criterion (BIC), as well as other bootstrap-based model selection objectives, and demonstrate its effectiveness in improving generalization performance for varied real-life datasets.

Original languageEnglish
Pages (from-to)251-259
Number of pages9
JournalProceedings of Machine Learning Research
StatePublished - 2011
Event14th International Conference on Artificial Intelligence and Statistics, AISTATS 2011 - Fort Lauderdale, FL, United States
Duration: 11 Apr 201113 Apr 2011

All Science Journal Classification (ASJC) codes

  • Software
  • Control and Systems Engineering
  • Statistics and Probability
  • Artificial Intelligence


Dive into the research topics of 'Bagged structure learning of Bayesian networks'. Together they form a unique fingerprint.

Cite this