Skip to main navigation Skip to search Skip to main content

On hyper-parameter estimation in empirical Bayes: A revisit of the MacKay algorithm

  • Chune Li
  • , Yongyi Mao
  • , Richong Zhang
  • , Jinpeng Huai*
  • *Corresponding author for this work
  • Beihang University
  • University of Ottawa

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

An iterative procedure introduced in MacKay's evidence framework is often used for estimating the hyper-parameter in empirical Bayes. Despite its effectiveness, the procedure has stayed primarily as a heuristic to date. This paper formally investigates the mathematical nature of this procedure and justifies it as a well-principled algorithm framework. This framework, which we call the MacKay algorithm, is shown to be closely related to the EM algorithm under certain Gaussian assumption.

Original languageEnglish
Title of host publicationUncertainty in Artificial Intelligence - Proceedings of the 32nd Conference, UAI 2016
EditorsAlexander Ihler, Dominik Janzing
PublisherAssociation For Uncertainty in Artificial Intelligence (AUAI)
Pages477-486
Number of pages10
ISBN (Electronic)9780996643115
StatePublished - 2016
Event32nd Conference on Uncertainty in Artificial Intelligence, UAI 2016 - Jersey City, United States
Duration: 25 Jun 201629 Jun 2016

Publication series

Name32nd Conference on Uncertainty in Artificial Intelligence 2016, UAI 2016

Conference

Conference32nd Conference on Uncertainty in Artificial Intelligence, UAI 2016
Country/TerritoryUnited States
CityJersey City
Period25/06/1629/06/16

Fingerprint

Dive into the research topics of 'On hyper-parameter estimation in empirical Bayes: A revisit of the MacKay algorithm'. Together they form a unique fingerprint.

Cite this