Parallel Sampling of HDPs using Sub-Cluster Splits

Part of Advances in Neural Information Processing Systems 27 (NIPS 2014)

Bibtex »Metadata »Paper »Reviews »Supplemental »

Authors

Jason Chang, John W. Fisher III

Abstract

<p>We develop a sampling technique for Hierarchical Dirichlet process models. The parallel algorithm builds upon [Chang &amp; Fisher 2013] by proposing large split and merge moves based on learned sub-clusters. The additional global split and merge moves drastically improve convergence in the experimental results. Furthermore, we discover that cross-validation techniques do not adequately determine convergence, and that previous sampling methods converge slower than were previously expected.</p>