Author : Jiaming Song
Publisher :
ISBN 13 :
Total Pages : pages
Book Rating : 4.:/5 (126 download)
Book Synopsis Compression, Generation, and Inference Via Supervised Learning by : Jiaming Song
Download or read book Compression, Generation, and Inference Via Supervised Learning written by Jiaming Song and published by . This book was released on 2021 with total page pages. Available in PDF, EPUB and Kindle. Book excerpt: Artificial intelligence and machine learning methods have seen tremendous advances in the past decade, thanks to deep neural networks. Supervised learning methods enables neural networks to effectively approximate low-level functions of human intelligence, such as identifying an object within an image. However, many complex functions of human intelligence are difficult to solve with supervised learning directly: humans can build concise representations of the world (compression), generate works of art based on creative imaginations (generation), and infer how others will act from personal experiences (inference). In this dissertation, we focus on machine learning approaches that reduce these complex functions of human intelligence into simpler ones that can be readily solved with supervised learning and thus enabling us to leverage the developments in deep learning. This dissertation comprises of three parts, namely compression, generation, and inference. The first part discusses how we can apply supervised learning to unsupervised representation learning. We develop algorithms that can learn informative representations from large unlabeled datasets while protecting certain sensitive attributes. The second part extends these ideas to learning high-dimensional probabilistic models of unlabeled data. Combined with the insights from the first part, we introduce a generative model suitable for conditional generation under limited supervision. In the third and final part, we present two applications of supervised learning in probabilistic inference methods: (a) optimizing for efficient Bayesian inference algorithms and (b) inferring the agents' intent under complex, multi-agent environments. These contributions enable machines to overcome existing limitations of supervised learning in real-world compression, generation, and inference problems.