Author : Paraschos Koutris
Publisher :
ISBN 13 : 9781680834079
Total Pages : 131 pages
Book Rating : 4.8/5 (34 download)
Book Synopsis Algorithmic Aspects of Parallel Data Processing by : Paraschos Koutris
Download or read book Algorithmic Aspects of Parallel Data Processing written by Paraschos Koutris and published by . This book was released on 2017 with total page 131 pages. Available in PDF, EPUB and Kindle. Book excerpt: In the last decade or so we have witnessed a growing interest in processing large data sets on large distributed clusters. The idea was pioneered by the MapReduce framework, and has been widely adopted by several other systems, including PigLatin, Hive, Scope, U-SQL, Dremmel, Spark and Myria. A large part of the complex data analysis performed by these systems consists of a sequence of relatively simple query operations, such as joining two or more tables. This survey discusses recent algorithmic developments for distributed data processing. It uses a theoretical model of parallel processing called the Massively Parallel Computation (MPC) model, which is a simplification of the BSP model where the only cost is given by the amount of communication and the number of communication rounds. The survey studies several algorithms for multi-join queries, for sorting, and for matrix multiplication, and discusses their relationships and common techniques applied across the different data processing tasks.