A Study Of Sequential And Parallel Sorting Algorithms

Download A Study Of Sequential And Parallel Sorting Algorithms full books in PDF, epub, and Kindle. Read online A Study Of Sequential And Parallel Sorting Algorithms ebook anywhere anytime directly on your device. Fast Download speed and no annoying ads. We cannot guarantee that every ebooks is available!

Sequential and Parallel Algorithms and Data Structures

Author : Peter Sanders
Publisher : Springer Nature
ISBN 13 : 3030252094
Total Pages : 516 pages
Book Rating : 4.0/5 (32 download)

DOWNLOAD NOW!

Book Synopsis Sequential and Parallel Algorithms and Data Structures by : Peter Sanders

Download or read book Sequential and Parallel Algorithms and Data Structures written by Peter Sanders and published by Springer Nature. This book was released on 2019-08-31 with total page 516 pages. Available in PDF, EPUB and Kindle. Book excerpt: This textbook is a concise introduction to the basic toolbox of structures that allow efficient organization and retrieval of data, key algorithms for problems on graphs, and generic techniques for modeling, understanding, and solving algorithmic problems. The authors aim for a balance between simplicity and efficiency, between theory and practice, and between classical results and the forefront of research. Individual chapters cover arrays and linked lists, hash tables and associative arrays, sorting and selection, priority queues, sorted sequences, graph representation, graph traversal, shortest paths, minimum spanning trees, optimization, collective communication and computation, and load balancing. The authors also discuss important issues such as algorithm engineering, memory hierarchies, algorithm libraries, and certifying algorithms. Moving beyond the sequential algorithms and data structures of the earlier related title, this book takes into account the paradigm shift towards the parallel processing required to solve modern performance-critical applications and how this impacts on the teaching of algorithms. The book is suitable for undergraduate and graduate students and professionals familiar with programming and basic mathematical language. Most chapters have the same basic structure: the authors discuss a problem as it occurs in a real-life situation, they illustrate the most important applications, and then they introduce simple solutions as informally as possible and as formally as necessary so the reader really understands the issues at hand. As they move to more advanced and optional issues, their approach gradually leads to a more mathematical treatment, including theorems and proofs. The book includes many examples, pictures, informal explanations, and exercises, and the implementation notes introduce clean, efficient implementations in languages such as C++ and Java.

Algorithms Sequential and Parallel

Author : Russ Miller
Publisher : Cengage Learning
ISBN 13 : 9781133366805
Total Pages : 0 pages
Book Rating : 4.3/5 (668 download)

DOWNLOAD NOW!

Book Synopsis Algorithms Sequential and Parallel by : Russ Miller

Download or read book Algorithms Sequential and Parallel written by Russ Miller and published by Cengage Learning. This book was released on 2012-12-20 with total page 0 pages. Available in PDF, EPUB and Kindle. Book excerpt: Equip yourself for success with a state-of-the-art approach to algorithms available only in Miller/Boxer's ALGORITHMS SEQUENTIAL AND PARALLEL: A UNIFIED APPROACH, 3E. This unique and functional text gives you an introduction to algorithms and paradigms for modern computing systems, integrating the study of parallel and sequential algorithms within a focused presentation. With a wide range of practical exercises and engaging examples drawn from fundamental application domains, this book prepares you to design, analyze, and implement algorithms for modern computing systems. Important Notice: Media content referenced within the product description or the product text may not be available in the ebook version.

Parallel Sorting Algorithms

Author : Selim G. Akl
Publisher : Academic Press
ISBN 13 : 148326808X
Total Pages : 244 pages
Book Rating : 4.4/5 (832 download)

DOWNLOAD NOW!

Book Synopsis Parallel Sorting Algorithms by : Selim G. Akl

Download or read book Parallel Sorting Algorithms written by Selim G. Akl and published by Academic Press. This book was released on 2014-06-20 with total page 244 pages. Available in PDF, EPUB and Kindle. Book excerpt: Parallel Sorting Algorithms explains how to use parallel algorithms to sort a sequence of items on a variety of parallel computers. The book reviews the sorting problem, the parallel models of computation, parallel algorithms, and the lower bounds on the parallel sorting problems. The text also presents twenty different algorithms, such as linear arrays, mesh-connected computers, cube-connected computers. Another example where algorithm can be applied is on the shared-memory SIMD (single instruction stream multiple data stream) computers in which the whole sequence to be sorted can fit in the respective primary memories of the computers (random access memory), or in a single shared memory. SIMD processors communicate through an interconnection network or the processors communicate through a common and shared memory. The text also investigates the case of external sorting in which the sequence to be sorted is bigger than the available primary memory. In this case, the algorithms used in external sorting is very similar to those used to describe internal sorting, that is, when the sequence can fit in the primary memory, The book explains that an algorithm can reach its optimum possible operating time for sorting when it is running on a particular set of architecture, depending on a constant multiplicative factor. The text is suitable for computer engineers and scientists interested in parallel algorithms.

Learning with Kernels

Author : Bernhard Scholkopf
Publisher : MIT Press
ISBN 13 : 0262536579
Total Pages : 645 pages
Book Rating : 4.2/5 (625 download)

DOWNLOAD NOW!

Book Synopsis Learning with Kernels by : Bernhard Scholkopf

Download or read book Learning with Kernels written by Bernhard Scholkopf and published by MIT Press. This book was released on 2018-06-05 with total page 645 pages. Available in PDF, EPUB and Kindle. Book excerpt: A comprehensive introduction to Support Vector Machines and related kernel methods. In the 1990s, a new type of learning algorithm was developed, based on results from statistical learning theory: the Support Vector Machine (SVM). This gave rise to a new class of theoretically elegant learning machines that use a central concept of SVMs—-kernels—for a number of learning tasks. Kernel machines provide a modular framework that can be adapted to different tasks and domains by the choice of the kernel function and the base algorithm. They are replacing neural networks in a variety of fields, including engineering, information retrieval, and bioinformatics. Learning with Kernels provides an introduction to SVMs and related kernel methods. Although the book begins with the basics, it also includes the latest research. It provides all of the concepts necessary to enable a reader equipped with some basic mathematical knowledge to enter the world of machine learning using theoretically well-founded yet easy-to-use kernel algorithms and to understand and apply the powerful algorithms that have been developed over the last few years.

Parallel and High Performance Computing

Author : Robert Robey
Publisher : Simon and Schuster
ISBN 13 : 1638350388
Total Pages : 702 pages
Book Rating : 4.6/5 (383 download)

DOWNLOAD NOW!

Book Synopsis Parallel and High Performance Computing by : Robert Robey

Download or read book Parallel and High Performance Computing written by Robert Robey and published by Simon and Schuster. This book was released on 2021-08-24 with total page 702 pages. Available in PDF, EPUB and Kindle. Book excerpt: Parallel and High Performance Computing offers techniques guaranteed to boost your code’s effectiveness. Summary Complex calculations, like training deep learning models or running large-scale simulations, can take an extremely long time. Efficient parallel programming can save hours—or even days—of computing time. Parallel and High Performance Computing shows you how to deliver faster run-times, greater scalability, and increased energy efficiency to your programs by mastering parallel techniques for multicore processor and GPU hardware. About the technology Write fast, powerful, energy efficient programs that scale to tackle huge volumes of data. Using parallel programming, your code spreads data processing tasks across multiple CPUs for radically better performance. With a little help, you can create software that maximizes both speed and efficiency. About the book Parallel and High Performance Computing offers techniques guaranteed to boost your code’s effectiveness. You’ll learn to evaluate hardware architectures and work with industry standard tools such as OpenMP and MPI. You’ll master the data structures and algorithms best suited for high performance computing and learn techniques that save energy on handheld devices. You’ll even run a massive tsunami simulation across a bank of GPUs. What's inside Planning a new parallel project Understanding differences in CPU and GPU architecture Addressing underperforming kernels and loops Managing applications with batch scheduling About the reader For experienced programmers proficient with a high-performance computing language like C, C++, or Fortran. About the author Robert Robey works at Los Alamos National Laboratory and has been active in the field of parallel computing for over 30 years. Yuliana Zamora is currently a PhD student and Siebel Scholar at the University of Chicago, and has lectured on programming modern hardware at numerous national conferences. Table of Contents PART 1 INTRODUCTION TO PARALLEL COMPUTING 1 Why parallel computing? 2 Planning for parallelization 3 Performance limits and profiling 4 Data design and performance models 5 Parallel algorithms and patterns PART 2 CPU: THE PARALLEL WORKHORSE 6 Vectorization: FLOPs for free 7 OpenMP that performs 8 MPI: The parallel backbone PART 3 GPUS: BUILT TO ACCELERATE 9 GPU architectures and concepts 10 GPU programming model 11 Directive-based GPU programming 12 GPU languages: Getting down to basics 13 GPU profiling and tools PART 4 HIGH PERFORMANCE COMPUTING ECOSYSTEMS 14 Affinity: Truce with the kernel 15 Batch schedulers: Bringing order to chaos 16 File operations for a parallel world 17 Tools and resources for better code

Algorithms and Data Structures

Author : Kurt Mehlhorn
Publisher : Springer Science & Business Media
ISBN 13 : 3540779787
Total Pages : 300 pages
Book Rating : 4.5/5 (47 download)

DOWNLOAD NOW!

Book Synopsis Algorithms and Data Structures by : Kurt Mehlhorn

Download or read book Algorithms and Data Structures written by Kurt Mehlhorn and published by Springer Science & Business Media. This book was released on 2008-05-27 with total page 300 pages. Available in PDF, EPUB and Kindle. Book excerpt: Algorithms are at the heart of every nontrivial computer application, and algorithmics is a modern and active area of computer science. Every computer scientist and every professional programmer should know about the basic algorithmic toolbox: structures that allow efficient organization and retrieval of data, frequently used algorithms, and basic techniques for modeling, understanding and solving algorithmic problems. This book is a concise introduction addressed to students and professionals familiar with programming and basic mathematical language. Individual chapters cover arrays and linked lists, hash tables and associative arrays, sorting and selection, priority queues, sorted sequences, graph representation, graph traversal, shortest paths, minimum spanning trees, and optimization. The algorithms are presented in a modern way, with explicitly formulated invariants, and comment on recent trends such as algorithm engineering, memory hierarchies, algorithm libraries and certifying algorithms. The authors use pictures, words and high-level pseudocode to explain the algorithms, and then they present more detail on efficient implementations using real programming languages like C++ and Java. The authors have extensive experience teaching these subjects to undergraduates and graduates, and they offer a clear presentation, with examples, pictures, informal explanations, exercises, and some linkage to the real world. Most chapters have the same basic structure: a motivation for the problem, comments on the most important applications, and then simple solutions presented as informally as possible and as formally as necessary. For the more advanced issues, this approach leads to a more mathematical treatment, including some theorems and proofs. Finally, each chapter concludes with a section on further findings, providing views on the state of research, generalizations and advanced solutions.

Parallel Scientific Computation

Author : Rob H. Bisseling
Publisher :
ISBN 13 : 0198788347
Total Pages : 410 pages
Book Rating : 4.1/5 (987 download)

DOWNLOAD NOW!

Book Synopsis Parallel Scientific Computation by : Rob H. Bisseling

Download or read book Parallel Scientific Computation written by Rob H. Bisseling and published by . This book was released on 2020 with total page 410 pages. Available in PDF, EPUB and Kindle. Book excerpt: Parallel Scientific Computation presents a methodology for designing parallel algorithms and writing parallel computer programs for modern computer architectures with multiple processors.

Topics in Parallel and Distributed Computing

Author : Sushil K Prasad
Publisher : Morgan Kaufmann
ISBN 13 : 0128039388
Total Pages : 359 pages
Book Rating : 4.1/5 (28 download)

DOWNLOAD NOW!

Book Synopsis Topics in Parallel and Distributed Computing by : Sushil K Prasad

Download or read book Topics in Parallel and Distributed Computing written by Sushil K Prasad and published by Morgan Kaufmann. This book was released on 2015-09-16 with total page 359 pages. Available in PDF, EPUB and Kindle. Book excerpt: Topics in Parallel and Distributed Computing provides resources and guidance for those learning PDC as well as those teaching students new to the discipline. The pervasiveness of computing devices containing multicore CPUs and GPUs, including home and office PCs, laptops, and mobile devices, is making even common users dependent on parallel processing. Certainly, it is no longer sufficient for even basic programmers to acquire only the traditional sequential programming skills. The preceding trends point to the need for imparting a broad-based skill set in PDC technology. However, the rapid changes in computing hardware platforms and devices, languages, supporting programming environments, and research advances, poses a challenge both for newcomers and seasoned computer scientists. This edited collection has been developed over the past several years in conjunction with the IEEE technical committee on parallel processing (TCPP), which held several workshops and discussions on learning parallel computing and integrating parallel concepts into courses throughout computer science curricula. - Contributed and developed by the leading minds in parallel computing research and instruction - Provides resources and guidance for those learning PDC as well as those teaching students new to the discipline - Succinctly addresses a range of parallel and distributed computing topics - Pedagogically designed to ensure understanding by experienced engineers and newcomers - Developed over the past several years in conjunction with the IEEE technical committee on parallel processing (TCPP), which held several workshops and discussions on learning parallel computing and integrating parallel concepts

并行程序设计

Author : Foster
Publisher :
ISBN 13 : 9787115103475
Total Pages : 381 pages
Book Rating : 4.1/5 (34 download)

DOWNLOAD NOW!

Book Synopsis 并行程序设计 by : Foster

Download or read book 并行程序设计 written by Foster and published by . This book was released on 2002 with total page 381 pages. Available in PDF, EPUB and Kindle. Book excerpt: 国外著名高等院校信息科学与技术优秀教材

Parallel Algorithms for Regular Architectures

Author : Russ Miller
Publisher : MIT Press
ISBN 13 : 9780262132336
Total Pages : 336 pages
Book Rating : 4.1/5 (323 download)

DOWNLOAD NOW!

Book Synopsis Parallel Algorithms for Regular Architectures by : Russ Miller

Download or read book Parallel Algorithms for Regular Architectures written by Russ Miller and published by MIT Press. This book was released on 1996 with total page 336 pages. Available in PDF, EPUB and Kindle. Book excerpt: Parallel-Algorithms for Regular Architectures is the first book to concentrate exclusively on algorithms and paradigms for programming parallel computers such as the hypercube, mesh, pyramid, and mesh-of-trees.

Using OpenMP

Author : Barbara Chapman
Publisher : MIT Press
ISBN 13 : 0262533022
Total Pages : 378 pages
Book Rating : 4.2/5 (625 download)

DOWNLOAD NOW!

Book Synopsis Using OpenMP by : Barbara Chapman

Download or read book Using OpenMP written by Barbara Chapman and published by MIT Press. This book was released on 2007-10-12 with total page 378 pages. Available in PDF, EPUB and Kindle. Book excerpt: A comprehensive overview of OpenMP, the standard application programming interface for shared memory parallel computing—a reference for students and professionals. "I hope that readers will learn to use the full expressibility and power of OpenMP. This book should provide an excellent introduction to beginners, and the performance section should help those with some experience who want to push OpenMP to its limits." —from the foreword by David J. Kuck, Intel Fellow, Software and Solutions Group, and Director, Parallel and Distributed Solutions, Intel Corporation OpenMP, a portable programming interface for shared memory parallel computers, was adopted as an informal standard in 1997 by computer scientists who wanted a unified model on which to base programs for shared memory systems. OpenMP is now used by many software developers; it offers significant advantages over both hand-threading and MPI. Using OpenMP offers a comprehensive introduction to parallel programming concepts and a detailed overview of OpenMP. Using OpenMP discusses hardware developments, describes where OpenMP is applicable, and compares OpenMP to other programming interfaces for shared and distributed memory parallel architectures. It introduces the individual features of OpenMP, provides many source code examples that demonstrate the use and functionality of the language constructs, and offers tips on writing an efficient OpenMP program. It describes how to use OpenMP in full-scale applications to achieve high performance on large-scale architectures, discussing several case studies in detail, and offers in-depth troubleshooting advice. It explains how OpenMP is translated into explicitly multithreaded code, providing a valuable behind-the-scenes account of OpenMP program performance. Finally, Using OpenMP considers trends likely to influence OpenMP development, offering a glimpse of the possibilities of a future OpenMP 3.0 from the vantage point of the current OpenMP 2.5. With multicore computer use increasing, the need for a comprehensive introduction and overview of the standard interface is clear. Using OpenMP provides an essential reference not only for students at both undergraduate and graduate levels but also for professionals who intend to parallelize existing codes or develop new parallel programs for shared memory computer architectures.

Limits to Parallel Computation

Author : Raymond Greenlaw
Publisher : Oxford University Press, USA
ISBN 13 : 0195085914
Total Pages : 328 pages
Book Rating : 4.1/5 (95 download)

DOWNLOAD NOW!

Book Synopsis Limits to Parallel Computation by : Raymond Greenlaw

Download or read book Limits to Parallel Computation written by Raymond Greenlaw and published by Oxford University Press, USA. This book was released on 1995 with total page 328 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book provides a comprehensive analysis of the most important topics in parallel computation. It is written so that it may be used as a self-study guide to the field, and researchers in parallel computing will find it a useful reference for many years to come. The first half of the book consists of an introduction to many fundamental issues in parallel computing. The second half provides lists of P-complete- and open problems. These lists will have lasting value to researchers in both industry and academia. The lists of problems, with their corresponding remarks, the thorough index, and the hundreds of references add to the exceptional value of this resource. While the exciting field of parallel computation continues to expand rapidly, this book serves as a guide to research done through 1994 and also describes the fundamental concepts that new workers will need to know in coming years. It is intended for anyone interested in parallel computing, including senior level undergraduate students, graduate students, faculty, and people in industry. As an essential reference, the book will be needed in all academic libraries.

Masters Theses in the Pure and Applied Sciences

Author : W. H. Shafer
Publisher : Springer Science & Business Media
ISBN 13 : 1475757859
Total Pages : 307 pages
Book Rating : 4.4/5 (757 download)

DOWNLOAD NOW!

Book Synopsis Masters Theses in the Pure and Applied Sciences by : W. H. Shafer

Download or read book Masters Theses in the Pure and Applied Sciences written by W. H. Shafer and published by Springer Science & Business Media. This book was released on 2013-03-14 with total page 307 pages. Available in PDF, EPUB and Kindle. Book excerpt: Masters Theses in the Pure and Applied Sciences was first conceived, published, and dis seminated by the Center for Information and Numerical Data Analysis and Synthesis (CINDAS) * at Purdue University in 1957, starting its coverage of theses with the academic year 1955. Beginning with Volume 13, the printing and dissemination phases of the ac tivity were transferred to University Microfilms/Xerox of Ann Arbor, Michigan, with the thought that such an arrangement would be more beneficial to the academic and general scientific and technical community. After five years of this joint undertaking we had concluded that it was in the interest of all concerned if the printing and distribution of the volume were handled by an international publishing house to assure improved service and broader dissemination. Hence, starting with Volume 18, Masters Theses in the Pure and Applied Sciences has been disseminated on a worldwide basis by Plenum Publishing Corporation of New York, and in the same year the coverage was broadened to include Canadian universities. All back issues can also be ordered from Plenum. We have reported in Volume 24 (thesis year 1979) a total of 10,033 theses titles from 26 Canadian and 215 United States universities. We are sure that this broader base for theses titles reported will greatly enhance the value of this important annual reference work. While Volume 24 reports these submitted in 1979, on occasion, certain universities do report theses submitted in previous years but not reported at the time.

Fundamentals of Sequential and Parallel Algorithms

Author : Kenneth A. Berman
Publisher : Course Technology
ISBN 13 : 9780534946746
Total Pages : 0 pages
Book Rating : 4.9/5 (467 download)

DOWNLOAD NOW!

Book Synopsis Fundamentals of Sequential and Parallel Algorithms by : Kenneth A. Berman

Download or read book Fundamentals of Sequential and Parallel Algorithms written by Kenneth A. Berman and published by Course Technology. This book was released on 1997 with total page 0 pages. Available in PDF, EPUB and Kindle. Book excerpt: Introduction fro ancient to modern times; Elementary data structures; Design analysis of sequential algorithms; Sequential sortin algorithms and their analysis; Introduction to parallel algorithms and architectures; parallel sorting; Expanding the design and analysis of the algorithms toolkit; Introduction, correctness proofs, and recurrence relations;Graphs, digraphs, and sets; Probability and average complexity of agorithms; Introduction to Lower bound theory; Parallel prefix, matix multiplication, and pointer jumping; Major design strategies; The Greedy method; Divide conquer; Dynamic programming; Backtracking and branch-and-bound; Special topics; Heuristic search: A- search, game trees; The dictionary problem: hashing and balanced trees; Probabilistic algorithms; graph algorithms; NP- complete problems and the class NC; The classes NC and P-complete; Closing remarks.

Algorithms

Author : Kenneth A. Berman
Publisher : Course Technology
ISBN 13 :
Total Pages : 1000 pages
Book Rating : 4.X/5 (4 download)

DOWNLOAD NOW!

Book Synopsis Algorithms by : Kenneth A. Berman

Download or read book Algorithms written by Kenneth A. Berman and published by Course Technology. This book was released on 2005 with total page 1000 pages. Available in PDF, EPUB and Kindle. Book excerpt: Algorithms: Sequential, Parallel, and Distributed offers in-depth coverage of traditional and current topics in sequential algorithms, as well as a solid introduction to the theory of parallel and distributed algorithms. In light of the emergence of modern computing environments such as parallel computers, the Internet, and cluster and grid computing, it is important that computer science students be exposed to algorithms that exploit these technologies. Berman and Paul's text will teach students how to create new algorithms or modify existing algorithms, thereby enhancing students' ability to think independently.

Parallel Programming Using C++

Author : Gregory V. Wilson
Publisher : MIT Press
ISBN 13 : 9780262731188
Total Pages : 796 pages
Book Rating : 4.7/5 (311 download)

DOWNLOAD NOW!

Book Synopsis Parallel Programming Using C++ by : Gregory V. Wilson

Download or read book Parallel Programming Using C++ written by Gregory V. Wilson and published by MIT Press. This book was released on 1996-07-08 with total page 796 pages. Available in PDF, EPUB and Kindle. Book excerpt: Foreword by Bjarne Stroustrup Software is generally acknowledged to be the single greatest obstacle preventing mainstream adoption of massively-parallel computing. While sequential applications are routinely ported to platforms ranging from PCs to mainframes, most parallel programs only ever run on one type of machine. One reason for this is that most parallel programming systems have failed to insulate their users from the architectures of the machines on which they have run. Those that have been platform-independent have usually also had poor performance. Many researchers now believe that object-oriented languages may offer a solution. By hiding the architecture-specific constructs required for high performance inside platform-independent abstractions, parallel object-oriented programming systems may be able to combine the speed of massively-parallel computing with the comfort of sequential programming. Parallel Programming Using C++ describes fifteen parallel programming systems based on C++, the most popular object-oriented language of today. These systems cover the whole spectrum of parallel programming paradigms, from data parallelism through dataflow and distributed shared memory to message-passing control parallelism. For the parallel programming community, a common parallel application is discussed in each chapter, as part of the description of the system itself. By comparing the implementations of the polygon overlay problem in each system, the reader can get a better sense of their expressiveness and functionality for a common problem. For the systems community, the chapters contain a discussion of the implementation of the various compilers and runtime systems. In addition to discussing the performance of polygon overlay, several of the contributors also discuss the performance of other, more substantial, applications. For the research community, the contributors discuss the motivations for and philosophy of their systems. As well, many of the chapters include critiques that complete the research arc by pointing out possible future research directions. Finally, for the object-oriented community, there are many examples of how encapsulation, inheritance, and polymorphism can be used to control the complexity of developing, debugging, and tuning parallel software.

Introduction to HPC with MPI for Data Science

Author : Frank Nielsen
Publisher : Springer
ISBN 13 : 3319219030
Total Pages : 304 pages
Book Rating : 4.3/5 (192 download)

DOWNLOAD NOW!

Book Synopsis Introduction to HPC with MPI for Data Science by : Frank Nielsen

Download or read book Introduction to HPC with MPI for Data Science written by Frank Nielsen and published by Springer. This book was released on 2016-02-03 with total page 304 pages. Available in PDF, EPUB and Kindle. Book excerpt: This gentle introduction to High Performance Computing (HPC) for Data Science using the Message Passing Interface (MPI) standard has been designed as a first course for undergraduates on parallel programming on distributed memory models, and requires only basic programming notions. Divided into two parts the first part covers high performance computing using C++ with the Message Passing Interface (MPI) standard followed by a second part providing high-performance data analytics on computer clusters. In the first part, the fundamental notions of blocking versus non-blocking point-to-point communications, global communications (like broadcast or scatter) and collaborative computations (reduce), with Amdalh and Gustafson speed-up laws are described before addressing parallel sorting and parallel linear algebra on computer clusters. The common ring, torus and hypercube topologies of clusters are then explained and global communication procedures on these topologies are studied. This first part closes with the MapReduce (MR) model of computation well-suited to processing big data using the MPI framework. In the second part, the book focuses on high-performance data analytics. Flat and hierarchical clustering algorithms are introduced for data exploration along with how to program these algorithms on computer clusters, followed by machine learning classification, and an introduction to graph analytics. This part closes with a concise introduction to data core-sets that let big data problems be amenable to tiny data problems. Exercises are included at the end of each chapter in order for students to practice the concepts learned, and a final section contains an overall exam which allows them to evaluate how well they have assimilated the material covered in the book.