Machine Learning for Kids

Download Machine Learning for Kids PDF Online Free

Author :
Publisher : No Starch Press
ISBN 13 : 1718500572
Total Pages : 290 pages
Book Rating : 4.7/5 (185 download)

DOWNLOAD NOW!


Book Synopsis Machine Learning for Kids by : Dale Lane

Download or read book Machine Learning for Kids written by Dale Lane and published by No Starch Press. This book was released on 2021-01-19 with total page 290 pages. Available in PDF, EPUB and Kindle. Book excerpt: A hands-on, application-based introduction to machine learning and artificial intelligence (AI) that guides young readers through creating compelling AI-powered games and applications using the Scratch programming language. Machine learning (also known as ML) is one of the building blocks of AI, or artificial intelligence. AI is based on the idea that computers can learn on their own, with your help. Machine Learning for Kids will introduce you to machine learning, painlessly. With this book and its free, Scratch-based, award-winning companion website, you'll see how easy it is to add machine learning to your own projects. You don't even need to know how to code! As you work through the book you'll discover how machine learning systems can be taught to recognize text, images, numbers, and sounds, and how to train your models to improve their accuracy. You'll turn your models into fun computer games and apps, and see what happens when they get confused by bad data. You'll build 13 projects step-by-step from the ground up, including: • Rock, Paper, Scissors game that recognizes your hand shapes • An app that recommends movies based on other movies that you like • A computer character that reacts to insults and compliments • An interactive virtual assistant (like Siri or Alexa) that obeys commands • An AI version of Pac-Man, with a smart character that knows how to avoid ghosts NOTE: This book includes a Scratch tutorial for beginners, and step-by-step instructions for every project. Ages 12+

Machine Learning for Kids

Download Machine Learning for Kids PDF Online Free

Author :
Publisher : No Starch Press
ISBN 13 : 1718500564
Total Pages : 290 pages
Book Rating : 4.7/5 (185 download)

DOWNLOAD NOW!


Book Synopsis Machine Learning for Kids by : Dale Lane

Download or read book Machine Learning for Kids written by Dale Lane and published by No Starch Press. This book was released on 2021-02-09 with total page 290 pages. Available in PDF, EPUB and Kindle. Book excerpt: A hands-on, application-based introduction to machine learning and artificial intelligence (AI). Create compelling AI-powered games and applications using the Scratch programming language. AI Made Easy with 13 Projects Machine learning (also known as ML) is one of the building blocks of AI, or artificial intelligence. AI is based on the idea that computers can learn on their own, with your help. Machine Learning for Kids will introduce you to machine learning, painlessly. With this book and its free, Scratch-based companion website, you’ll see how easy it is to add machine learning to your own projects. You don’t even need to know how to code! Step by easy step, you’ll discover how machine learning systems can be taught to recognize text, images, numbers, and sounds, and how to train your models to improve them. You’ll turn your models into 13 fun computer games and apps, including: A Rock, Paper, Scissors game that recognizes your hand shapes A computer character that reacts to insults and compliments An interactive virtual assistant (like Siri or Alexa) A movie recommendation app An AI version of Pac-Man There’s no experience required and step-by-step instructions make sure that anyone can follow along! No Experience Necessary! Ages 12+

Deep Learning Applications, Volume 2

Download Deep Learning Applications, Volume 2 PDF Online Free

Author :
Publisher : Springer
ISBN 13 : 9789811567582
Total Pages : 300 pages
Book Rating : 4.5/5 (675 download)

DOWNLOAD NOW!


Book Synopsis Deep Learning Applications, Volume 2 by : M. Arif Wani

Download or read book Deep Learning Applications, Volume 2 written by M. Arif Wani and published by Springer. This book was released on 2020-12-14 with total page 300 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book presents selected papers from the 18th IEEE International Conference on Machine Learning and Applications (IEEE ICMLA 2019). It focuses on deep learning networks and their application in domains such as healthcare, security and threat detection, fault diagnosis and accident analysis, and robotic control in industrial environments, and highlights novel ways of using deep neural networks to solve real-world problems. Also offering insights into deep learning architectures and algorithms, it is an essential reference guide for academic researchers, professionals, software engineers in industry, and innovative product developers.

Mathematics for Machine Learning

Download Mathematics for Machine Learning PDF Online Free

Author :
Publisher : Cambridge University Press
ISBN 13 : 1108569323
Total Pages : 392 pages
Book Rating : 4.1/5 (85 download)

DOWNLOAD NOW!


Book Synopsis Mathematics for Machine Learning by : Marc Peter Deisenroth

Download or read book Mathematics for Machine Learning written by Marc Peter Deisenroth and published by Cambridge University Press. This book was released on 2020-04-23 with total page 392 pages. Available in PDF, EPUB and Kindle. Book excerpt: The fundamental mathematical tools needed to understand machine learning include linear algebra, analytic geometry, matrix decompositions, vector calculus, optimization, probability and statistics. These topics are traditionally taught in disparate courses, making it hard for data science or computer science students, or professionals, to efficiently learn the mathematics. This self-contained textbook bridges the gap between mathematical and machine learning texts, introducing the mathematical concepts with a minimum of prerequisites. It uses these concepts to derive four central machine learning methods: linear regression, principal component analysis, Gaussian mixture models and support vector machines. For students and others with a mathematical background, these derivations provide a starting point to machine learning texts. For those learning the mathematics for the first time, the methods help build intuition and practical experience with applying mathematical concepts. Every chapter includes worked examples and exercises to test understanding. Programming tutorials are offered on the book's web site.

Deep Learning for Coders with fastai and PyTorch

Download Deep Learning for Coders with fastai and PyTorch PDF Online Free

Author :
Publisher : O'Reilly Media
ISBN 13 : 1492045497
Total Pages : 624 pages
Book Rating : 4.4/5 (92 download)

DOWNLOAD NOW!


Book Synopsis Deep Learning for Coders with fastai and PyTorch by : Jeremy Howard

Download or read book Deep Learning for Coders with fastai and PyTorch written by Jeremy Howard and published by O'Reilly Media. This book was released on 2020-06-29 with total page 624 pages. Available in PDF, EPUB and Kindle. Book excerpt: Deep learning is often viewed as the exclusive domain of math PhDs and big tech companies. But as this hands-on guide demonstrates, programmers comfortable with Python can achieve impressive results in deep learning with little math background, small amounts of data, and minimal code. How? With fastai, the first library to provide a consistent interface to the most frequently used deep learning applications. Authors Jeremy Howard and Sylvain Gugger, the creators of fastai, show you how to train a model on a wide range of tasks using fastai and PyTorch. You’ll also dive progressively further into deep learning theory to gain a complete understanding of the algorithms behind the scenes. Train models in computer vision, natural language processing, tabular data, and collaborative filtering Learn the latest deep learning techniques that matter most in practice Improve accuracy, speed, and reliability by understanding how deep learning models work Discover how to turn your models into web applications Implement deep learning algorithms from scratch Consider the ethical implications of your work Gain insight from the foreword by PyTorch cofounder, Soumith Chintala

AI Crash Course

Download AI Crash Course PDF Online Free

Author :
Publisher : Packt Publishing Ltd
ISBN 13 : 1838645551
Total Pages : 361 pages
Book Rating : 4.8/5 (386 download)

DOWNLOAD NOW!


Book Synopsis AI Crash Course by : Hadelin de Ponteves

Download or read book AI Crash Course written by Hadelin de Ponteves and published by Packt Publishing Ltd. This book was released on 2019-11-29 with total page 361 pages. Available in PDF, EPUB and Kindle. Book excerpt: Unlock the power of artificial intelligence with top Udemy AI instructor Hadelin de Ponteves. Key FeaturesLearn from friendly, plain English explanations and practical activitiesPut ideas into action with 5 hands-on projects that show step-by-step how to build intelligent softwareUse AI to win classic video games and construct a virtual self-driving carBook Description Welcome to the Robot World ... and start building intelligent software now! Through his best-selling video courses, Hadelin de Ponteves has taught hundreds of thousands of people to write AI software. Now, for the first time, his hands-on, energetic approach is available as a book. Starting with the basics before easing you into more complicated formulas and notation, AI Crash Course gives you everything you need to build AI systems with reinforcement learning and deep learning. Five full working projects put the ideas into action, showing step-by-step how to build intelligent software using the best and easiest tools for AI programming, including Python, TensorFlow, Keras, and PyTorch. AI Crash Course teaches everyone to build an AI to work in their applications. Once you've read this book, you're only limited by your imagination. What you will learnMaster the basics of AI without any previous experienceBuild fun projects, including a virtual-self-driving car and a robot warehouse workerUse AI to solve real-world business problemsLearn how to code in PythonDiscover the 5 principles of reinforcement learningCreate your own AI toolkitWho this book is for If you want to add AI to your skillset, this book is for you. It doesn't require data science or machine learning knowledge. Just maths basics (high school level).

Fun Q

Download Fun Q PDF Online Free

Author :
Publisher :
ISBN 13 : 9781734467505
Total Pages : 416 pages
Book Rating : 4.4/5 (675 download)

DOWNLOAD NOW!


Book Synopsis Fun Q by : Nick Psaris

Download or read book Fun Q written by Nick Psaris and published by . This book was released on 2020-07-16 with total page 416 pages. Available in PDF, EPUB and Kindle. Book excerpt:

Deep Learning and the Game of Go

Download Deep Learning and the Game of Go PDF Online Free

Author :
Publisher : Simon and Schuster
ISBN 13 : 1638354014
Total Pages : 611 pages
Book Rating : 4.6/5 (383 download)

DOWNLOAD NOW!


Book Synopsis Deep Learning and the Game of Go by : Kevin Ferguson

Download or read book Deep Learning and the Game of Go written by Kevin Ferguson and published by Simon and Schuster. This book was released on 2019-01-06 with total page 611 pages. Available in PDF, EPUB and Kindle. Book excerpt: Summary Deep Learning and the Game of Go teaches you how to apply the power of deep learning to complex reasoning tasks by building a Go-playing AI. After exposing you to the foundations of machine and deep learning, you'll use Python to build a bot and then teach it the rules of the game. Foreword by Thore Graepel, DeepMind Purchase of the print book includes a free eBook in PDF, Kindle, and ePub formats from Manning Publications. About the Technology The ancient strategy game of Go is an incredible case study for AI. In 2016, a deep learning-based system shocked the Go world by defeating a world champion. Shortly after that, the upgraded AlphaGo Zero crushed the original bot by using deep reinforcement learning to master the game. Now, you can learn those same deep learning techniques by building your own Go bot! About the Book Deep Learning and the Game of Go introduces deep learning by teaching you to build a Go-winning bot. As you progress, you'll apply increasingly complex training techniques and strategies using the Python deep learning library Keras. You'll enjoy watching your bot master the game of Go, and along the way, you'll discover how to apply your new deep learning skills to a wide range of other scenarios! What's inside Build and teach a self-improving game AI Enhance classical game AI systems with deep learning Implement neural networks for deep learning About the Reader All you need are basic Python skills and high school-level math. No deep learning experience required. About the Author Max Pumperla and Kevin Ferguson are experienced deep learning specialists skilled in distributed systems and data science. Together, Max and Kevin built the open source bot BetaGo. Table of Contents PART 1 - FOUNDATIONS Toward deep learning: a machine-learning introduction Go as a machine-learning problem Implementing your first Go bot PART 2 - MACHINE LEARNING AND GAME AI Playing games with tree search Getting started with neural networks Designing a neural network for Go data Learning from data: a deep-learning bot Deploying bots in the wild Learning by practice: reinforcement learning Reinforcement learning with policy gradients Reinforcement learning with value methods Reinforcement learning with actor-critic methods PART 3 - GREATER THAN THE SUM OF ITS PARTS AlphaGo: Bringing it all together AlphaGo Zero: Integrating tree search with reinforcement learning

AI and Machine Learning for Coders

Download AI and Machine Learning for Coders PDF Online Free

Author :
Publisher : O'Reilly Media
ISBN 13 : 1492078166
Total Pages : 393 pages
Book Rating : 4.4/5 (92 download)

DOWNLOAD NOW!


Book Synopsis AI and Machine Learning for Coders by : Laurence Moroney

Download or read book AI and Machine Learning for Coders written by Laurence Moroney and published by O'Reilly Media. This book was released on 2020-10-01 with total page 393 pages. Available in PDF, EPUB and Kindle. Book excerpt: If you're looking to make a career move from programmer to AI specialist, this is the ideal place to start. Based on Laurence Moroney's extremely successful AI courses, this introductory book provides a hands-on, code-first approach to help you build confidence while you learn key topics. You'll understand how to implement the most common scenarios in machine learning, such as computer vision, natural language processing (NLP), and sequence modeling for web, mobile, cloud, and embedded runtimes. Most books on machine learning begin with a daunting amount of advanced math. This guide is built on practical lessons that let you work directly with the code. You'll learn: How to build models with TensorFlow using skills that employers desire The basics of machine learning by working with code samples How to implement computer vision, including feature detection in images How to use NLP to tokenize and sequence words and sentences Methods for embedding models in Android and iOS How to serve models over the web and in the cloud with TensorFlow Serving

Probabilistic Machine Learning

Download Probabilistic Machine Learning PDF Online Free

Author :
Publisher : MIT Press
ISBN 13 : 0262369303
Total Pages : 858 pages
Book Rating : 4.2/5 (623 download)

DOWNLOAD NOW!


Book Synopsis Probabilistic Machine Learning by : Kevin P. Murphy

Download or read book Probabilistic Machine Learning written by Kevin P. Murphy and published by MIT Press. This book was released on 2022-03-01 with total page 858 pages. Available in PDF, EPUB and Kindle. Book excerpt: A detailed and up-to-date introduction to machine learning, presented through the unifying lens of probabilistic modeling and Bayesian decision theory. This book offers a detailed and up-to-date introduction to machine learning (including deep learning) through the unifying lens of probabilistic modeling and Bayesian decision theory. The book covers mathematical background (including linear algebra and optimization), basic supervised learning (including linear and logistic regression and deep neural networks), as well as more advanced topics (including transfer learning and unsupervised learning). End-of-chapter exercises allow students to apply what they have learned, and an appendix covers notation. Probabilistic Machine Learning grew out of the author’s 2012 book, Machine Learning: A Probabilistic Perspective. More than just a simple update, this is a completely new book that reflects the dramatic developments in the field since 2012, most notably deep learning. In addition, the new book is accompanied by online Python code, using libraries such as scikit-learn, JAX, PyTorch, and Tensorflow, which can be used to reproduce nearly all the figures; this code can be run inside a web browser using cloud-based notebooks, and provides a practical complement to the theoretical topics discussed in the book. This introductory text will be followed by a sequel that covers more advanced topics, taking the same probabilistic approach.

Deep Learning Illustrated

Download Deep Learning Illustrated PDF Online Free

Author :
Publisher : Addison-Wesley Professional
ISBN 13 : 0135121728
Total Pages : 725 pages
Book Rating : 4.1/5 (351 download)

DOWNLOAD NOW!


Book Synopsis Deep Learning Illustrated by : Jon Krohn

Download or read book Deep Learning Illustrated written by Jon Krohn and published by Addison-Wesley Professional. This book was released on 2019-08-05 with total page 725 pages. Available in PDF, EPUB and Kindle. Book excerpt: "The authors’ clear visual style provides a comprehensive look at what’s currently possible with artificial neural networks as well as a glimpse of the magic that’s to come." – Tim Urban, author of Wait But Why Fully Practical, Insightful Guide to Modern Deep Learning Deep learning is transforming software, facilitating powerful new artificial intelligence capabilities, and driving unprecedented algorithm performance. Deep Learning Illustrated is uniquely intuitive and offers a complete introduction to the discipline’s techniques. Packed with full-color figures and easy-to-follow code, it sweeps away the complexity of building deep learning models, making the subject approachable and fun to learn. World-class instructor and practitioner Jon Krohn–with visionary content from Grant Beyleveld and beautiful illustrations by Aglaé Bassens–presents straightforward analogies to explain what deep learning is, why it has become so popular, and how it relates to other machine learning approaches. Krohn has created a practical reference and tutorial for developers, data scientists, researchers, analysts, and students who want to start applying it. He illuminates theory with hands-on Python code in accompanying Jupyter notebooks. To help you progress quickly, he focuses on the versatile deep learning library Keras to nimbly construct efficient TensorFlow models; PyTorch, the leading alternative library, is also covered. You’ll gain a pragmatic understanding of all major deep learning approaches and their uses in applications ranging from machine vision and natural language processing to image generation and game-playing algorithms. Discover what makes deep learning systems unique, and the implications for practitioners Explore new tools that make deep learning models easier to build, use, and improve Master essential theory: artificial neurons, training, optimization, convolutional nets, recurrent nets, generative adversarial networks (GANs), deep reinforcement learning, and more Walk through building interactive deep learning applications, and move forward with your own artificial intelligence projects Register your book for convenient access to downloads, updates, and/or corrections as they become available. See inside book for details.

Advances in Financial Machine Learning

Download Advances in Financial Machine Learning PDF Online Free

Author :
Publisher : John Wiley & Sons
ISBN 13 : 1119482119
Total Pages : 395 pages
Book Rating : 4.1/5 (194 download)

DOWNLOAD NOW!


Book Synopsis Advances in Financial Machine Learning by : Marcos Lopez de Prado

Download or read book Advances in Financial Machine Learning written by Marcos Lopez de Prado and published by John Wiley & Sons. This book was released on 2018-01-23 with total page 395 pages. Available in PDF, EPUB and Kindle. Book excerpt: Learn to understand and implement the latest machine learning innovations to improve your investment performance Machine learning (ML) is changing virtually every aspect of our lives. Today, ML algorithms accomplish tasks that – until recently – only expert humans could perform. And finance is ripe for disruptive innovations that will transform how the following generations understand money and invest. In the book, readers will learn how to: Structure big data in a way that is amenable to ML algorithms Conduct research with ML algorithms on big data Use supercomputing methods and back test their discoveries while avoiding false positives Advances in Financial Machine Learning addresses real life problems faced by practitioners every day, and explains scientifically sound solutions using math, supported by code and examples. Readers become active users who can test the proposed solutions in their individual setting. Written by a recognized expert and portfolio manager, this book will equip investment professionals with the groundbreaking tools needed to succeed in modern finance.

Machine Learning For Dummies

Download Machine Learning For Dummies PDF Online Free

Author :
Publisher : John Wiley & Sons
ISBN 13 : 1119724015
Total Pages : 471 pages
Book Rating : 4.1/5 (197 download)

DOWNLOAD NOW!


Book Synopsis Machine Learning For Dummies by : John Paul Mueller

Download or read book Machine Learning For Dummies written by John Paul Mueller and published by John Wiley & Sons. This book was released on 2021-02-09 with total page 471 pages. Available in PDF, EPUB and Kindle. Book excerpt: One of Mark Cuban’s top reads for better understanding A.I. (inc.com, 2021) Your comprehensive entry-level guide to machine learning While machine learning expertise doesn’t quite mean you can create your own Turing Test-proof android—as in the movie Ex Machina—it is a form of artificial intelligence and one of the most exciting technological means of identifying opportunities and solving problems fast and on a large scale. Anyone who masters the principles of machine learning is mastering a big part of our tech future and opening up incredible new directions in careers that include fraud detection, optimizing search results, serving real-time ads, credit-scoring, building accurate and sophisticated pricing models—and way, way more. Unlike most machine learning books, the fully updated 2nd Edition of Machine Learning For Dummies doesn't assume you have years of experience using programming languages such as Python (R source is also included in a downloadable form with comments and explanations), but lets you in on the ground floor, covering the entry-level materials that will get you up and running building models you need to perform practical tasks. It takes a look at the underlying—and fascinating—math principles that power machine learning but also shows that you don't need to be a math whiz to build fun new tools and apply them to your work and study. Understand the history of AI and machine learning Work with Python 3.8 and TensorFlow 2.x (and R as a download) Build and test your own models Use the latest datasets, rather than the worn out data found in other books Apply machine learning to real problems Whether you want to learn for college or to enhance your business or career performance, this friendly beginner's guide is your best introduction to machine learning, allowing you to become quickly confident using this amazing and fast-developing technology that's impacting lives for the better all over the world.

Introducing Machine Learning

Download Introducing Machine Learning PDF Online Free

Author :
Publisher : Microsoft Press
ISBN 13 : 0135588383
Total Pages : 617 pages
Book Rating : 4.1/5 (355 download)

DOWNLOAD NOW!


Book Synopsis Introducing Machine Learning by : Dino Esposito

Download or read book Introducing Machine Learning written by Dino Esposito and published by Microsoft Press. This book was released on 2020-01-31 with total page 617 pages. Available in PDF, EPUB and Kindle. Book excerpt: Master machine learning concepts and develop real-world solutions Machine learning offers immense opportunities, and Introducing Machine Learning delivers practical knowledge to make the most of them. Dino and Francesco Esposito start with a quick overview of the foundations of artificial intelligence and the basic steps of any machine learning project. Next, they introduce Microsoft’s powerful ML.NET library, including capabilities for data processing, training, and evaluation. They present families of algorithms that can be trained to solve real-life problems, as well as deep learning techniques utilizing neural networks. The authors conclude by introducing valuable runtime services available through the Azure cloud platform and consider the long-term business vision for machine learning. · 14-time Microsoft MVP Dino Esposito and Francesco Esposito help you · Explore what’s known about how humans learn and how intelligent software is built · Discover which problems machine learning can address · Understand the machine learning pipeline: the steps leading to a deliverable model · Use AutoML to automatically select the best pipeline for any problem and dataset · Master ML.NET, implement its pipeline, and apply its tasks and algorithms · Explore the mathematical foundations of machine learning · Make predictions, improve decision-making, and apply probabilistic methods · Group data via classification and clustering · Learn the fundamentals of deep learning, including neural network design · Leverage AI cloud services to build better real-world solutions faster About This Book · For professionals who want to build machine learning applications: both developers who need data science skills and data scientists who need relevant programming skills · Includes examples of machine learning coding scenarios built using the ML.NET library

Fundamentals of Machine Learning for Predictive Data Analytics, second edition

Download Fundamentals of Machine Learning for Predictive Data Analytics, second edition PDF Online Free

Author :
Publisher : MIT Press
ISBN 13 : 0262361108
Total Pages : 853 pages
Book Rating : 4.2/5 (623 download)

DOWNLOAD NOW!


Book Synopsis Fundamentals of Machine Learning for Predictive Data Analytics, second edition by : John D. Kelleher

Download or read book Fundamentals of Machine Learning for Predictive Data Analytics, second edition written by John D. Kelleher and published by MIT Press. This book was released on 2020-10-20 with total page 853 pages. Available in PDF, EPUB and Kindle. Book excerpt: The second edition of a comprehensive introduction to machine learning approaches used in predictive data analytics, covering both theory and practice. Machine learning is often used to build predictive models by extracting patterns from large datasets. These models are used in predictive data analytics applications including price prediction, risk assessment, predicting customer behavior, and document classification. This introductory textbook offers a detailed and focused treatment of the most important machine learning approaches used in predictive data analytics, covering both theoretical concepts and practical applications. Technical and mathematical material is augmented with explanatory worked examples, and case studies illustrate the application of these models in the broader business context. This second edition covers recent developments in machine learning, especially in a new chapter on deep learning, and two new chapters that go beyond predictive analytics to cover unsupervised learning and reinforcement learning.

Grokking Machine Learning

Download Grokking Machine Learning PDF Online Free

Author :
Publisher : Simon and Schuster
ISBN 13 : 1617295914
Total Pages : 510 pages
Book Rating : 4.6/5 (172 download)

DOWNLOAD NOW!


Book Synopsis Grokking Machine Learning by : Luis Serrano

Download or read book Grokking Machine Learning written by Luis Serrano and published by Simon and Schuster. This book was released on 2021-12-14 with total page 510 pages. Available in PDF, EPUB and Kindle. Book excerpt: Grokking Machine Learning presents machine learning algorithms and techniques in a way that anyone can understand. This book skips the confused academic jargon and offers clear explanations that require only basic algebra. As you go, you'll build interesting projects with Python, including models for spam detection and image recognition. You'll also pick up practical skills for cleaning and preparing data.

Reinforcement Learning, second edition

Download Reinforcement Learning, second edition PDF Online Free

Author :
Publisher : MIT Press
ISBN 13 : 0262352702
Total Pages : 549 pages
Book Rating : 4.2/5 (623 download)

DOWNLOAD NOW!


Book Synopsis Reinforcement Learning, second edition by : Richard S. Sutton

Download or read book Reinforcement Learning, second edition written by Richard S. Sutton and published by MIT Press. This book was released on 2018-11-13 with total page 549 pages. Available in PDF, EPUB and Kindle. Book excerpt: The significantly expanded and updated new edition of a widely used text on reinforcement learning, one of the most active research areas in artificial intelligence. Reinforcement learning, one of the most active research areas in artificial intelligence, is a computational approach to learning whereby an agent tries to maximize the total amount of reward it receives while interacting with a complex, uncertain environment. In Reinforcement Learning, Richard Sutton and Andrew Barto provide a clear and simple account of the field's key ideas and algorithms. This second edition has been significantly expanded and updated, presenting new topics and updating coverage of other topics. Like the first edition, this second edition focuses on core online learning algorithms, with the more mathematical material set off in shaded boxes. Part I covers as much of reinforcement learning as possible without going beyond the tabular case for which exact solutions can be found. Many algorithms presented in this part are new to the second edition, including UCB, Expected Sarsa, and Double Learning. Part II extends these ideas to function approximation, with new sections on such topics as artificial neural networks and the Fourier basis, and offers expanded treatment of off-policy learning and policy-gradient methods. Part III has new chapters on reinforcement learning's relationships to psychology and neuroscience, as well as an updated case-studies chapter including AlphaGo and AlphaGo Zero, Atari game playing, and IBM Watson's wagering strategy. The final chapter discusses the future societal impacts of reinforcement learning.