Stochastic Control by Functional Analysis Methods

Download Stochastic Control by Functional Analysis Methods PDF Online Free

Author :
Publisher : Elsevier
ISBN 13 : 0080875327
Total Pages : 427 pages
Book Rating : 4.0/5 (88 download)

DOWNLOAD NOW!


Book Synopsis Stochastic Control by Functional Analysis Methods by : A. Bensoussan

Download or read book Stochastic Control by Functional Analysis Methods written by A. Bensoussan and published by Elsevier. This book was released on 2011-08-18 with total page 427 pages. Available in PDF, EPUB and Kindle. Book excerpt: Stochastic Control by Functional Analysis Methods

Weak Convergence Methods and Singularly Perturbed Stochastic Control and Filtering Problems

Download Weak Convergence Methods and Singularly Perturbed Stochastic Control and Filtering Problems PDF Online Free

Author :
Publisher : Springer Science & Business Media
ISBN 13 : 146124482X
Total Pages : 245 pages
Book Rating : 4.4/5 (612 download)

DOWNLOAD NOW!


Book Synopsis Weak Convergence Methods and Singularly Perturbed Stochastic Control and Filtering Problems by : Harold Kushner

Download or read book Weak Convergence Methods and Singularly Perturbed Stochastic Control and Filtering Problems written by Harold Kushner and published by Springer Science & Business Media. This book was released on 2012-12-06 with total page 245 pages. Available in PDF, EPUB and Kindle. Book excerpt: The book deals with several closely related topics concerning approxima tions and perturbations of random processes and their applications to some important and fascinating classes of problems in the analysis and design of stochastic control systems and nonlinear filters. The basic mathematical methods which are used and developed are those of the theory of weak con vergence. The techniques are quite powerful for getting weak convergence or functional limit theorems for broad classes of problems and many of the techniques are new. The original need for some of the techniques which are developed here arose in connection with our study of the particular applica tions in this book, and related problems of approximation in control theory, but it will be clear that they have numerous applications elsewhere in weak convergence and process approximation theory. The book is a continuation of the author's long term interest in problems of the approximation of stochastic processes and its applications to problems arising in control and communication theory and related areas. In fact, the techniques used here can be fruitfully applied to many other areas. The basic random processes of interest can be described by solutions to either (multiple time scale) Ito differential equations driven by wide band or state dependent wide band noise or which are singularly perturbed. They might be controlled or not, and their state values might be fully observable or not (e. g. , as in the nonlinear filtering problem).

Stochastic Optimal Control in Infinite Dimension

Download Stochastic Optimal Control in Infinite Dimension PDF Online Free

Author :
Publisher : Springer
ISBN 13 : 3319530674
Total Pages : 928 pages
Book Rating : 4.3/5 (195 download)

DOWNLOAD NOW!


Book Synopsis Stochastic Optimal Control in Infinite Dimension by : Giorgio Fabbri

Download or read book Stochastic Optimal Control in Infinite Dimension written by Giorgio Fabbri and published by Springer. This book was released on 2017-06-22 with total page 928 pages. Available in PDF, EPUB and Kindle. Book excerpt: Providing an introduction to stochastic optimal control in infinite dimension, this book gives a complete account of the theory of second-order HJB equations in infinite-dimensional Hilbert spaces, focusing on its applicability to associated stochastic optimal control problems. It features a general introduction to optimal stochastic control, including basic results (e.g. the dynamic programming principle) with proofs, and provides examples of applications. A complete and up-to-date exposition of the existing theory of viscosity solutions and regular solutions of second-order HJB equations in Hilbert spaces is given, together with an extensive survey of other methods, with a full bibliography. In particular, Chapter 6, written by M. Fuhrman and G. Tessitore, surveys the theory of regular solutions of HJB equations arising in infinite-dimensional stochastic control, via BSDEs. The book is of interest to both pure and applied researchers working in the control theory of stochastic PDEs, and in PDEs in infinite dimension. Readers from other fields who want to learn the basic theory will also find it useful. The prerequisites are: standard functional analysis, the theory of semigroups of operators and its use in the study of PDEs, some knowledge of the dynamic programming approach to stochastic optimal control problems in finite dimension, and the basics of stochastic analysis and stochastic equations in infinite-dimensional spaces.

Numerical Methods for Stochastic Control Problems in Continuous Time

Download Numerical Methods for Stochastic Control Problems in Continuous Time PDF Online Free

Author :
Publisher : Springer Science & Business Media
ISBN 13 : 146130007X
Total Pages : 480 pages
Book Rating : 4.4/5 (613 download)

DOWNLOAD NOW!


Book Synopsis Numerical Methods for Stochastic Control Problems in Continuous Time by : Harold Kushner

Download or read book Numerical Methods for Stochastic Control Problems in Continuous Time written by Harold Kushner and published by Springer Science & Business Media. This book was released on 2013-11-27 with total page 480 pages. Available in PDF, EPUB and Kindle. Book excerpt: Stochastic control is a very active area of research. This monograph, written by two leading authorities in the field, has been updated to reflect the latest developments. It covers effective numerical methods for stochastic control problems in continuous time on two levels, that of practice and that of mathematical development. It is broadly accessible for graduate students and researchers.

Continuous-time Stochastic Control and Optimization with Financial Applications

Download Continuous-time Stochastic Control and Optimization with Financial Applications PDF Online Free

Author :
Publisher : Springer Science & Business Media
ISBN 13 : 3540895000
Total Pages : 243 pages
Book Rating : 4.5/5 (48 download)

DOWNLOAD NOW!


Book Synopsis Continuous-time Stochastic Control and Optimization with Financial Applications by : Huyên Pham

Download or read book Continuous-time Stochastic Control and Optimization with Financial Applications written by Huyên Pham and published by Springer Science & Business Media. This book was released on 2009-05-28 with total page 243 pages. Available in PDF, EPUB and Kindle. Book excerpt: Stochastic optimization problems arise in decision-making problems under uncertainty, and find various applications in economics and finance. On the other hand, problems in finance have recently led to new developments in the theory of stochastic control. This volume provides a systematic treatment of stochastic optimization problems applied to finance by presenting the different existing methods: dynamic programming, viscosity solutions, backward stochastic differential equations, and martingale duality methods. The theory is discussed in the context of recent developments in this field, with complete and detailed proofs, and is illustrated by means of concrete examples from the world of finance: portfolio allocation, option hedging, real options, optimal investment, etc. This book is directed towards graduate students and researchers in mathematical finance, and will also benefit applied mathematicians interested in financial applications and practitioners wishing to know more about the use of stochastic optimization methods in finance.

Stochastic Differential Systems, Stochastic Control Theory and Applications

Download Stochastic Differential Systems, Stochastic Control Theory and Applications PDF Online Free

Author :
Publisher : Springer Science & Business Media
ISBN 13 : 1461387620
Total Pages : 601 pages
Book Rating : 4.4/5 (613 download)

DOWNLOAD NOW!


Book Synopsis Stochastic Differential Systems, Stochastic Control Theory and Applications by : Wendell Fleming

Download or read book Stochastic Differential Systems, Stochastic Control Theory and Applications written by Wendell Fleming and published by Springer Science & Business Media. This book was released on 2012-12-06 with total page 601 pages. Available in PDF, EPUB and Kindle. Book excerpt: This IMA Volume in Mathematics and its Applications STOCHASTIC DIFFERENTIAL SYSTEMS, STOCHASTIC CONTROL THEORY AND APPLICATIONS is the proceedings of a workshop which was an integral part of the 1986-87 IMA program on STOCHASTIC DIFFERENTIAL EQUATIONS AND THEIR APPLICATIONS. We are grateful to the Scientific Committee: Daniel Stroock (Chairman) WendeIl Flerning Theodore Harris Pierre-Louis Lions Steven Orey George Papanicolaou for planning and implementing an exciting and stimulating year-long program. We es pecially thank WendeIl Fleming and Pierre-Louis Lions for organizing an interesting and productive workshop in an area in which mathematics is beginning to make significant contributions to real-world problems. George R. Seil Hans Weinberger PREFACE This volume is the Proceedings of a Workshop on Stochastic Differential Systems, Stochastic Control Theory, and Applications held at IMA June 9-19,1986. The Workshop Program Commit tee consisted of W.H. Fleming and P.-L. Lions (co-chairmen), J. Baras, B. Hajek, J.M. Harrison, and H. Sussmann. The Workshop emphasized topics in the following four areas. (1) Mathematical theory of stochastic differential systems, stochastic control and nonlinear filtering for Markov diffusion processes. Connections with partial differential equations. (2) Applications of stochastic differential system theory, in engineering and management sci ence. Adaptive control of Markov processes. Advanced computational methods in stochas tic control and nonlinear filtering. (3) Stochastic scheduling, queueing networks, and related topics. Flow control, multiarm bandit problems, applications to problems of computer networks and scheduling of complex manufacturing operations.

Stochastic Partial Differential Equations and Applications II

Download Stochastic Partial Differential Equations and Applications II PDF Online Free

Author :
Publisher : Springer
ISBN 13 : 3540482008
Total Pages : 264 pages
Book Rating : 4.5/5 (44 download)

DOWNLOAD NOW!


Book Synopsis Stochastic Partial Differential Equations and Applications II by : Giuseppe Da Prato

Download or read book Stochastic Partial Differential Equations and Applications II written by Giuseppe Da Prato and published by Springer. This book was released on 2006-11-14 with total page 264 pages. Available in PDF, EPUB and Kindle. Book excerpt:

Stochastic Processes in Physics and Engineering

Download Stochastic Processes in Physics and Engineering PDF Online Free

Author :
Publisher : Springer Science & Business Media
ISBN 13 : 9400928939
Total Pages : 418 pages
Book Rating : 4.4/5 (9 download)

DOWNLOAD NOW!


Book Synopsis Stochastic Processes in Physics and Engineering by : Sergio Albeverio

Download or read book Stochastic Processes in Physics and Engineering written by Sergio Albeverio and published by Springer Science & Business Media. This book was released on 2012-12-06 with total page 418 pages. Available in PDF, EPUB and Kindle. Book excerpt: Approach your problems from the right end It isn't that they can't see the solution. It is and begin with the answers. Then one day, that they can't see the problem. perhaps you will find the final question. O. K. Chesterton. The Scandal of Father 'The Hermit Qad in Crane Feathers' in R. Brown 'The point of a Pin'. van Gu!ik's The Chinese Maze Murders. Growing specialization and diversification have brought a host of monographs and textbooks on increasingly specialized topics. However, the "tree" of knowledge of mathematics and related fields does not grow only by putting forth new branches. It also happens, quite often in fact, that branches which were thought to be completely disparate are suddenly seen to be related. Further, the kind and level of sophistication of mathematics applied in various sciences has changed drastically in recent years: measure theory is used (non-trivially) in regional and theoretical economics; algebraic geometry interacts with physics; the Minkowsky lemma, coding theory and the structure of water meet one another in packing and covering theory; quantum fields, crystal defects and mathematical programming profit from homotopy theory; Lie algebras are relevant to filtering; and prediction and electrical engineering can use Stein spaces. And in addition to this there are such new emerging subdisciplines as "experimental mathematics", "CFD", "completely integrable systems", "chaos, synergetics and large-scale order", which are almost impossible to fit into the existing classification schemes. They draw upon widely different sections of mathematics.

Markov Processes, Semigroups and Generators

Download Markov Processes, Semigroups and Generators PDF Online Free

Author :
Publisher : Walter de Gruyter
ISBN 13 : 311025011X
Total Pages : 449 pages
Book Rating : 4.1/5 (12 download)

DOWNLOAD NOW!


Book Synopsis Markov Processes, Semigroups and Generators by : Vassili N. Kolokoltsov

Download or read book Markov Processes, Semigroups and Generators written by Vassili N. Kolokoltsov and published by Walter de Gruyter. This book was released on 2011-03-29 with total page 449 pages. Available in PDF, EPUB and Kindle. Book excerpt: Markov processes represent a universal model for a large variety of real life random evolutions. The wide flow of new ideas, tools, methods and applications constantly pours into the ever-growing stream of research on Markov processes that rapidly spreads over new fields of natural and social sciences, creating new streamlined logical paths to its turbulent boundary. Even if a given process is not Markov, it can be often inserted into a larger Markov one (Markovianization procedure) by including the key historic parameters into the state space. This monograph gives a concise, but systematic and self-contained, exposition of the essentials of Markov processes, together with recent achievements, working from the "physical picture" - a formal pre-generator, and stressing the interplay between probabilistic (stochastic differential equations) and analytic (semigroups) tools. The book will be useful to students and researchers. Part I can be used for a one-semester course on Brownian motion, Lévy and Markov processes, or on probabilistic methods for PDE. Part II mainly contains the author's research on Markov processes. From the contents: Tools from Probability and Analysis Brownian motion Markov processes and martingales SDE, ψDE and martingale problems Processes in Euclidean spaces Processes in domains with a boundary Heat kernels for stable-like processes Continuous-time random walks and fractional dynamics Complex chains and Feynman integral

Optimal Control and Partial Differential Equations

Download Optimal Control and Partial Differential Equations PDF Online Free

Author :
Publisher : IOS Press
ISBN 13 : 9781586030964
Total Pages : 632 pages
Book Rating : 4.0/5 (39 download)

DOWNLOAD NOW!


Book Synopsis Optimal Control and Partial Differential Equations by : José Luis Menaldi

Download or read book Optimal Control and Partial Differential Equations written by José Luis Menaldi and published by IOS Press. This book was released on 2001 with total page 632 pages. Available in PDF, EPUB and Kindle. Book excerpt: This volume contains more than sixty invited papers of international wellknown scientists in the fields where Alain Bensoussan's contributions have been particularly important: filtering and control of stochastic systems, variationnal problems, applications to economy and finance, numerical analysis... In particular, the extended texts of the lectures of Professors Jens Frehse, Hitashi Ishii, Jacques-Louis Lions, Sanjoy Mitter, Umberto Mosco, Bernt Oksendal, George Papanicolaou, A. Shiryaev, given in the Conference held in Paris on December 4th, 2000 in honor of Professor Alain Bensoussan are included.

Stochastic Control Theory

Download Stochastic Control Theory PDF Online Free

Author :
Publisher : Springer
ISBN 13 : 4431551239
Total Pages : 263 pages
Book Rating : 4.4/5 (315 download)

DOWNLOAD NOW!


Book Synopsis Stochastic Control Theory by : Makiko Nisio

Download or read book Stochastic Control Theory written by Makiko Nisio and published by Springer. This book was released on 2014-11-27 with total page 263 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book offers a systematic introduction to the optimal stochastic control theory via the dynamic programming principle, which is a powerful tool to analyze control problems. First we consider completely observable control problems with finite horizons. Using a time discretization we construct a nonlinear semigroup related to the dynamic programming principle (DPP), whose generator provides the Hamilton–Jacobi–Bellman (HJB) equation, and we characterize the value function via the nonlinear semigroup, besides the viscosity solution theory. When we control not only the dynamics of a system but also the terminal time of its evolution, control-stopping problems arise. This problem is treated in the same frameworks, via the nonlinear semigroup. Its results are applicable to the American option price problem. Zero-sum two-player time-homogeneous stochastic differential games and viscosity solutions of the Isaacs equations arising from such games are studied via a nonlinear semigroup related to DPP (the min-max principle, to be precise). Using semi-discretization arguments, we construct the nonlinear semigroups whose generators provide lower and upper Isaacs equations. Concerning partially observable control problems, we refer to stochastic parabolic equations driven by colored Wiener noises, in particular, the Zakai equation. The existence and uniqueness of solutions and regularities as well as Itô's formula are stated. A control problem for the Zakai equations has a nonlinear semigroup whose generator provides the HJB equation on a Banach space. The value function turns out to be a unique viscosity solution for the HJB equation under mild conditions. This edition provides a more generalized treatment of the topic than does the earlier book Lectures on Stochastic Control Theory (ISI Lecture Notes 9), where time-homogeneous cases are dealt with. Here, for finite time-horizon control problems, DPP was formulated as a one-parameter nonlinear semigroup, whose generator provides the HJB equation, by using a time-discretization method. The semigroup corresponds to the value function and is characterized as the envelope of Markovian transition semigroups of responses for constant control processes. Besides finite time-horizon controls, the book discusses control-stopping problems in the same frameworks.

Risk and Financial Management

Download Risk and Financial Management PDF Online Free

Author :
Publisher : John Wiley & Sons
ISBN 13 : 0470020350
Total Pages : 358 pages
Book Rating : 4.4/5 (7 download)

DOWNLOAD NOW!


Book Synopsis Risk and Financial Management by : Charles S. Tapiero

Download or read book Risk and Financial Management written by Charles S. Tapiero and published by John Wiley & Sons. This book was released on 2004-07-16 with total page 358 pages. Available in PDF, EPUB and Kindle. Book excerpt: Financial risk management has become a popular practice amongst financial institutions to protect against the adverse effects of uncertainty caused by fluctuations in interest rates, exchange rates, commodity prices, and equity prices. New financial instruments and mathematical techniques are continuously developed and introduced in financial practice. These techniques are being used by an increasing number of firms, traders and financial risk managers across various industries. Risk and Financial Management: Mathematical and Computational Methods confronts the many issues and controversies, and explains the fundamental concepts that underpin financial risk management. Provides a comprehensive introduction to the core topics of risk and financial management. Adopts a pragmatic approach, focused on computational, rather than just theoretical, methods. Bridges the gap between theory and practice in financial risk management Includes coverage of utility theory, probability, options and derivatives, stochastic volatility and value at risk. Suitable for students of risk, mathematical finance, and financial risk management, and finance practitioners. Includes extensive reference lists, applications and suggestions for further reading. Risk and Financial Management: Mathematical and Computational Methods is ideally suited to both students of mathematical finance with little background in economics and finance, and students of financial risk management, as well as finance practitioners requiring a clearer understanding of the mathematical and computational methods they use every day. It combines the required level of rigor, to support the theoretical developments, with a practical flavour through many examples and applications.

Information-Spectrum Methods in Information Theory

Download Information-Spectrum Methods in Information Theory PDF Online Free

Author :
Publisher : Springer Science & Business Media
ISBN 13 : 9783540435815
Total Pages : 568 pages
Book Rating : 4.4/5 (358 download)

DOWNLOAD NOW!


Book Synopsis Information-Spectrum Methods in Information Theory by : Te Sun Han

Download or read book Information-Spectrum Methods in Information Theory written by Te Sun Han and published by Springer Science & Business Media. This book was released on 2002-10-08 with total page 568 pages. Available in PDF, EPUB and Kindle. Book excerpt: From the reviews: "This book nicely complements the existing literature on information and coding theory by concentrating on arbitrary nonstationary and/or nonergodic sources and channels with arbitrarily large alphabets. Even with such generality the authors have managed to successfully reach a highly unconventional but very fertile exposition rendering new insights into many problems." -- MATHEMATICAL REVIEWS

Dynamic Probabilistic Models and Social Structure

Download Dynamic Probabilistic Models and Social Structure PDF Online Free

Author :
Publisher : Springer Science & Business Media
ISBN 13 : 9401125244
Total Pages : 458 pages
Book Rating : 4.4/5 (11 download)

DOWNLOAD NOW!


Book Synopsis Dynamic Probabilistic Models and Social Structure by : Guillermo L. Gómez M.

Download or read book Dynamic Probabilistic Models and Social Structure written by Guillermo L. Gómez M. and published by Springer Science & Business Media. This book was released on 2012-12-06 with total page 458 pages. Available in PDF, EPUB and Kindle. Book excerpt: Mathematical models have been very successful in the study of the physical world. Galilei and Newton introduced point particles moving without friction under the action of simple forces as the basis for the description of concrete motions like the ones of the planets. This approach was sustained by appro priate mathematical methods, namely infinitesimal calculus, which was being developed at that time. In this way classical analytical mechanics was able to establish some general results, gaining insight through explicit solution of some simple cases and developing various methods of approximation for handling more complicated ones. Special relativity theory can be seen as an extension of this kind of modelling. In the study of electromagnetic phenomena and in general relativity another mathematical model is used, in which the concept of classical field plays the fundamental role. The equations of motion here are partial differential equations, and the methods of study used involve further developments of classical analysis. These models are deterministic in nature. However it was realized already in the second half of last century, through the work of Maxwell, Boltzmann, Gibbs and others, that in the discussion of systems involving a great number of particles, the deterministic description is not by itself of great help, in particu lar a suitable "weighting" of all possible initial conditions should be considered.

Image Analysis, Random Fields and Dynamic Monte Carlo Methods

Download Image Analysis, Random Fields and Dynamic Monte Carlo Methods PDF Online Free

Author :
Publisher : Springer Science & Business Media
ISBN 13 : 3642975224
Total Pages : 321 pages
Book Rating : 4.6/5 (429 download)

DOWNLOAD NOW!


Book Synopsis Image Analysis, Random Fields and Dynamic Monte Carlo Methods by : Gerhard Winkler

Download or read book Image Analysis, Random Fields and Dynamic Monte Carlo Methods written by Gerhard Winkler and published by Springer Science & Business Media. This book was released on 2012-12-06 with total page 321 pages. Available in PDF, EPUB and Kindle. Book excerpt: This text is concerned with a probabilistic approach to image analysis as initiated by U. GRENANDER, D. and S. GEMAN, B.R. HUNT and many others, and developed and popularized by D. and S. GEMAN in a paper from 1984. It formally adopts the Bayesian paradigm and therefore is referred to as 'Bayesian Image Analysis'. There has been considerable and still growing interest in prior models and, in particular, in discrete Markov random field methods. Whereas image analysis is replete with ad hoc techniques, Bayesian image analysis provides a general framework encompassing various problems from imaging. Among those are such 'classical' applications like restoration, edge detection, texture discrimination, motion analysis and tomographic reconstruction. The subject is rapidly developing and in the near future is likely to deal with high-level applications like object recognition. Fascinating experiments by Y. CHOW, U. GRENANDER and D.M. KEENAN (1987), (1990) strongly support this belief.

Computational Financial Mathematics using MATHEMATICA®

Download Computational Financial Mathematics using MATHEMATICA® PDF Online Free

Author :
Publisher : Springer Science & Business Media
ISBN 13 : 9780817641979
Total Pages : 500 pages
Book Rating : 4.6/5 (419 download)

DOWNLOAD NOW!


Book Synopsis Computational Financial Mathematics using MATHEMATICA® by : Srdjan Stojanovic

Download or read book Computational Financial Mathematics using MATHEMATICA® written by Srdjan Stojanovic and published by Springer Science & Business Media. This book was released on 2002-10-04 with total page 500 pages. Available in PDF, EPUB and Kindle. Book excerpt: Given the explosion of interest in mathematical methods for solving problems in finance and trading, a great deal of research and development is taking place in universities, large brokerage firms, and in the supporting trading software industry. Mathematical advances have been made both analytically and numerically in finding practical solutions. This book provides a comprehensive overview of existing and original material, about what mathematics when allied with Mathematica can do for finance. Sophisticated theories are presented systematically in a user-friendly style, and a powerful combination of mathematical rigor and Mathematica programming. Three kinds of solution methods are emphasized: symbolic, numerical, and Monte-- Carlo. Nowadays, only good personal computers are required to handle the symbolic and numerical methods that are developed in this book. Key features: * No previous knowledge of Mathematica programming is required * The symbolic, numeric, data management and graphic capabilities of Mathematica are fully utilized * Monte--Carlo solutions of scalar and multivariable SDEs are developed and utilized heavily in discussing trading issues such as Black--Scholes hedging * Black--Scholes and Dupire PDEs are solved symbolically and numerically * Fast numerical solutions to free boundary problems with details of their Mathematica realizations are provided * Comprehensive study of optimal portfolio diversification, including an original theory of optimal portfolio hedging under non-Log-Normal asset price dynamics is presented The book is designed for the academic community of instructors and students, and most importantly, will meet the everyday trading needs of quantitatively inclined professional and individual investors.

Stochastic Networks and Queues

Download Stochastic Networks and Queues PDF Online Free

Author :
Publisher : Springer Science & Business Media
ISBN 13 : 3662130521
Total Pages : 406 pages
Book Rating : 4.6/5 (621 download)

DOWNLOAD NOW!


Book Synopsis Stochastic Networks and Queues by : Philippe Robert

Download or read book Stochastic Networks and Queues written by Philippe Robert and published by Springer Science & Business Media. This book was released on 2013-04-17 with total page 406 pages. Available in PDF, EPUB and Kindle. Book excerpt: Queues and stochastic networks are analyzed in this book with purely probabilistic methods. The purpose of these lectures is to show that general results from Markov processes, martingales or ergodic theory can be used directly to study the corresponding stochastic processes. Recent developments have shown that, instead of having ad-hoc methods, a better understanding of fundamental results on stochastic processes is crucial to study the complex behavior of stochastic networks. In this book, various aspects of these stochastic models are investigated in depth in an elementary way: Existence of equilibrium, characterization of stationary regimes, transient behaviors (rare events, hitting times) and critical regimes, etc. A simple presentation of stationary point processes and Palm measures is given. Scaling methods and functional limit theorems are a major theme of this book. In particular, a complete chapter is devoted to fluid limits of Markov processes.