Robust Techniques for High-dimensional Data

Download Robust Techniques for High-dimensional Data PDF Online Free

Author :
Publisher :
ISBN 13 :
Total Pages : 0 pages
Book Rating : 4.:/5 (14 download)

DOWNLOAD NOW!


Book Synopsis Robust Techniques for High-dimensional Data by : Zhaoxue Tong

Download or read book Robust Techniques for High-dimensional Data written by Zhaoxue Tong and published by . This book was released on 2023 with total page 0 pages. Available in PDF, EPUB and Kindle. Book excerpt: This dissertation aims to develop statistical methods to address the challenges in modeling high-dimensional data caused by the presence of large amounts of noisy and ultra-high-dimensional data. The work focuses on fundamental theory and methodology in high-dimensional data analysis, including feature screening, false discovery rate control, robust regression, and precision matrix estimation. The first project introduces a new model-free conditional feature screening approach that is robust to outliers and heavy-tailed predictors and responses. Additionally, an FDR control procedure is proposed to enhance the performance of the screening procedure. We provide theoretical guarantees for the sure screening and false discovery control performance. We also present finite sample performance comparisons with existing methods through Monte Carlo simulation studies and a real data example. The second project proposes a new robust estimator that can handle both heavy-tailed predictors and heavy-tailed errors in high-dimensional regression. The estimator employs rank-based regression and winsorizes heavy-tailed predictors, with a focus on reducing the burden of tuning. The work establishes sufficient conditions for statistical consistency and demonstrates the strong oracle property through a second-stage enhancement. Both simulation studies and real data analysis demonstrate good performance. The third project presents a new approach for estimating the precision matrix for high-dimensional heavy-tailed data. The proposed estimator employs winsorized rank-based regression and eliminates the burden of fine-tuning, providing robustness guarantees and computational efficiency. We establish sufficient conditions for statistical consistency and propose a robust variance estimator for heavy-tailed data based on the median-of-means approach, which performs well in simulation studies.

Robust Correlation

Download Robust Correlation PDF Online Free

Author :
Publisher : John Wiley & Sons
ISBN 13 : 1118493451
Total Pages : 353 pages
Book Rating : 4.1/5 (184 download)

DOWNLOAD NOW!


Book Synopsis Robust Correlation by : Georgy L. Shevlyakov

Download or read book Robust Correlation written by Georgy L. Shevlyakov and published by John Wiley & Sons. This book was released on 2016-09-19 with total page 353 pages. Available in PDF, EPUB and Kindle. Book excerpt: This bookpresents material on both the analysis of the classical concepts of correlation and on the development of their robust versions, as well as discussing the related concepts of correlation matrices, partial correlation, canonical correlation, rank correlations, with the corresponding robust and non-robust estimation procedures. Every chapter contains a set of examples with simulated and real-life data. Key features: Makes modern and robust correlation methods readily available and understandable to practitioners, specialists, and consultants working in various fields. Focuses on implementation of methodology and application of robust correlation with R. Introduces the main approaches in robust statistics, such as Huber’s minimax approach and Hampel’s approach based on influence functions. Explores various robust estimates of the correlation coefficient including the minimax variance and bias estimates as well as the most B- and V-robust estimates. Contains applications of robust correlation methods to exploratory data analysis, multivariate statistics, statistics of time series, and to real-life data. Includes an accompanying website featuring computer code and datasets Features exercises and examples throughout the text using both small and large data sets. Theoretical and applied statisticians, specialists in multivariate statistics, robust statistics, robust time series analysis, data analysis and signal processing will benefit from this book. Practitioners who use correlation based methods in their work as well as postgraduate students in statistics will also find this book useful.

Robust Penalized Regression for Complex High-dimensional Data

Download Robust Penalized Regression for Complex High-dimensional Data PDF Online Free

Author :
Publisher :
ISBN 13 :
Total Pages : 169 pages
Book Rating : 4.:/5 (119 download)

DOWNLOAD NOW!


Book Synopsis Robust Penalized Regression for Complex High-dimensional Data by : Bin Luo

Download or read book Robust Penalized Regression for Complex High-dimensional Data written by Bin Luo and published by . This book was released on 2020 with total page 169 pages. Available in PDF, EPUB and Kindle. Book excerpt: "Robust high-dimensional data analysis has become an important and challenging task in complex Big Data analysis due to the high-dimensionality and data contamination. One of the most popular procedures is the robust penalized regression. In this dissertation, we address three typical robust ultra-high dimensional regression problems via penalized regression approaches. The first problem is related to the linear model with the existence of outliers, dealing with the outlier detection, variable selection and parameter estimation simultaneously. The second problem is related to robust high-dimensional mean regression with irregular settings such as the data contamination, data asymmetry and heteroscedasticity. The third problem is related to robust bi-level variable selection for the linear regression model with grouping structures in covariates. In Chapter 1, we introduce the background and challenges by overviews of penalized least squares methods and robust regression techniques. In Chapter 2, we propose a novel approach in a penalized weighted least squares framework to perform simultaneous variable selection and outlier detection. We provide a unified link between the proposed framework and a robust M-estimation in general settings. We also establish the non-asymptotic oracle inequalities for the joint estimation of both the regression coefficients and weight vectors. In Chapter 3, we establish a framework of robust estimators in high-dimensional regression models using Penalized Robust Approximated quadratic M estimation (PRAM). This framework allows general settings such as random errors lack of symmetry and homogeneity, or covariates are not sub-Gaussian. Theoretically, we show that, in the ultra-high dimension setting, the PRAM estimator has local estimation consistency at the minimax rate enjoyed by the LS-Lasso and owns the local oracle property, under certain mild conditions. In Chapter 4, we extend the study in Chapter 3 to robust high-dimensional data analysis with structured sparsity. In particular, we propose a framework of high-dimensional M-estimators for bi-level variable selection. This framework encourages bi-level sparsity through a computationally efficient two-stage procedure. It produces strong robust parameter estimators if some nonconvex redescending loss functions are applied. In theory, we provide sufficient conditions under which our proposed two-stage penalized M-estimator possesses simultaneous local estimation consistency and the bi-level variable selection consistency, if a certain nonconvex penalty function is used at the group level. The performances of the proposed estimators are demonstrated in both simulation studies and real examples. In Chapter 5, we provide some discussions and future work."--Abstract from author supplied metadata

Data Depth

Download Data Depth PDF Online Free

Author :
Publisher : American Mathematical Soc.
ISBN 13 : 0821835963
Total Pages : 264 pages
Book Rating : 4.8/5 (218 download)

DOWNLOAD NOW!


Book Synopsis Data Depth by : Regina Y. Liu

Download or read book Data Depth written by Regina Y. Liu and published by American Mathematical Soc.. This book was released on 2006 with total page 264 pages. Available in PDF, EPUB and Kindle. Book excerpt: The book is a collection of some of the research presented at the workshop of the same name held in May 2003 at Rutgers University. The workshop brought together researchers from two different communities: statisticians and specialists in computational geometry. The main idea unifying these two research areas turned out to be the notion of data depth, which is an important notion both in statistics and in the study of efficiency of algorithms used in computational geometry. Many of the articles in the book lay down the foundations for further collaboration and interdisciplinary research. Information for our distributors: Co-published with the Center for Discrete Mathematics and Theoretical Computer Science beginning with Volume 8. Volumes 1-7 were co-published with the Association for Computer Machinery (ACM).

Robust High-dimensional Data Analysis Using a Weight Shrinkage Rule

Download Robust High-dimensional Data Analysis Using a Weight Shrinkage Rule PDF Online Free

Author :
Publisher :
ISBN 13 :
Total Pages : 73 pages
Book Rating : 4.:/5 (979 download)

DOWNLOAD NOW!


Book Synopsis Robust High-dimensional Data Analysis Using a Weight Shrinkage Rule by : Bin Luo

Download or read book Robust High-dimensional Data Analysis Using a Weight Shrinkage Rule written by Bin Luo and published by . This book was released on 2016 with total page 73 pages. Available in PDF, EPUB and Kindle. Book excerpt: "In high-dimensional settings, a penalized least squares approach may lose its efficiency in both estimation and variable selection due to the existence of either outliers or heteroscedasticity. In this thesis, we propose a novel approach to perform robust high-dimensional data analysis in a penalized weighted least square framework. The main idea is to relate the irregularity of each observation to a weight vector and obtain the outlying status data-adaptively using a weight shrinkage rule. By usage of L-1 type regularization on both the coefficients and weight vectors, the proposed method is able to perform simultaneous variable selection and outliers detection efficiently. Eventually, this procedure results in estimators with potentially strong robustness and non-asymptotic consistency. We provide a unified link between the weight shrinkage rule and a robust M-estimation in general settings. We also establish the non-asymptotic oracle inequalities for the joint estimation of both the regression coefficients and weight vectors. These theoretical results allow the number of variables to far exceed the sample size. The performance of the proposed estimator is demonstrated in both simulation studies and real examples."--Abstract from author supplied metadata.

Robust Regression and Outlier Detection

Download Robust Regression and Outlier Detection PDF Online Free

Author :
Publisher : John Wiley & Sons
ISBN 13 : 0471725374
Total Pages : 329 pages
Book Rating : 4.4/5 (717 download)

DOWNLOAD NOW!


Book Synopsis Robust Regression and Outlier Detection by : Peter J. Rousseeuw

Download or read book Robust Regression and Outlier Detection written by Peter J. Rousseeuw and published by John Wiley & Sons. This book was released on 2005-02-25 with total page 329 pages. Available in PDF, EPUB and Kindle. Book excerpt: WILEY-INTERSCIENCE PAPERBACK SERIES The Wiley-Interscience Paperback Series consists of selectedbooks that have been made more accessible to consumers in an effortto increase global appeal and general circulation. With these newunabridged softcover volumes, Wiley hopes to extend the lives ofthese works by making them available to future generations ofstatisticians, mathematicians, and scientists. "The writing style is clear and informal, and much of thediscussion is oriented to application. In short, the book is akeeper." –Mathematical Geology "I would highly recommend the addition of this book to thelibraries of both students and professionals. It is a usefultextbook for the graduate student, because it emphasizes both thephilosophy and practice of robustness in regression settings, andit provides excellent examples of precise, logical proofs oftheorems. . . .Even for those who are familiar with robustness, thebook will be a good reference because it consolidates the researchin high-breakdown affine equivariant estimators and includes anextensive bibliography in robust regression, outlier diagnostics,and related methods. The aim of this book, the authors tell us, is‘to make robust regression available for everyday statisticalpractice.’ Rousseeuw and Leroy have included all of thenecessary ingredients to make this happen." –Journal of the American Statistical Association

Machine Learning and Knowledge Discovery in Databases

Download Machine Learning and Knowledge Discovery in Databases PDF Online Free

Author :
Publisher : Springer Science & Business Media
ISBN 13 : 354087478X
Total Pages : 714 pages
Book Rating : 4.5/5 (48 download)

DOWNLOAD NOW!


Book Synopsis Machine Learning and Knowledge Discovery in Databases by : Walter Daelemans

Download or read book Machine Learning and Knowledge Discovery in Databases written by Walter Daelemans and published by Springer Science & Business Media. This book was released on 2008-09-04 with total page 714 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book constitutes the refereed proceedings of the joint conference on Machine Learning and Knowledge Discovery in Databases: ECML PKDD 2008, held in Antwerp, Belgium, in September 2008. The 100 papers presented in two volumes, together with 5 invited talks, were carefully reviewed and selected from 521 submissions. In addition to the regular papers the volume contains 14 abstracts of papers appearing in full version in the Machine Learning Journal and the Knowledge Discovery and Databases Journal of Springer. The conference intends to provide an international forum for the discussion of the latest high quality research results in all areas related to machine learning and knowledge discovery in databases. The topics addressed are application of machine learning and data mining methods to real-world problems, particularly exploratory research that describes novel learning and mining tasks and applications requiring non-standard techniques.

An Introduction to the Analysis of Algorithms

Download An Introduction to the Analysis of Algorithms PDF Online Free

Author :
Publisher : Addison-Wesley
ISBN 13 : 0133373487
Total Pages : 735 pages
Book Rating : 4.1/5 (333 download)

DOWNLOAD NOW!


Book Synopsis An Introduction to the Analysis of Algorithms by : Robert Sedgewick

Download or read book An Introduction to the Analysis of Algorithms written by Robert Sedgewick and published by Addison-Wesley. This book was released on 2013-01-18 with total page 735 pages. Available in PDF, EPUB and Kindle. Book excerpt: Despite growing interest, basic information on methods and models for mathematically analyzing algorithms has rarely been directly accessible to practitioners, researchers, or students. An Introduction to the Analysis of Algorithms, Second Edition, organizes and presents that knowledge, fully introducing primary techniques and results in the field. Robert Sedgewick and the late Philippe Flajolet have drawn from both classical mathematics and computer science, integrating discrete mathematics, elementary real analysis, combinatorics, algorithms, and data structures. They emphasize the mathematics needed to support scientific studies that can serve as the basis for predicting algorithm performance and for comparing different algorithms on the basis of performance. Techniques covered in the first half of the book include recurrences, generating functions, asymptotics, and analytic combinatorics. Structures studied in the second half of the book include permutations, trees, strings, tries, and mappings. Numerous examples are included throughout to illustrate applications to the analysis of algorithms that are playing a critical role in the evolution of our modern computational infrastructure. Improvements and additions in this new edition include Upgraded figures and code An all-new chapter introducing analytic combinatorics Simplified derivations via analytic combinatorics throughout The book’s thorough, self-contained coverage will help readers appreciate the field’s challenges, prepare them for advanced results—covered in their monograph Analytic Combinatorics and in Donald Knuth’s The Art of Computer Programming books—and provide the background they need to keep abreast of new research. "[Sedgewick and Flajolet] are not only worldwide leaders of the field, they also are masters of exposition. I am sure that every serious computer scientist will find this book rewarding in many ways." —From the Foreword by Donald E. Knuth

Robust Statistics

Download Robust Statistics PDF Online Free

Author :
Publisher : John Wiley & Sons
ISBN 13 : 1119214688
Total Pages : 466 pages
Book Rating : 4.1/5 (192 download)

DOWNLOAD NOW!


Book Synopsis Robust Statistics by : Ricardo A. Maronna

Download or read book Robust Statistics written by Ricardo A. Maronna and published by John Wiley & Sons. This book was released on 2019-01-04 with total page 466 pages. Available in PDF, EPUB and Kindle. Book excerpt: A new edition of this popular text on robust statistics, thoroughly updated to include new and improved methods and focus on implementation of methodology using the increasingly popular open-source software R. Classical statistics fail to cope well with outliers associated with deviations from standard distributions. Robust statistical methods take into account these deviations when estimating the parameters of parametric models, thus increasing the reliability of fitted models and associated inference. This new, second edition of Robust Statistics: Theory and Methods (with R) presents a broad coverage of the theory of robust statistics that is integrated with computing methods and applications. Updated to include important new research results of the last decade and focus on the use of the popular software package R, it features in-depth coverage of the key methodology, including regression, multivariate analysis, and time series modeling. The book is illustrated throughout by a range of examples and applications that are supported by a companion website featuring data sets and R code that allow the reader to reproduce the examples given in the book. Unlike other books on the market, Robust Statistics: Theory and Methods (with R) offers the most comprehensive, definitive, and up-to-date treatment of the subject. It features chapters on estimating location and scale; measuring robustness; linear regression with fixed and with random predictors; multivariate analysis; generalized linear models; time series; numerical algorithms; and asymptotic theory of M-estimates. Explains both the use and theoretical justification of robust methods Guides readers in selecting and using the most appropriate robust methods for their problems Features computational algorithms for the core methods Robust statistics research results of the last decade included in this 2nd edition include: fast deterministic robust regression, finite-sample robustness, robust regularized regression, robust location and scatter estimation with missing data, robust estimation with independent outliers in variables, and robust mixed linear models. Robust Statistics aims to stimulate the use of robust methods as a powerful tool to increase the reliability and accuracy of statistical modelling and data analysis. It is an ideal resource for researchers, practitioners, and graduate students in statistics, engineering, computer science, and physical and social sciences.

Robust Statistical Procedures

Download Robust Statistical Procedures PDF Online Free

Author :
Publisher : SIAM
ISBN 13 : 9781611970036
Total Pages : 77 pages
Book Rating : 4.9/5 (7 download)

DOWNLOAD NOW!


Book Synopsis Robust Statistical Procedures by : Peter J. Huber

Download or read book Robust Statistical Procedures written by Peter J. Huber and published by SIAM. This book was released on 1996-01-01 with total page 77 pages. Available in PDF, EPUB and Kindle. Book excerpt: Here is a brief, well-organized, and easy-to-follow introduction and overview of robust statistics. Huber focuses primarily on the important and clearly understood case of distribution robustness, where the shape of the true underlying distribution deviates slightly from the assumed model (usually the Gaussian law). An additional chapter on recent developments in robustness has been added and the reference list has been expanded and updated from the 1977 edition.

Data-Driven Science and Engineering

Download Data-Driven Science and Engineering PDF Online Free

Author :
Publisher : Cambridge University Press
ISBN 13 : 1009098489
Total Pages : 615 pages
Book Rating : 4.0/5 (9 download)

DOWNLOAD NOW!


Book Synopsis Data-Driven Science and Engineering by : Steven L. Brunton

Download or read book Data-Driven Science and Engineering written by Steven L. Brunton and published by Cambridge University Press. This book was released on 2022-05-05 with total page 615 pages. Available in PDF, EPUB and Kindle. Book excerpt: A textbook covering data-science and machine learning methods for modelling and control in engineering and science, with Python and MATLAB®.

Beyond the Worst-Case Analysis of Algorithms

Download Beyond the Worst-Case Analysis of Algorithms PDF Online Free

Author :
Publisher : Cambridge University Press
ISBN 13 : 1108494315
Total Pages : 705 pages
Book Rating : 4.1/5 (84 download)

DOWNLOAD NOW!


Book Synopsis Beyond the Worst-Case Analysis of Algorithms by : Tim Roughgarden

Download or read book Beyond the Worst-Case Analysis of Algorithms written by Tim Roughgarden and published by Cambridge University Press. This book was released on 2021-01-14 with total page 705 pages. Available in PDF, EPUB and Kindle. Book excerpt: Introduces exciting new methods for assessing algorithms for problems ranging from clustering to linear programming to neural networks.

High-Dimensional Probability

Download High-Dimensional Probability PDF Online Free

Author :
Publisher : Cambridge University Press
ISBN 13 : 1108415199
Total Pages : 299 pages
Book Rating : 4.1/5 (84 download)

DOWNLOAD NOW!


Book Synopsis High-Dimensional Probability by : Roman Vershynin

Download or read book High-Dimensional Probability written by Roman Vershynin and published by Cambridge University Press. This book was released on 2018-09-27 with total page 299 pages. Available in PDF, EPUB and Kindle. Book excerpt: An integrated package of powerful probabilistic tools and key applications in modern mathematical data science.

Algorithmic High-Dimensional Robust Statistics

Download Algorithmic High-Dimensional Robust Statistics PDF Online Free

Author :
Publisher : Cambridge University Press
ISBN 13 : 1108950213
Total Pages : 302 pages
Book Rating : 4.1/5 (89 download)

DOWNLOAD NOW!


Book Synopsis Algorithmic High-Dimensional Robust Statistics by : Ilias Diakonikolas

Download or read book Algorithmic High-Dimensional Robust Statistics written by Ilias Diakonikolas and published by Cambridge University Press. This book was released on 2023-08-31 with total page 302 pages. Available in PDF, EPUB and Kindle. Book excerpt: Robust statistics is the study of designing estimators that perform well even when the dataset significantly deviates from the idealized modeling assumptions, such as in the presence of model misspecification or adversarial outliers in the dataset. The classical statistical theory, dating back to pioneering works by Tukey and Huber, characterizes the information-theoretic limits of robust estimation for most common problems. A recent line of work in computer science gave the first computationally efficient robust estimators in high dimensions for a range of learning tasks. This reference text for graduate students, researchers, and professionals in machine learning theory, provides an overview of recent developments in algorithmic high-dimensional robust statistics, presenting the underlying ideas in a clear and unified manner, while leveraging new perspectives on the developed techniques to provide streamlined proofs of these results. The most basic and illustrative results are analyzed in each chapter, while more tangential developments are explored in the exercises.

Comprehensive Chemometrics

Download Comprehensive Chemometrics PDF Online Free

Author :
Publisher : Elsevier
ISBN 13 : 0444641661
Total Pages : 2948 pages
Book Rating : 4.4/5 (446 download)

DOWNLOAD NOW!


Book Synopsis Comprehensive Chemometrics by : Steven Brown

Download or read book Comprehensive Chemometrics written by Steven Brown and published by Elsevier. This book was released on 2020-05-26 with total page 2948 pages. Available in PDF, EPUB and Kindle. Book excerpt: Comprehensive Chemometrics, Second Edition, Four Volume Set features expanded and updated coverage, along with new content that covers advances in the field since the previous edition published in 2009. Subject of note include updates in the fields of multidimensional and megavariate data analysis, omics data analysis, big chemical and biochemical data analysis, data fusion and sparse methods. The book follows a similar structure to the previous edition, using the same section titles to frame articles. Many chapters from the previous edition are updated, but there are also many new chapters on the latest developments. Presents integrated reviews of each chemical and biological method, examining their merits and limitations through practical examples and extensive visuals Bridges a gap in knowledge, covering developments in the field since the first edition published in 2009 Meticulously organized, with articles split into 4 sections and 12 sub-sections on key topics to allow students, researchers and professionals to find relevant information quickly and easily Written by academics and practitioners from various fields and regions to ensure that the knowledge within is easily understood and applicable to a large audience Presents integrated reviews of each chemical and biological method, examining their merits and limitations through practical examples and extensive visuals Bridges a gap in knowledge, covering developments in the field since the first edition published in 2009 Meticulously organized, with articles split into 4 sections and 12 sub-sections on key topics to allow students, researchers and professionals to find relevant information quickly and easily Written by academics and practitioners from various fields and regions to ensure that the knowledge within is easily understood and applicable to a large audience

High-Dimensional Data Analysis with Low-Dimensional Models

Download High-Dimensional Data Analysis with Low-Dimensional Models PDF Online Free

Author :
Publisher : Cambridge University Press
ISBN 13 : 1108805558
Total Pages : 718 pages
Book Rating : 4.1/5 (88 download)

DOWNLOAD NOW!


Book Synopsis High-Dimensional Data Analysis with Low-Dimensional Models by : John Wright

Download or read book High-Dimensional Data Analysis with Low-Dimensional Models written by John Wright and published by Cambridge University Press. This book was released on 2022-01-13 with total page 718 pages. Available in PDF, EPUB and Kindle. Book excerpt: Connecting theory with practice, this systematic and rigorous introduction covers the fundamental principles, algorithms and applications of key mathematical models for high-dimensional data analysis. Comprehensive in its approach, it provides unified coverage of many different low-dimensional models and analytical techniques, including sparse and low-rank models, and both convex and non-convex formulations. Readers will learn how to develop efficient and scalable algorithms for solving real-world problems, supported by numerous examples and exercises throughout, and how to use the computational tools learnt in several application contexts. Applications presented include scientific imaging, communication, face recognition, 3D vision, and deep networks for classification. With code available online, this is an ideal textbook for senior and graduate students in computer science, data science, and electrical engineering, as well as for those taking courses on sparsity, low-dimensional structures, and high-dimensional data. Foreword by Emmanuel Candès.

Statistical Learning with Sparsity

Download Statistical Learning with Sparsity PDF Online Free

Author :
Publisher : CRC Press
ISBN 13 : 1498712177
Total Pages : 354 pages
Book Rating : 4.4/5 (987 download)

DOWNLOAD NOW!


Book Synopsis Statistical Learning with Sparsity by : Trevor Hastie

Download or read book Statistical Learning with Sparsity written by Trevor Hastie and published by CRC Press. This book was released on 2015-05-07 with total page 354 pages. Available in PDF, EPUB and Kindle. Book excerpt: Discover New Methods for Dealing with High-Dimensional DataA sparse statistical model has only a small number of nonzero parameters or weights; therefore, it is much easier to estimate and interpret than a dense model. Statistical Learning with Sparsity: The Lasso and Generalizations presents methods that exploit sparsity to help recover the underl