A Robust Algorithm for Least Absolute Deviations Curve Fitting

A Robust Algorithm for Least Absolute Deviations Curve Fitting
Title A Robust Algorithm for Least Absolute Deviations Curve Fitting PDF eBook
Author Dongdong Lei
Publisher
Pages 8
Release 2001
Genre
ISBN

Download A Robust Algorithm for Least Absolute Deviations Curve Fitting Book in PDF, Epub and Kindle

The least absolute deviations criterion, or the l1 norm, is frequently used for approximation where the data may contain outliers or wild points'. One of the most popular methods for solving the least absolute deviations data fitting problem is the Barrodale and Roberts (BR) algorithm (1973), which is based on linear programming techniques and the use of a modified simplex method. This algorithm is particularly efficient. However, since it is based upon the simplex method it can be susceptible to the accumulation of unrecoverable rounding errors caused by using an inappropriate pivot. In this paper we shall show how we can extend a numerically stable form of the simplex method to the special case of l1 approximation whilst still maintaining the efficiency of the Barrodale and Roberts algorithm. This extension is achieved by using the l1 characterization to rebuild the relevant parts of the simplex tableau at each iteration. The advantage of this approach is demonstrated most effectively when the observation matrix of the approximation problem is sparse, as in the case when using compactly supported basis functions such as B-splines. Under these circumstances the new method is considerably more efficient than the Barrodale and Roberts algorithm as well as being more robust.

Least Absolute Deviations

Least Absolute Deviations
Title Least Absolute Deviations PDF eBook
Author P- Bloomfield
Publisher Springer Science & Business Media
Pages 363
Release 2012-12-06
Genre Mathematics
ISBN 1468485741

Download Least Absolute Deviations Book in PDF, Epub and Kindle

Least squares is probably the best known method for fitting linear models and by far the most widely used. Surprisingly, the discrete L 1 analogue, least absolute deviations (LAD) seems to have been considered first. Possibly the LAD criterion was forced into the background because of the com putational difficulties associated with it. Recently there has been a resurgence of interest in LAD. It was spurred on by work that has resulted in efficient al gorithms for obtaining LAD fits. Another stimulus came from robust statistics. LAD estimates resist undue effects from a feyv, large errors. Therefore. in addition to being robust, they also make good starting points for other iterative, robust procedures. The LAD criterion has great utility. LAD fits are optimal for linear regressions where the errors are double exponential. However they also have excellent properties well outside this narrow context. In addition they are useful in other linear situations such as time series and multivariate data analysis. Finally, LAD fitting embodies a set of ideas that is important in linear optimization theory and numerical analysis. viii PREFACE In this monograph we will present a unified treatment of the role of LAD techniques in several domains. Some of the material has appeared in recent journal papers and some of it is new. This presentation is organized in the following way. There are three parts, one for Theory, one for Applicatior.s and one for Algorithms.

Least Absolute Deviations

Least Absolute Deviations
Title Least Absolute Deviations PDF eBook
Author Peter Bloomfield
Publisher Birkhäuser
Pages 351
Release 2012-12-12
Genre Mathematics
ISBN 9781468485769

Download Least Absolute Deviations Book in PDF, Epub and Kindle

Least squares is probably the best known method for fitting linear models and by far the most widely used. Surprisingly, the discrete L 1 analogue, least absolute deviations (LAD) seems to have been considered first. Possibly the LAD criterion was forced into the background because of the com putational difficulties associated with it. Recently there has been a resurgence of interest in LAD. It was spurred on by work that has resulted in efficient al gorithms for obtaining LAD fits. Another stimulus came from robust statistics. LAD estimates resist undue effects from a feyv, large errors. Therefore. in addition to being robust, they also make good starting points for other iterative, robust procedures. The LAD criterion has great utility. LAD fits are optimal for linear regressions where the errors are double exponential. However they also have excellent properties well outside this narrow context. In addition they are useful in other linear situations such as time series and multivariate data analysis. Finally, LAD fitting embodies a set of ideas that is important in linear optimization theory and numerical analysis. viii PREFACE In this monograph we will present a unified treatment of the role of LAD techniques in several domains. Some of the material has appeared in recent journal papers and some of it is new. This presentation is organized in the following way. There are three parts, one for Theory, one for Applicatior.s and one for Algorithms.

Least Absolute Deviations Curve-fitting

Least Absolute Deviations Curve-fitting
Title Least Absolute Deviations Curve-fitting PDF eBook
Author Peter Bloomfield
Publisher
Pages 0
Release 1977
Genre
ISBN

Download Least Absolute Deviations Curve-fitting Book in PDF, Epub and Kindle

An Absolute Deviations Curve Fitting Algorithm for Non-linear Models

An Absolute Deviations Curve Fitting Algorithm for Non-linear Models
Title An Absolute Deviations Curve Fitting Algorithm for Non-linear Models PDF eBook
Author Asher Tishler
Publisher
Pages 46
Release 1978
Genre
ISBN

Download An Absolute Deviations Curve Fitting Algorithm for Non-linear Models Book in PDF, Epub and Kindle

Robust Regression

Robust Regression
Title Robust Regression PDF eBook
Author Kenneth D. Lawrence
Publisher Routledge
Pages 310
Release 2019-05-20
Genre Mathematics
ISBN 1351418289

Download Robust Regression Book in PDF, Epub and Kindle

Robust Regression: Analysis and Applications characterizes robust estimators in terms of how much they weight each observation discusses generalized properties of Lp-estimators. Includes an algorithm for identifying outliers using least absolute value criterion in regression modeling reviews redescending M-estimators studies Li linear regression proposes the best linear unbiased estimators for fixed parameters and random errors in the mixed linear model summarizes known properties of Li estimators for time series analysis examines ordinary least squares, latent root regression, and a robust regression weighting scheme and evaluates results from five different robust ridge regression estimators.

Robust Regression and Outlier Detection

Robust Regression and Outlier Detection
Title Robust Regression and Outlier Detection PDF eBook
Author Peter J. Rousseeuw
Publisher John Wiley & Sons
Pages 329
Release 2005-02-25
Genre Mathematics
ISBN 0471725374

Download Robust Regression and Outlier Detection Book in PDF, Epub and Kindle

WILEY-INTERSCIENCE PAPERBACK SERIES The Wiley-Interscience Paperback Series consists of selectedbooks that have been made more accessible to consumers in an effortto increase global appeal and general circulation. With these newunabridged softcover volumes, Wiley hopes to extend the lives ofthese works by making them available to future generations ofstatisticians, mathematicians, and scientists. "The writing style is clear and informal, and much of thediscussion is oriented to application. In short, the book is akeeper." –Mathematical Geology "I would highly recommend the addition of this book to thelibraries of both students and professionals. It is a usefultextbook for the graduate student, because it emphasizes both thephilosophy and practice of robustness in regression settings, andit provides excellent examples of precise, logical proofs oftheorems. . . .Even for those who are familiar with robustness, thebook will be a good reference because it consolidates the researchin high-breakdown affine equivariant estimators and includes anextensive bibliography in robust regression, outlier diagnostics,and related methods. The aim of this book, the authors tell us, is‘to make robust regression available for everyday statisticalpractice.’ Rousseeuw and Leroy have included all of thenecessary ingredients to make this happen." –Journal of the American Statistical Association