A Robust Algorithm for Least Absolute Deviations Curve Fitting
Title | A Robust Algorithm for Least Absolute Deviations Curve Fitting PDF eBook |
Author | Dongdong Lei |
Publisher | |
Pages | 8 |
Release | 2001 |
Genre | |
ISBN |
The least absolute deviations criterion, or the l1 norm, is frequently used for approximation where the data may contain outliers or wild points'. One of the most popular methods for solving the least absolute deviations data fitting problem is the Barrodale and Roberts (BR) algorithm (1973), which is based on linear programming techniques and the use of a modified simplex method. This algorithm is particularly efficient. However, since it is based upon the simplex method it can be susceptible to the accumulation of unrecoverable rounding errors caused by using an inappropriate pivot. In this paper we shall show how we can extend a numerically stable form of the simplex method to the special case of l1 approximation whilst still maintaining the efficiency of the Barrodale and Roberts algorithm. This extension is achieved by using the l1 characterization to rebuild the relevant parts of the simplex tableau at each iteration. The advantage of this approach is demonstrated most effectively when the observation matrix of the approximation problem is sparse, as in the case when using compactly supported basis functions such as B-splines. Under these circumstances the new method is considerably more efficient than the Barrodale and Roberts algorithm as well as being more robust.
Least Absolute Deviations
Title | Least Absolute Deviations PDF eBook |
Author | P- Bloomfield |
Publisher | Springer Science & Business Media |
Pages | 363 |
Release | 2012-12-06 |
Genre | Mathematics |
ISBN | 1468485741 |
Least squares is probably the best known method for fitting linear models and by far the most widely used. Surprisingly, the discrete L 1 analogue, least absolute deviations (LAD) seems to have been considered first. Possibly the LAD criterion was forced into the background because of the com putational difficulties associated with it. Recently there has been a resurgence of interest in LAD. It was spurred on by work that has resulted in efficient al gorithms for obtaining LAD fits. Another stimulus came from robust statistics. LAD estimates resist undue effects from a feyv, large errors. Therefore. in addition to being robust, they also make good starting points for other iterative, robust procedures. The LAD criterion has great utility. LAD fits are optimal for linear regressions where the errors are double exponential. However they also have excellent properties well outside this narrow context. In addition they are useful in other linear situations such as time series and multivariate data analysis. Finally, LAD fitting embodies a set of ideas that is important in linear optimization theory and numerical analysis. viii PREFACE In this monograph we will present a unified treatment of the role of LAD techniques in several domains. Some of the material has appeared in recent journal papers and some of it is new. This presentation is organized in the following way. There are three parts, one for Theory, one for Applicatior.s and one for Algorithms.
Least Absolute Deviations
Title | Least Absolute Deviations PDF eBook |
Author | Peter Bloomfield |
Publisher | Birkhäuser |
Pages | 351 |
Release | 2012-12-12 |
Genre | Mathematics |
ISBN | 9781468485769 |
Least squares is probably the best known method for fitting linear models and by far the most widely used. Surprisingly, the discrete L 1 analogue, least absolute deviations (LAD) seems to have been considered first. Possibly the LAD criterion was forced into the background because of the com putational difficulties associated with it. Recently there has been a resurgence of interest in LAD. It was spurred on by work that has resulted in efficient al gorithms for obtaining LAD fits. Another stimulus came from robust statistics. LAD estimates resist undue effects from a feyv, large errors. Therefore. in addition to being robust, they also make good starting points for other iterative, robust procedures. The LAD criterion has great utility. LAD fits are optimal for linear regressions where the errors are double exponential. However they also have excellent properties well outside this narrow context. In addition they are useful in other linear situations such as time series and multivariate data analysis. Finally, LAD fitting embodies a set of ideas that is important in linear optimization theory and numerical analysis. viii PREFACE In this monograph we will present a unified treatment of the role of LAD techniques in several domains. Some of the material has appeared in recent journal papers and some of it is new. This presentation is organized in the following way. There are three parts, one for Theory, one for Applicatior.s and one for Algorithms.
Least Absolute Deviations Curve-fitting
Title | Least Absolute Deviations Curve-fitting PDF eBook |
Author | Peter Bloomfield |
Publisher | |
Pages | 0 |
Release | 1977 |
Genre | |
ISBN |
An Absolute Deviations Curve Fitting Algorithm for Non-linear Models
Title | An Absolute Deviations Curve Fitting Algorithm for Non-linear Models PDF eBook |
Author | Asher Tishler |
Publisher | |
Pages | 46 |
Release | 1978 |
Genre | |
ISBN |
Robust Regression
Title | Robust Regression PDF eBook |
Author | Kenneth D. Lawrence |
Publisher | Routledge |
Pages | 310 |
Release | 2019-05-20 |
Genre | Mathematics |
ISBN | 1351418289 |
Robust Regression: Analysis and Applications characterizes robust estimators in terms of how much they weight each observation discusses generalized properties of Lp-estimators. Includes an algorithm for identifying outliers using least absolute value criterion in regression modeling reviews redescending M-estimators studies Li linear regression proposes the best linear unbiased estimators for fixed parameters and random errors in the mixed linear model summarizes known properties of Li estimators for time series analysis examines ordinary least squares, latent root regression, and a robust regression weighting scheme and evaluates results from five different robust ridge regression estimators.
Robust Regression and Outlier Detection
Title | Robust Regression and Outlier Detection PDF eBook |
Author | Peter J. Rousseeuw |
Publisher | John Wiley & Sons |
Pages | 329 |
Release | 2005-02-25 |
Genre | Mathematics |
ISBN | 0471725374 |
WILEY-INTERSCIENCE PAPERBACK SERIES The Wiley-Interscience Paperback Series consists of selectedbooks that have been made more accessible to consumers in an effortto increase global appeal and general circulation. With these newunabridged softcover volumes, Wiley hopes to extend the lives ofthese works by making them available to future generations ofstatisticians, mathematicians, and scientists. "The writing style is clear and informal, and much of thediscussion is oriented to application. In short, the book is akeeper." –Mathematical Geology "I would highly recommend the addition of this book to thelibraries of both students and professionals. It is a usefultextbook for the graduate student, because it emphasizes both thephilosophy and practice of robustness in regression settings, andit provides excellent examples of precise, logical proofs oftheorems. . . .Even for those who are familiar with robustness, thebook will be a good reference because it consolidates the researchin high-breakdown affine equivariant estimators and includes anextensive bibliography in robust regression, outlier diagnostics,and related methods. The aim of this book, the authors tell us, is‘to make robust regression available for everyday statisticalpractice.’ Rousseeuw and Leroy have included all of thenecessary ingredients to make this happen." –Journal of the American Statistical Association