Least Absolute Deviation Estimation for General Autoregressive Moving Average Time-Series Models

Least Absolute Deviation Estimation for General Autoregressive Moving Average Time-Series Models
Title Least Absolute Deviation Estimation for General Autoregressive Moving Average Time-Series Models PDF eBook
Author Rongning Wu
Publisher
Pages 0
Release 2010
Genre
ISBN

Download Least Absolute Deviation Estimation for General Autoregressive Moving Average Time-Series Models Book in PDF, Epub and Kindle

We study least absolute deviation (LAD) estimation for general autoregressive moving average time-series models that may be noncausal, noninvertible or both. For ARMA models with Gaussian noise, causality and invertibility are assumed for the parameterization to be identifiable. The assumptions, however, are not required for models with non-Gaussian noise, and hence are removed in our study. We derive a functional limit theorem for random processes based on an LAD objective function, and establish the consistency and asymptotic normality of the LAD estimator. The performance of the estimator is evaluated via simulation and compared with the asymptotic theory. Application to real data is also provided.

Lasso for Autoregressive and Moving Average Coeffi[ci]ents Via Residuals of Unobservable Time Series

Lasso for Autoregressive and Moving Average Coeffi[ci]ents Via Residuals of Unobservable Time Series
Title Lasso for Autoregressive and Moving Average Coeffi[ci]ents Via Residuals of Unobservable Time Series PDF eBook
Author Hanh Nguyen
Publisher
Pages 115
Release 2018
Genre Autoregression (Statistics).
ISBN

Download Lasso for Autoregressive and Moving Average Coeffi[ci]ents Via Residuals of Unobservable Time Series Book in PDF, Epub and Kindle

This dissertation contains four topics in time series data analysis. First, we propose the oracle model selection for autoregressive time series when the observations are contaminated with trend. An adaptive least absolute shrinkage and selection operator (LASSO) type model selection method is used after the trend is estimated by non-parametric B-splines method. The first step is to estimate the trend by B-splines method and then calculate the detrended residuals. The second step is to use the residuals as if they were observations to optimize an adaptive LASSO type objective function. The oracle properties of such an Adaptive Lasso model selection procedure are established; that is, the proposed method can identify the true model with probability approaching one as the sample size increases, and the asymptotic properties of estimators are not affected by the replacement of observations with detrended residuals. The extensive simulation studies of several constrained and unconstrained autoregressive models also confirm the theoretical results. The method is illustrated by two time series data sets, the annual U.S. tobacco production and annual tree ring width measurements. Second, we generalize our first topic to a more general class of time series using the autoregressive and moving-average (ARMA) model. The ARMA model class is the building block for stationary time series analysis. We adopt the two-step method non-parametric trend estimation with B-spline and model selection and model estimation with the adaptive LASSO. We prove that such model selection and model estimation procedure possesses the oracle properties. Another important objective of this topic is forecasting time series with trend. We approach the forecasting problem by two methods: the empirical method by using the one-step ahead prediction in time series and the bagging method. Our simulation studies show that both methods are efficient with the decreased mean square error when the sample size increases. Simulation studies are adopted to illustrate the asymptotic result of our proposed method for model selection and model estimation with twelve ARMA(p, q) models, in which p an q are in the range from 1 to 15. The method is also illustrated by two time series data sets from the New York State Energy Research and Development Authority (NYSERDA), a public benefit corporation which offers data and analysis to help New Yorkers increase energy efficiency. Third, we propose a new model class, which is motivated by lag effects of covariates on the dependent variable. Our paper aims at providing more accurate statistical analysis for the relationship, for example, between the outcome of an event that occurs once every several years and the covariates that have observations every year. Lag effects have received a great deal of attention since Almon (1965) proposed linear distributed lag models to model the dependence of time series on several regressors from a correlated sequence. Motivated by the linear distributed lag model, we propose distributed generalized linear models as well as the estimation procedure for the model coefficients. The estimators from our proposed procedure are shown to be oracle or asymptotically efficient. Simulation studies confirm the asymptotic properties of the estimators and present consequences of model misspecification as well as better model prediction accuracy. The application is illustrated by analysis of the presidential election data in 2016. Fourth, we aim to provide an easy-to-use data analysis procedure for linear regression with non-independent errors. In practice, errors in regression model may be non-independent. In such situation, it is usually suitable to assume that the error terms for the model follow a time series structure. In fact, this type of model structure (reffered as RegARMA) has received great interests from researchers. Pierce (1971) discussed a nonlinear least squares estimation of RegARMA; Greenhouse et al. (1987) studied biological rhythm data by using the RegARMA model. Recently, Wu and Wang (2012) used the shrinkage estimation procedure to analyze data using RegARMA. However, in the literature the trend factor of the time series has not been considered. We will use the same idea of the two step-procedure as in the first project and the second project for our approach. We first estimate the trend of the time series by using a non-parametric method such as B-spline or linear Kernel. We then use the adaptive LASSO method for model selection and model estimation of the linear part and the time series error part. Simulation results show that our approach works quite well. However, it would be very interesting and challenging to improve the estimations and extend the estimation method to more complicated models, which will be the focus of the future research.

Handbook of Quantile Regression

Handbook of Quantile Regression
Title Handbook of Quantile Regression PDF eBook
Author Roger Koenker
Publisher CRC Press
Pages 463
Release 2017-10-12
Genre Mathematics
ISBN 1498725295

Download Handbook of Quantile Regression Book in PDF, Epub and Kindle

Quantile regression constitutes an ensemble of statistical techniques intended to estimate and draw inferences about conditional quantile functions. Median regression, as introduced in the 18th century by Boscovich and Laplace, is a special case. In contrast to conventional mean regression that minimizes sums of squared residuals, median regression minimizes sums of absolute residuals; quantile regression simply replaces symmetric absolute loss by asymmetric linear loss. Since its introduction in the 1970's by Koenker and Bassett, quantile regression has been gradually extended to a wide variety of data analytic settings including time series, survival analysis, and longitudinal data. By focusing attention on local slices of the conditional distribution of response variables it is capable of providing a more complete, more nuanced view of heterogeneous covariate effects. Applications of quantile regression can now be found throughout the sciences, including astrophysics, chemistry, ecology, economics, finance, genomics, medicine, and meteorology. Software for quantile regression is now widely available in all the major statistical computing environments. The objective of this volume is to provide a comprehensive review of recent developments of quantile regression methodology illustrating its applicability in a wide range of scientific settings. The intended audience of the volume is researchers and graduate students across a diverse set of disciplines.

Advances in Time Series Methods and Applications

Advances in Time Series Methods and Applications
Title Advances in Time Series Methods and Applications PDF eBook
Author Wai Keung Li
Publisher Springer
Pages 298
Release 2016-12-02
Genre Business & Economics
ISBN 1493965689

Download Advances in Time Series Methods and Applications Book in PDF, Epub and Kindle

This volume reviews and summarizes some of A. I. McLeod's significant contributions to time series analysis. It also contains original contributions to the field and to related areas by participants of the festschrift held in June 2014 and friends of Dr. McLeod. Covering a diverse range of state-of-the-art topics, this volume well balances applied and theoretical research across fourteen contributions by experts in the field. It will be of interest to researchers and practitioners in time series, econometricians, and graduate students in time series or econometrics, as well as environmental statisticians, data scientists, statisticians interested in graphical models, and researchers in quantitative risk management.

Almost All About Unit Roots

Almost All About Unit Roots
Title Almost All About Unit Roots PDF eBook
Author In Choi
Publisher Cambridge University Press
Pages 301
Release 2015-05-12
Genre Business & Economics
ISBN 1107097339

Download Almost All About Unit Roots Book in PDF, Epub and Kindle

Many economic theories depend on the presence or absence of a unit root for their validity, making familiarity with unit roots extremely important to econometric and statistical theory. This book introduces the literature on unit roots in a comprehensive manner to empirical and theoretical researchers in economics and other areas.

Least Absolute Deviation Estimation of Linear Econometric Models

Least Absolute Deviation Estimation of Linear Econometric Models
Title Least Absolute Deviation Estimation of Linear Econometric Models PDF eBook
Author Madhuchhanda Dasgupta
Publisher
Pages 0
Release 2004
Genre
ISBN

Download Least Absolute Deviation Estimation of Linear Econometric Models Book in PDF, Epub and Kindle

Econometricians generally take for granted that the error terms in the econometric models are generated by distributions having a finite variance. However, since the time of Pareto the existence of error distributions with infinite variance is known. Works of many econometricians, namely, Meyer & Glauber (1964), Fama (1965) and Mandlebroth (1967), on economic data series like prices in financial and commodity markets confirm that infinite variance distributions exist abundantly. The distribution of firms by size, behaviour of speculative prices and various other recent economic phenomena also display similar trends. Further, econometricians generally assume that the disturbance term, which is an influence of innumerably many factors not accounted for in the model, approaches normality according to the Central Limit Theorem. But Bartels (1977) is of the opinion that there are limit theorems, which are just likely to be relevant when considering the sum of number of components in a regression disturbance that leads to non-normal stable distribution characterized by infinite variance. Thus, the possibility of the error term following a non-normal distribution exists. The Least Squares method of estimation of parameters of linear (regression) models performs well provided that the residuals (disturbances or errors) are well behaved (preferably normally or near-normally distributed and not infested with large size outliers) and follow Gauss-Markov assumptions. However, models with the disturbances that are prominently non-normally distributed and contain sizeable outliers fail estimation by the Least Squares method. An intensive research has established that in such cases estimation by the Least Absolute Deviation (LAD) method performs well. This paper is an attempt to survey the literature on LAD estimation of single as well as multi-equation linear econometric models.

Probability, Finance And Insurance, Proceedings Of A Workshop

Probability, Finance And Insurance, Proceedings Of A Workshop
Title Probability, Finance And Insurance, Proceedings Of A Workshop PDF eBook
Author Siu Pang Yung
Publisher World Scientific
Pages 253
Release 2004-06-28
Genre Mathematics
ISBN 9814482617

Download Probability, Finance And Insurance, Proceedings Of A Workshop Book in PDF, Epub and Kindle

This workshop was the first of its kind in bringing together researchers in probability theory, stochastic processes, insurance and finance from mainland China, Taiwan, Hong Kong, Singapore, Australia and the United States. In particular, as China has joined the WTO, there is a growing demand for expertise in actuarial sciences and quantitative finance. The strong probability research and graduate education programs in many of China's universities can be enriched by their outreach in fields that are of growing importance to the country's expanding economy, and the workshop and its proceedings can be regarded as the first step in this direction.This book presents the most recent developments in probability, finance and actuarial sciences, especially in Chinese probability research. It focuses on the integration of probability theory with applications in finance and insurance. It also brings together academic researchers and those in industry and government. With contributions by leading authorities on probability theory — particularly limit theory and large derivations, valuation of credit derivatives, portfolio selection, dynamic protection and ruin theory — it is an essential source of ideas and information for graduate students and researchers in probability theory, mathematical finance and actuarial sciences, and thus every university should acquire a copy.The proceedings have been selected for coverage in:• Index to Scientific & Technical Proceedings (ISTP CDROM version / ISI Proceedings)• Index to Social Sciences & Humanities Proceedings® (ISSHP® / ISI Proceedings)• Index to Social Sciences & Humanities Proceedings (ISSHP CDROM version / ISI Proceedings)• CC Proceedings — Engineering & Physical Sciences