Regression Models for Time Series Analysis

A comprehensive and timely edition on an emerging new trend in time series Linear Models and Time-Series Analysis: Regression, ANOVA, ARMA and GARCH sets a strong foundation, in terms of distribution theory, for the linear model (regression and ANOVA), univariate time series analysis (ARMAX and GARCH), and some multivariate models associated primarily with modeling financial asset returns (copula-based structures and the discrete mixed normal and Laplace). It builds on the author's previous book, Fundamental Statistical Inference: A Computational Approach, which introduced the major concepts of statistical inference. Attention is explicitly paid to application and numeric computation, with examples of Matlab code throughout. The code offers a framework for discussion and illustration of numerics, and shows the mapping from theory to computation. The topic of time series analysis is on firm footing, with numerous textbooks and research journals dedicated to it. With respect to the subject/technology, many chapters in Linear Models and Time-Series Analysis cover firmly entrenched topics (regression and ARMA). Several others are dedicated to very modern methods, as used in empirical finance, asset pricing, risk management, and portfolio optimization, in order to address the severe change in performance of many pension funds, and changes in how fund managers work. Covers traditional time series analysis with new guidelines Provides access to cutting edge topics that are at the forefront of financial econometrics and industry Includes latest developments and topics such as financial returns data, notably also in a multivariate context Written by a leading expert in time series analysis Extensively classroom tested Includes a tutorial on SAS Supplemented with a companion website containing numerous Matlab programs Solutions to most exercises are provided in the book Linear Models and Time-Series Analysis: Regression, ANOVA, ARMA and GARCH is suitable for advanced masters students in statistics and quantitative finance, as well as doctoral students in economics and finance. It is also useful for quantitative financial practitioners in large financial institutions and smaller finance outlets.

This book aims to promote regression methods for analyzing lifetime (or time-to-event) data that are based on a representation of the underlying process, and are therefore likely to offer greater scientific insight compared to purely empirical methods. In contrast to the rich statistical literature, the regression methods actually employed in lifetime data analysis are limited, particularly in the biomedical field where D. R. Cox’s famous semi-parametric proportional hazards model predominates. Practitioners should become familiar with more flexible models. The first hitting time regression models (or threshold regression) presented here represent observed events as the outcome of an underlying stochastic process. One example is death occurring when the patient’s health status falls to zero, but the idea has wide applicability – in biology, engineering, banking and finance, and elsewhere. The central topic is the model based on an underlying Wiener process, leading to lifetimes following the inverse Gaussian distribution. Introducing time-varying covariates and many other extensions are considered. Various applications are presented in detail.

Praise for the Fourth Edition “The book follows faithfully the style of the original edition. The approach is heavily motivated by real-world time series, and by developing a complete approach to model building, estimation, forecasting and control." – Mathematical Reviews Bridging classical models and modern topics, the Fifth Edition of Time Series Analysis: Forecasting and Control maintains a balanced presentation of the tools for modeling and analyzing time series. Also describing the latest developments that have occurred in the field over the past decade through applications from areas such as business, finance, and engineering, the Fifth Edition continues to serve as one of the most influential and prominent works on the subject. Time Series Analysis: Forecasting and Control, Fifth Edition provides a clearly written exploration of the key methods for building, classifying, testing, and analyzing stochastic models for time series and describes their use in five important areas of application: forecasting; determining the transfer function of a system; modeling the effects of intervention events; developing multivariate dynamic models; and designing simple control schemes. Along with these classical uses, the new edition covers modern topics with new features that include: A redesigned chapter on multivariate time series analysis with an expanded treatment of Vector Autoregressive, or VAR models, along with a discussion of the analytical tools needed for modeling vector time series An expanded chapter on special topics covering unit root testing, time-varying volatility models such as ARCH and GARCH, nonlinear time series models, and long memory models Numerous examples drawn from finance, economics, engineering, and other related fields The use of the publicly available R software for graphical illustrations and numerical calculations along with scripts that demonstrate the use of R for model building and forecasting Updates to literature references throughout and new end-of-chapter exercises Streamlined chapter introductions and revisions that update and enhance the exposition Time Series Analysis: Forecasting and Control, Fifth Edition is a valuable real-world reference for researchers and practitioners in time series analysis, econometrics, finance, and related fields. The book is also an excellent textbook for beginning graduate-level courses in advanced statistics, mathematics, economics, finance, engineering, and physics.

A modern and accessible guide to the analysis of introductory time series data Featuring an organized and self-contained guide, Time Series Analysis provides a broad introduction to the most fundamental methodologies and techniques of time series analysis. The book focuses on the treatment of univariate time series by illustrating a number of well-known models such as ARMA and ARIMA. Providing contemporary coverage, the book features several useful and newlydeveloped techniques such as weak and strong dependence, Bayesian methods, non-Gaussian data, local stationarity, missing values and outliers, and threshold models. Time Series Analysis includes practical applications of time series methods throughout, as well as: Real-world examples and exercise sets that allow readers to practice the presented methods and techniques Numerous detailed analyses of computational aspects related to the implementation of methodologies including algorithm efficiency, arithmetic complexity, and process time End-of-chapter proposed problems and bibliographical notes to deepen readers’ knowledge of the presented material Appendices that contain details on fundamental concepts and select solutions of the problems implemented throughout A companion website with additional data fi les and computer codes Time Series Analysis is an excellent textbook for undergraduate and beginning graduate-level courses in time series as well as a supplement for students in advanced statistics, mathematics, economics, finance, engineering, and physics. The book is also a useful reference for researchers and practitioners in time series analysis, econometrics, and finance. Wilfredo Palma, PhD, is Professor of Statistics in the Department of Statistics at Pontificia Universidad Cat?lica de Chile. He has published several refereed articles and has received over a dozen academic honors and awards. His research interests include time series analysis, prediction theory, state space systems, linear models, and econometrics. He is the author of Long-Memory Time Series: Theory and Methods, also published by Wiley.

Simplifies the treatment of statistical inference focusing on how to specify and interpret models in the context of testing causal theories. Simple bivariate regression, multiple regression, multiple classification analysis, path analysis, logit regression, multinomial logit regression and survival models are among the subjects covered. Features an appendix of computer programs (for major statistical packages) that are used to generate illustrative examples contained in the chapters.

An outstanding introduction to the fundamentals of regression analysis-updated and expanded The methods of regression analysis are the most widely used statistical tools for discovering the relationships among variables. This classic text, with its emphasis on clear, thorough presentation of concepts and applications, offers a complete, easily accessible introduction to the fundamentals of regression analysis. Assuming only a basic knowledge of elementary statistics, Applied Regression Analysis, Third Edition focuses on the fitting and checking of both linear and nonlinear regression models, using small and large data sets, with pocket calculators or computers. This Third Edition features separate chapters on multicollinearity, generalized linear models, mixture ingredients, geometry of regression, robust regression, and resampling procedures. Extensive support materials include sets of carefully designed exercises with full or partial solutions and a series of true/false questions with answers. All data sets used in both the text and the exercises can be found on the companion disk at the back of the book. For analysts, researchers, and students in university, industrial, and government courses on regression, this text is an excellent introduction to the subject and an efficient means of learning how to use a valuable analytical tool. It will also prove an invaluable reference resource for applied scientists and statisticians.

Reflects the developments and new directions in the field since the publication of the first successful edition and contains a complete set of problems and solutions This revised and expanded edition reflects the developments and new directions in the field since the publication of the first edition. In particular, sections on nonstationary panel data analysis and a discussion on the distinction between deterministic and stochastic trends have been added. Three new chapters on long-memory discrete-time and continuous-time processes have also been created, whereas some chapters have been merged and some sections deleted. The first eleven chapters of the first edition have been compressed into ten chapters, with a chapter on nonstationary panel added and located under Part I: Analysis of Non-fractional Time Series. Chapters 12 to 14 have been newly written under Part II: Analysis of Fractional Time Series. Chapter 12 discusses the basic theory of long-memory processes by introducing ARFIMA models and the fractional Brownian motion (fBm). Chapter 13 is concerned with the computation of distributions of quadratic functionals of the fBm and its ratio. Next, Chapter 14 introduces the fractional Ornstein–Uhlenbeck process, on which the statistical inference is discussed. Finally, Chapter 15 gives a complete set of solutions to problems posed at the end of most sections. This new edition features: • Sections to discuss nonstationary panel data analysis, the problem of differentiating between deterministic and stochastic trends, and nonstationary processes of local deviations from a unit root • Consideration of the maximum likelihood estimator of the drift parameter, as well as asymptotics as the sampling span increases • Discussions on not only nonstationary but also noninvertible time series from a theoretical viewpoint • New topics such as the computation of limiting local powers of panel unit root tests, the derivation of the fractional unit root distribution, and unit root tests under the fBm error Time Series Analysis: Nonstationary and Noninvertible Distribution Theory, Second Edition, is a reference for graduate students in econometrics or time series analysis. Katsuto Tanaka, PhD, is a professor in the Faculty of Economics at Gakushuin University and was previously a professor at Hitotsubashi University. He is a recipient of the Tjalling C. Koopmans Econometric Theory Prize (1996), the Japan Statistical Society Prize (1998), and the Econometric Theory Award (1999). Aside from the first edition of Time Series Analysis (Wiley, 1996), Dr. Tanaka had published five econometrics and statistics books in Japanese.

Incorporates mixed-effects modeling techniques for more powerful and efficient methods This book presents current and effective nonparametric regression techniques for longitudinal data analysis and systematically investigates the incorporation of mixed-effects modeling techniques into various nonparametric regression models. The authors emphasize modeling ideas and inference methodologies, although some theoretical results for the justification of the proposed methods are presented. With its logical structure and organization, beginning with basic principles, the text develops the foundation needed to master advanced principles and applications. Following a brief overview, data examples from biomedical research studies are presented and point to the need for nonparametric regression analysis approaches. Next, the authors review mixed-effects models and nonparametric regression models, which are the two key building blocks of the proposed modeling techniques. The core section of the book consists of four chapters dedicated to the major nonparametric regression methods: local polynomial, regression spline, smoothing spline, and penalized spline. The next two chapters extend these modeling techniques to semiparametric and time varying coefficient models for longitudinal data analysis. The final chapter examines discrete longitudinal data modeling and analysis. Each chapter concludes with a summary that highlights key points and also provides bibliographic notes that point to additional sources for further study. Examples of data analysis from biomedical research are used to illustrate the methodologies contained throughout the book. Technical proofs are presented in separate appendices. With its focus on solving problems, this is an excellent textbook for upper-level undergraduate and graduate courses in longitudinal data analysis. It is also recommended as a reference for biostatisticians and other theoretical and applied research statisticians with an interest in longitudinal data analysis. Not only do readers gain an understanding of the principles of various nonparametric regression methods, but they also gain a practical understanding of how to use the methods to tackle real-world problems.

Concise, mathematically clear, and comprehensive treatment of the subject. * Expanded coverage of diagnostics and methods of model fitting. * Requires no specialized knowledge beyond a good grasp of matrix algebra and some acquaintance with straight-line regression and simple analysis of variance models. * More than 200 problems throughout the book plus outline solutions for the exercises. * This revision has been extensively class-tested.

A comprehensive resource that draws a balance between theory and applications of nonlinear time series analysis Nonlinear Time Series Analysis offers an important guide to both parametric and nonparametric methods, nonlinear state-space models, and Bayesian as well as classical approaches to nonlinear time series analysis. The authors—noted experts in the field—explore the advantages and limitations of the nonlinear models and methods and review the improvements upon linear time series models. The need for this book is based on the recent developments in nonlinear time series analysis, statistical learning, dynamic systems and advanced computational methods. Parametric and nonparametric methods and nonlinear and non-Gaussian state space models provide a much wider range of tools for time series analysis. In addition, advances in computing and data collection have made available large data sets and high-frequency data. These new data make it not only feasible, but also necessary to take into consideration the nonlinearity embedded in most real-world time series. This vital guide: • Offers research developed by leading scholars of time series analysis • Presents R commands making it possible to reproduce all the analyses included in the text • Contains real-world examples throughout the book • Recommends exercises to test understanding of material presented • Includes an instructor solutions manual and companion website Written for students, researchers, and practitioners who are interested in exploring nonlinearity in time series, Nonlinear Time Series Analysis offers a comprehensive text that explores the advantages and limitations of the nonlinear models and methods and demonstrates the improvements upon linear time series models.