Sparse Estimation of Polynomial and Rational Dynamical Models

In many practical situations, it is highly desirable to estimate an accurate mathematical model of a real system using as few parameters as possible. At the same time, the need for an accurate description of the system behavior without knowing its complete dynamical structure often leads to model pa...

Full description

Saved in:
Bibliographic Details
Published in:IEEE transactions on automatic control Vol. 59; no. 11; pp. 2962 - 2977
Main Authors: Rojas, Cristian R., Toth, Roland, Hjalmarsson, Hakan
Format: Journal Article
Language:English
Published: New York IEEE 01.11.2014
The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subjects:
AIC
BIC
Biological system modeling
Cost function
cross-validation
Data models
Dynamical systems
Dynamics
Economic models
Estimates
Estimation
LASSO
Linear regression
Mathematical models
model structure selection
Noise
Norms
Parametrization
Polynomials
Regularization
Simulation
sparse estimation
Sparsity
Steiglitz-McBride method
system identification
sparse estimation
Steiglitz-McBride method
model structure selection
LASSO
cross-validation
AIC
system identification
BIC
ISSN:0018-9286, 1558-2523, 1558-2523
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:In many practical situations, it is highly desirable to estimate an accurate mathematical model of a real system using as few parameters as possible. At the same time, the need for an accurate description of the system behavior without knowing its complete dynamical structure often leads to model parameterizations describing a rich set of possible hypotheses; an unavoidable choice, which suggests sparsity of the desired parameter estimate. An elegant way to impose this expectation of sparsity is to estimate the parameters by penalizing the criterion with the ℓ 0 "norm" of the parameters. Due to the non-convex nature of the ℓ 0 -norm, this penalization is often implemented as solving an optimization program based on a convex relaxation (e.g., ℓ 1 /LASSO, nuclear norm, . . .). Two difficulties arise when trying to apply these methods: (1) the need to use cross-validation or some related technique for choosing the values of regularization parameters associated with the ℓ 1 penalty; and (2) the requirement that the (unpenalized) cost function must be convex. To address the first issue, we propose a new technique for sparse linear regression called SPARSEVA, with close ties with the LASSO (least absolute shrinkage and selection operator), which provides an automatic tuning of the amount of regularization. The second difficulty, which imposes a severe constraint on the types of model structures or estimation methods on which the ℓ 1 relaxation can be applied, is addressed by combining SPARSEVA and the Steiglitz-McBride method. To demonstrate the advantages of the proposed approach, a solid theoretical analysis and an extensive simulation study are provided.
Bibliography:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
content type line 23
ISSN:0018-9286
1558-2523
1558-2523
DOI:10.1109/TAC.2014.2351711