Using Maximum Likelihood (or Prediction Error) methods to identify linear state space model is a prime technique. The likelihood function is a nonconvex function and care must be exercised in the numerical maximization. Here the focus will be on affine parameterizations which allow some special techniques and algorithms. Three approaches to formulate and perform the maximization are described in this contribution: (1) The standard and well known Gauss-Newton iterative search, (2) a scheme based on the EM (expectation-maximization) technique, which becomes especially simple in the affine parameterization case, and (3) a new approach based on lifting the problem to a higher dimension in the parameter space and introducing rank constraints.@en

Gray-box identification is prevalent in modeling physical and networked systems. However, due to the non-convex nature of the gray-box identification problem, good initial parameter estimates are crucial for a successful application. In this paper, a new identification method is proposed by exploiting the low-rank and structured Hankel matrix of impulse response. This identification problem is recasted into a difference-of-convex programming problem, which is then solved by the sequential convex programming approach with the associated initialization obtained by nuclear-norm optimization. The presented method aims to achieve the maximum impulse-response fitting while not requiring additional (non-convex) conditions to secure non-singularity of the similarity transformation relating the given state-space matrices to the gray-box parameterized ones. This overcomes a persistent shortcoming in a number of recent contributions on this topic, and the new method can be applied for the structured state-space realization even if the involved system parameters are unidentifiable. The method can be used both for directly estimating the gray-box parameters and for providing initial parameter estimates for further iterative search in a conventional gray-box identification setup.@en

In this paper, a unified identification framework called constrained subspace method for structured state-space models (COSMOS) is presented, where the structure is defined by a user specified linear or polynomial parametrization. The new approach operates directly from the input and output data, which differs from the traditional two-step method that first obtains a state-space realization followed by the systemparameter estimation. The new identification framework relies on a subspace inspired linear regression problem which may not yield a consistent estimate in the presence of process noise. To alleviate this problem, the linear regression formulation is imposed by structured and low rank constraints in terms of a finite set of system Markov parameters and the user specified model parameters. The non-convex nature of the constrained optimization problem is dealt with by transforming the problem into a difference-of-convex optimization problem, which is then handled by the sequential convex programming strategy. Numerical simulation examples show that the proposed identification method is more robust than the classical prediction-error method (PEM) initialized by random initial values in converging to local minima, but at the cost of heavier computational burden.@en

Identification of structured state-space (gray-box) model is popular for modeling physical and network systems. Due to the non-convex nature of the gray-box identification problem, good initial parameter estimates are crucial for successful applications. In this paper, the non-convex gray-box identification problem is reformulated as a structured low-rank matrix factorization problem by exploiting the rank and structured properties of a block Hankel matrix constructed by the system impulse response. To address the low-rank optimization problem, it is first transformed into a difference-of-convex (DC) formulation and then solved using the sequentially convex relaxation method. Compared with the classical gray-box identification methods like the prediction-error method (PEM), the new approach turns out to be more robust against converging to non-global minima, as supported by a simulation study. The developed identification can either be directly used for gray-box identification or provide an initial parameter estimate for the PEM.@en

Performing multiple experiments is common when learning internal mechanisms of complex systems. These experiments can include perturbations of parameters or external disturbances. A challenging problem is to efficiently incorporate all collected data simultaneously to infer the underlying dynamic network. This paper addresses the reconstruction of dynamic networks from heterogeneous datasets under the assumption that the underlying networks share the same Boolean structure across all experiments. Parametric models are derived for dynamical structure functions, which describe causal interactions between measured variables. Multiple datasets are integrated into one regression problem with additional demands on group sparsity to assure network sparsity and structure consistency. To acquire structured group sparsity, we propose a sampling-based method, together with extended versions of l1-methods and sparse Bayesian learning. The performance of the proposed methods is benchmarked in numerical simulation. In summary, this paper presents efficient methods on network reconstruction from multiple experiments, and reveals practical experience that could guide applications.@en

Performing multiple experiments is common when learning internal mechanisms of complex systems. These experiments can include perturbations of parameters or external disturbances. A challenging problem is to efficiently incorporate all collected data simultaneously to infer the underlying dynamic network. This paper addresses the reconstruction of dynamic networks from heterogeneous datasets under the assumption that the underlying networks share the same Boolean structure across all experiments. Parametric models are derived for dynamical structure functions, which describe causal interactions between measured variables. Multiple datasets are integrated into one regression problem with additional demands on group sparsity to assure network sparsity and structure consistency. To acquire structured group sparsity, we propose a sampling-based method, together with extended versions of l1-methods and sparse Bayesian learning. The performance of the proposed methods is benchmarked in numerical simulation. In summary, this paper presents efficient methods on network reconstruction from multiple experiments, and reveals practical experience that could guide applications.@en

The continuous-time subspace identification using state-variable filtering has been investigated for a long time. Due to the simple orthogonal basis functions that were adopted by the existing methods, the identification performance is quite sensitive to the selection of the system-dynamic parameter associated with an orthogonal basis. To cope with this problem, a subspace identification method using generalized orthonormal (Takenaka-Malmquist) basis functions is developed, which has the potential to perform better than the existing state-variable filtering methods since the adopted Takenaka-Malmquist basis has more degree of freedom in selecting the system-dynamic parameters. As a price for the flexibility of the generalized orthonormal bases, the transformed state-space model is time-varying or parameter-varying which cannot be identified using traditional subspace identification methods. To this end, a new subspace identification algorithm is developed by exploiting the structural properties of the time-variant system matrices, which is then validated by numerical simulations.@en