As a method of estimating the parameters of statistical models in statistics, maximum likelihood (ML) method has gained much attention and been popularly applied to a variety of fields. In the subjects of information, control, as well as system science and engineering, it is usually exploited to estimate the parameters of diverse linear dynamic systems. The tough task of estimating ML parameters of diverse linear dynamic systems can be attributed to a constrained optimization problem. In an effort to solve the constrained optimization problem effectively, we first use the ML method to address the statistical modelling of ML parameter estimation of general linear dynamic systems. Then we present a novel heuristic particle swarm search algorithm called sliding mode controlling particle swarm optimization (SMCPSO) algorithm. In SMCPSO, we introduce a sliding mode controller (SMC) into standard particle swarm optimization (SPSO). The SMC is intentionally placed between the particle position and the global best particle position so as to improve the particles' position information. It ameliorates the exploration and exploitation search abilities of the particles. Thereafter, SMCPSO is exploited to solve the problem of the ML parameter estimation of a given linear dynamic system together with SPSO, recursive ML generalized least squares (RMLGLS) method, and recursive ML least squares (RMLLS) algorithm. The simulation results demonstrate that SMCPSO is an effective approach and superior to other three approaches in estimating the ML parameters of the linear dynamic system.
HaryantoA. and HongK.-S., Maximum likelihood identification of Wiener-Hammerstein models, Mechanical Systems and Signal Processing41(1-2) (2013), 54-70.
2.
PenceB.L., FathyH.K. and SteinJ.L., Recursive maximum likelihood parameter estimation for state space systems using polynomial chaos theory, Automatica47(11) (2011), 2420-2424.
3.
QuB.Y., SuganthanP.N. and DasS., A distance-based locally informed particle swarm model for multimodal optimization, IEEE Transactions on Evolutionary Computation17(3) (2013), 387-402.
4.
EdwardsC. and SpurgeonS., Sliding Mode Control: Theory and Applications, Taylor and Francis, London, UK, 1998.
5.
HuC. and LiuQ., Online identification for hypersonic vehicle using recursive maximum likelihood method based on interior-point algorithm, in: 25th Chinese Control and Decision Conference, IEEE, (2013), 1862-1867.
6.
WenC.-C. and ChenY.-H., Nonparametric maximum likelihood analysis of clustered current status data with the gamma-frailty cox model, Computational Statistics and Data Analysis55(2) (2011), 1053-1060.
7.
AnÇ., AksoyS. and AnkanO., Maximum likelihood estimation of Gaussian mixture models using stochastic search, Pattern Recognition45(7) (2012), 2804-2816.
8.
WangD.Q., ChuY.Y., YangG.W. and DingF., Auxiliary model-based recursive generalized least squares parameter estimation for Hammerstein OEAR systems, Mathematical and Computer Modelling52(1-2) (2010), 309-317.
9.
StathakisE., JaldenJ., RasmussenL.K. and SkoglundM., Uniformly improving maximum-likelihood SNR estimation of known signals in Gaussian channels, IEEE Transactions on Signal Processing62(1) (2014), 156-167.
10.
NeriF., MininnoE. and IaccaG., Compact particle swarm optimization, Information Sciences239 (2013), 96-121.
11.
BaghishaniH. and MohammadzadehM., A data cloning algorithm for computing maximum likelihood estimates in spatial generalized linear mixed models, Computational Statistics and Data Analysis55(4) (2011) 1748-1759.
12.
ChangJ.-C. and ChenC.-Y., Maximum likelihood DOA estimation with sensor position perturbation using particle swarm optimization, Advances in Intelligent Systems and Applications: Smart Innovation, Systems and Technologies, Springer-Verlag, Berlin, Heidelberg 20(1) (2013), 187-197.
13.
LiJ. and DingF., Maximum likelihood stochastic gradient estimation for Hammerstein systems with colored noise based on the key term separation technique, Computers and Mathematics with Applications62(11) (2011), 4170-4177.
14.
LiJ., DingF. and YangG., Maximum likelihood least squares identification method for input nonlinear finite impulse response moving average systems, Mathematical and Computer Modelling55(3-4) (2012), 442-450.
15.
PanJ., MaW.-K. and JaldenJ., MIMO detection by Lagrangian dual maximum-likelihood relaxation: reinterpreting regularized lattice decoding, IEEE Transactions on Signal Processing62(2) (2014), 511-524.
16.
ZhangJ., ChenS., LevyD. and LuY., Feedback loop mechanisms based particle swarm optimization with neighborhood topology, in: IEEE Congress on Evolutionary Computation, IEEE, (2011), 1864-1871.
17.
YaoK., YuD., DengL. and GongY., A fast maximum likelihood nonlinear feature transformation method for GMM-HMM speaker adaptation, Neurocomputing128 (2014), 145-152.
18.
DosiekL., PierreJ.W. and FollumJ., A recursive maximum likelihood estimator for the online estimation of electromechanical modes with error bounds, IEEE Transactions on Power Systems28(1) (2013), 441-451.
19.
CoelhoL.D.S., Gaussian quantum-behaved particle swarm optimization approaches for constrained engineering design problems, Expert Systems with Applications37(2) (2010), 1676-1683.
20.
VitorinoL.N., RibeiroS.F. and Bastos-FilhoC.J.A., A mechanism based on artificial bee colony to generate diversity in particle swarm optimization, Neurocomputing148 (2015), 39-45.
21.
AugustyniakM., Maximum likelihood estimation of the Markov-switching GARCH model, Computational Statistics and Data Analysis76(2) (2014), 61-75.
22.
HuM., WuT. and WeirJ.D., An adaptive particle swarm optimization with multiple adaptive methods, IEEE Transactions on Evolutionary Computation17(5) (2013), 705-720.
23.
ChenM.-R., LiX., ZhangX. and LuY.-Z, A novel particle swarm optimizer hybridized with extremal optimization, Applied Soft Computing10(2) (2010), 367-373.
24.
DasM.T. and DulgerL.C., Signature verification (SV) toolbox: Application of PSO-NN, Engineering Applications of Artificial Intelligence9(1) (2009), 308-320.
25.
AcharjeeP. and GoswamiS.K., Chaotic particle swarm optimization based robust load flow, Internationl Journal Electric Power and Energy Systems32(2) (2010), 141-146.
26.
DuttaP., ArnaudE., PradosE. and SaujotM., Calibration of an integrated land-use and transportation model using maximum-likelihood estimation, IEEE Transactions on Computers63(1) (2014), 167-178.
27.
StoicaP. and BabuP., Maximum-likelihood nonparametric estimation of smooth spectra from irregularly sampled data, IEEE Transactions on Signal Processing59(12) (2011), 5746-5758.
28.
SahuP.K., ShahT., MannaK. and ChattopadhyayS., Application mapping onto mesh-based network-on-chip using discrete particle swarm optimization, IEEE Transactions on Very Large Scale Integration Systems22(2) (2014), 300-312.
29.
ChengR. and JinY., A competitive swarm optimizer for large scale optimization, IEEE Transactions on Cybernetics45(2) (2015), 191-204.
30.
PoliR., KennedyJ. and BlackwellT., Particle swarm optimization: an overview, Swarm Intelligence1(1) (2007), 33-57.
31.
HiraiS. and YamanishiK., Efficient computation of normalized maximum likelihood codes for Gaussian mixture models with its applications to clustering, IEEE Transactions on Information Theory59(11) (2013), 7718-7727.
32.
KunduS., JhaA., ChattopadhyayS., SenguptaI. and KapurR., Framework for multiple-fault diagnosis based on multiple fault simulation using particle swarm optimization, IEEE Transactions on Very Large Scale Integration Systems22(3) (2014), 696-700.
33.
DenoeuxT., Maximum likelihood estimation from fuzzy data using the EM algorithm, Fuzzy Sets and Systems183(1) (2011), 72-91.
34.
HuW. and YenG.G., Adaptive multiobjective particle swarm optimization based on parallel cell coordinate system, IEEE Transactions on Evolutionary Computation19(1) (2015), 1-18.
35.
ChenW.-N., ZhangJ., LinY., ChenN., ZhanZ.-H., ChungH.S.-H., LiY. and ShiY.-H., Particle swarm optimization with an aging leader and challengers, IEEE Transactions on Evolutionary Computation17(2) (2013), 241-258.
36.
DuX., ChengL. and LiuL., A swarm intelligence algorithm for joint sparse recovery, IEEE Signal Processing Letters20(6) (2013), 611-614.
37.
LuY., LevyD., ZhangJ. and LiD., An evolutionary performance enhanced PSO approach by using a BP neural-learning-based PID controller, Connection Science23(1) (2011), 45-63.
38.
LuY., YanD., ZhangJ. and LevyD., Direct back propagation neural dynamic programming-based particle swarm optimisation, Connection Science26(4) (2014), 367-388.
39.
PehlivanogluY.V., A new particle swarm optimization method enhanced with a periodic mutation strategy and neural networks, IEEE Transactions on Evolutionary Computation17(3) (2013), 436-452.
40.
LiuZ.-H., ZhangJ., ZhouS.-W., LiX.-H. and LiuK., Coevolutionary particle swarm optimization using AIS and its application in multiparameter estimation of PMSM, IEEE Transactions on Cybernetics43(6) (2013), 1921-1935.
41.
ZhanZ.H., ZhangJ., LiY. and ChungH.S.H., Adaptive particle swarm optimization, IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics39(6) (2009), 1362-1381.
42.
LiuZ.-M., HuangZ.-T. and ZhouY.-Y., An efficient maximum likelihood method for direction-of-arrival estimation via sparse Bayesian learning, IEEE Transactions on Wireless Communications11(10) (2012), 1-11.
43.
RenZ., ZhangA., WenC. and FengZ., A scatter learning particle swarm optimization algorithm for multimodal problems, IEEE Transactions on Cybernetics44(7) (2014), 1127-1140.
44.
WangZ., LuoJ.-A. and ZhangX.-P., A novel location-penalized maximum likelihood estimator for bearing-only target localization, IEEE Transactions on Signal Processing60(12) (2012), 6166-6181.
