GPSO-ICA: Independent Component Analysis based on Gravitational Particle Swarm Optimization for blind source separation

Abstract

Blind source separation (BSS) is an advanced method of signal processing. Essentially, the problem in BSS is to separate and estimate the original signal from the observed mixed signal source without knowing the characteristics of the original signal. Independent component analysis (ICA) is a popular approach for blind source separation, and because its traditional search scheme is based on a gradient algorithm, a convergence problem will arise. In order to overcome the defect, this paper proposed to apply Particle Swarm Optimization (PSO) and Gravitational Search Algorithm (GSA) to conduct accelerated computing of the rate of convergence of a demixing matrix in ICA. However, the PSO converges prematurely, and the population diversity is reduced rapidly, so that the optimal solution falls into the local optimum. In order to increase the diversity of PSO, GPSO-based ICA algorithm (GPSO-ICA) is proposed that has the exploring ability of GSA, so that the ICA algorithm has a higher convergence rate and better ability to escape local optimization. A series of comparisons is implemented for the ICA algorithms based on PSO, GSA, and GPSO. The results show that GPSO-ICA has better performance than the other methods.

Keywords

Blind source separation Independent Component Analysis Particle Swarm Optimization Gravitation Searching Algorithm

Get full access to this article

View all access options for this article.

References

Lee

T.W.

, Independent Component Analysis-Theory and Application, Norwell, MA: Kuwer, 1998.

Comon

, Independent component analysis, A new concept?, Signal Processing 36 (1994), 287–314.

Kiviluoto

and Oja

, Independent Component Analysis for Parallel Financial Time Series, In Proceedings of the International Conference on Neural information Processing (ICONIP ’98), vol. 2, (1998), pp. 895–898.

Chien

J.T.

and Chen

B.C.

, A new independent component analysis for speech recognition and separation, IEEE Trans, Audio, Speech Lang Process 14(4) (2006), 1245–1254.

Hyvarinen

, Survey on independent component analysis, Neural Comp Surveys 2 (1999), 94–128.

Makeig

, Bell

, Jung

and Sejnowski

, Independent Component Analysis of Electroencephalographic, Advances in Neural Information Processing System Cambridge: MA, MIT Press vol. 8, (1996) pp. 145–151.

Hyvarinen

, Fast and robust fixed-point algorithms for independent component analysis, IEEE Transactions on Neural Networks 10(3) (1999), 626–634.

Hild

, Erdogmus

and Principe

, Blind source separation using renyi’s mutual information, IEEE Signal Processing Letters 8(6) (2001), 174–176.

Bell

M.A.J.

and Sejnowski

T.J.

, An information maximization approach to blind separation and blind deconvolution, Neural Computation 7 (1995), 1129–1159.

10.

Lee

S.H.

and Yang

C.S.

, PSO ICA with BRM for Image Enhancement, Computer, Consumer and Control (IS3C), 2016 International Symposium on, 2016.

11.

Hsieh

S.T.

, Sun

T.Y.

, Lin

C.L.

and Liu

C.C.

, Effective learning rate adjustment of blind source separation based on an improved particle swarm optimizer, Evolutionary Computation, IEEE Transactions on 12 (2008), 242–151.

12.

Kennedy

and Eberhart

, Particle swarm optimization. In IEEE International Conferenceon Neural Networks, volume 4 1995. pp. 1942–1948.

13.

Chen

W.-N.

, Zhang

, Chung

H.S.-H.

, Zhong

W.-L.

, Gang Wu

, and Shi

Y.H.

, A novel set-based particle swarm optimization method for discrete optimization problems, Evolutionary Computation, IEEE Transactions on 14(2) (2010), 278–300.

14.

Liu

, Wang

and Jin

Y.-H.

, Aneffective pso-based memetic algorithm for flow shop scheduling, Systems, Man, and Cybernetics, Part B: Cybernetics, IEEE Transactions on 37 (2007), 18–27.

15.

Unler

and Murat

, A discrete particle swarm optimization method for feature selection in binary classification problems, European Journal of Operational Research 206(3) (2010), 528–539.

16.

Huang

C.-L.

, Huang

W.-C.

, Chang

H.-Y.

, Yeh

Y.-C.

and Tsai

T.C.-Y.

, Hybridization strategies for continuous ant colony optimization and particle swarm optimization applied to data clustering, Applied Soft Computing 13(9) (2013), 3864–3872.

17.

Gao

and Xie

, A blind source separation algorithm using particle swarm optimization. In Proceedings of the Circuits and Systems Symposium on Emerging Technologies: Frontiers of Mobile and Wireless Communication, 1, 2004. pp. 297–300.

18.

Poli

, Kennedy

and Blackwell

, Particle swarm optimization: An overview, Swarm Intelligence 1(1) (2007), 33–57.

19.

Nickabadi

, Ebadzadeh

M.M.

and Safabakhsh

, DNPSO: A Dynamic Niching Particle Swarm Optimizer for Multi-modal Optimization, In pp, Proceedings of IEEE Congress on Evolutionary Computation (2008), 26–32.

20.

Liang

J.J.

, Qin

A.K.

, Suganthan

P.N.

and Baskar

, Comprehensive learning particle swarm optimizer for global optimization of multimodal functions, Evolutionary Computation, IEEE Transactions on 10(3) (2006), 281–295.

21.

Zhan

Z.-H.

, Zhang

, Li

and Hui

S.Y.

, Orthogonal learning particle swarm optimization, IEEE Transactions on Evolutionary Computation 15(6) (2011), 832–847.

22.

Wang

, Sun

, Li

, Rahnamayan

and Pan

J.S.

, Diversity enhanced particle swarm optimization with neighborhood search, Information Sciences 223(0) (2013), 119–135.

23.

Rashedi

, Nezamabadi-Pour

and Saryazdi

, GSA: A gravitational search algorithm, Information Sciences 179(13) (2009), 2232–2248.

24.

Mirjalili

and Hashim

S.Z.M.

, A New Hybrid PSOGSA Algorithm for Function Optimization, International Conference on Computer and Information Application 2010.

25.

Huang

K.-W.

, Chen

J.-L.

, Yang

C.-S.

and Tsai

C.-W.

, PSGO: Particle swarm gravitation optimization algorithm, Journal of Intelligent and Fuzzy Systems 28(6) (2015), 2655–2665.

26.

Talbi

E.G.

, A taxonomy of hybrid metaheuristic, Journal of Heuristics 8(5) (2002), 541–546.

27.

Hyvarinen

and Oja

, Independent component analysis: Algorithms and applications, Neural Netw 13 (2000), 411–430.

28.

Smith

, Lukasiak

and Burnett

I.S.

, An analysis of the limitations of blind signal separation application with speech, Signal Processing 86 (2006), 353–359.

29.

Nian

, Li

, Sun

and Li

, An Improved Particle Swarm Optimization Application to Independent Component Analysis, Information Engineering and Computer Science, 2009 ICIECS 2009 International Conference on 2009.