In this paper, by using a forcing function and the reverse modulus of continuity of gradient, we propose a generalization and development of the nonmonotone line search method for unconstrained optimization problems. The global convergence property of the new method is established under some reasonable conditions that are weaker than those of the existing nonmonotone line search methods. Furthermore, the proof of convergence is simpler than other methods.
ArmijoL (1966) Minimization of function having Lipschitz continuous first partial derivatives. Pacific Journal of Mathematics16: 1–3.
2.
DaiYH (2002) On the nonmonotone line search. Journal of Optimization Theory and Applications112: 315–330.
3.
GoldsteinAA (1965) On steepest descent. SIAM Journal on Control3: 147–151.
4.
GrippoLLamparielloFLucidiS (1986) A nonmonoton line search technique for Newton's method. SIAM Journal on Numerical Analysis23: 707–716.
5.
HanJLiuL (1995) General form of stepsize selection rules of line search and relevant analysis of global convergence of BFGS algorithm. Acta Mathematicae Applicatae Sinica—English Series18: 112–122.
6.
NocedalJWrightSJ (1999) Numerical Optimization, New York: Springer.
7.
SangZYSunQY (2009) A self-adaptive trust region method with line search based on a simple subproblem model. Journal of Computational and Applied Mathematics232: 514–522.
8.
ShiZJShenJ (2006) Convergence of nonmonotone line search method. Journal of Computational and Applied Mathematics193: 397–412.
9.
SunWYHanJYSunJ (2002) Global convergence of non-monotone descent methods for unconstrained optimization problems. Journal of Computational and Applied Mathematics146: 89–98.
10.
TointPL (1996) An assessment of nonmonoton line search technique for unconstrained optimization. SIAM Journal on Scientific Computing17: 725–739.
11.
WolfeP (1969) Convergence conditions for ascent methods. SIAM Review11: 226–235.
12.
YuZSPuDG (2008) A new nonmonotone line search technique for unconstrained optimization. Journal of Computational and Applied Mathematics219: 134–144.
13.
YuanYXSunWY (1997) Optimization Theory and Methods, Beijing: Science Press;[#,'?']?>. (in Chinese).
14.
ZhangHCHagerWW (2004) A nonmonotone line search technique and its application to unconstrained optimization. SIAM Journal on Optimization14: 1043–1056.
