A Scaled Conjugate Gradient Method Based on New BFGS Secant Equation with Modified Nonmonotone Line Search

• 作者: Haibin Zhang Tsegay Giday Woldu Yemane Hailu Fissuh
• 来源期刊: 美国计算数学期刊(英文)
• 学科: 数学
• 关键词: Conjugate Gradient METHOD BFGS METHOD MODIFIED SECANT EQUATION NONMONOTONE Line Search Nonsmooth Optimization
• 年，卷（期）: 2020,（1）
• 页码范围: 1-22
• 页数: 22页
• 分类号: O22

摘要

In this paper, we provide and analyze a new scaled conjugate gradient method and its performance, based on the modified secant equation of the Broyden-Fletcher-Goldfarb-Shanno (BFGS) method and on a new modified nonmonotone line search technique. The method incorporates the modified BFGS secant equation in an effort to include the second order information of the objective function. The new secant equation has both gradient and function value information, and its update formula inherits the positive definiteness of Hessian approximation for general convex function. In order to improve the likelihood of finding a global optimal solution, we introduce a new modified nonmonotone line search technique. It is shown that, for nonsmooth convex problems, the proposed algorithm is globally convergent. Numerical results show that this new scaled conjugate gradient algorithm is promising and efficient for solving not only convex but also some large scale nonsmooth nonconvex problems in the sense of the Dolan-Moré performance profiles.