Application of the infinitely many times repeated BNS update and conjugate directions to limited-memory optimization methods
Loading...
Date
2019
Authors
Journal Title
Journal ISSN
Volume Title
Publisher
ACAD SCIENCES CZECH REPUBLIC, INST MATHEMATICS, ZITNA 25, PRAHA 1, CZ-115 67, CZECH REPUBLIC
Abstract
To improve the performance of the L-BFGS method for large scale unconstrained optimization, repeating of some BFGS updates was proposed e.g. in [1]. Since this can be time consuming, the extra updates need to be selected carefully. We show that groups of these updates can be repeated infinitely many times under some conditions, without a noticeable increase of the computational time; the limit update is a block BFGS update [17]. It can be obtained by solving of some Lyapunov matrix equation whose order can be decreased by application of vector corrections for conjugacy [16]. Global convergence of the proposed algorithm is established for convex and sufficiently smooth functions. Numerical results indicate the efficiency of the new method.
Description
Subject(s)
numerical results, global convergence, the conjugate directions, the Lyapunov matrix equation, the repeated Byrd-Nocedal-Schnabel update, limited-memory variable metric methods, Unconstrained minimization