An improved nonlinear conjugate gradient method and its application to satellite image restoration

Document Type : Research Article

Authors

1 Department of Mathematics, Faculty of Mathematical Sciences, University of Mazandaran, Babolsar, Iran

2 Department of Applied Mathematics, Faculty of Mathematical Sciences, University of Mazandran, Babolsar, Iran

Abstract

In this paper, an improved nonlinear conjugate gradient method is proposed for solving unconstrained optimization problems. Due to the high computational cost of Newton-type methods, conjugate gradient methods have emerged as efficient alternatives for large-scale problems. However, their performance heavily depends on the choice of search directions and algorithmic parameters. In the proposed method, a novel parameter and a modified search direction are introduced to ensure sufficient descent at each iteration. Global convergence of the method is established under standard assumptions. Numerical experiments on satellite image restoration demonstrate the superiority of the proposed method over the Polak–Ribiere–Polyak method in terms of noise reduction and image quality enhancement.

Keywords

Main Subjects

References

[1] E. Ali, S. Mahdi, A family of developed hybrid four-term conjugate gradient algorithms for unconstrained optimization with applications in image restoration, Symmetry 15 (2023) 1203.
[2] M.R. Arazm, S. Babaie-Kafaki, R. Ghanbari, An extended Dai–Liao conjugate gradient method with global convergence for nonconvex functions, Glas. Mat. 52 (2017) 361–375.
[3] B. Barrouk, M. Belloufi, R. Benzine, T. Bechouat, An improved PRP conjugate gradient method for optimization computation, Int. J. Nonlinear Anal. Appl. 15 (2023) 139–147.
[4] D.P. Bertsekas, Nonlinear Programming, 2nd ed., Athena Scientific, Belmont, MA, 2003.
[5] A. Bertuzzi, F. Conte, F. Papa, C. Sinisgalli, Applications of nonlinear programming to the optimization of fractionated protocols in cancer radiotherapy, Information 11 (2020) 313.
[6] J. Cao, J. Wu, A conjugate gradient algorithm and its applications in image restoration, Appl. Numer. Math. 152 (2020) 243–252.
[7] R. Chan-Renous-Legoubin, C.W. Royer, A nonlinear conjugate gradient method with complexity guarantees and its application to nonconvex regression, arXiv:2201.08568. (2022).
[8] Y.H. Dai, Y. Yuan, A nonlinear conjugate gradient method with a strong global convergence property, SIAM J. Optim. 10 (1999) 177–182.
[9] R. Fletcher, C.M. Reeves, Function minimization by conjugate gradients, Comput. J. 7 (1964) 149–154.
[10] M.R. Hestenes, E. Stiefel, Methods of conjugate gradients for solving linear systems, J. Res. Natl. Bur. Stand. 49 (1952) 409–436.
[11] J. Nocedal, S.J. Wright, Numerical Optimization, 2nd ed., Springer, New York, 2006.
[12] B.T. Polyak, The conjugate gradient method in extreme problems, USSR Comput. Math. Math. Phys. 9 (1969) 94–112.
[13] E. Rubtsov, I. Chilingarian, I. Katkov, K. Grishin, V. Goradzhanov, S. Borisov, Hybrid minimization algorithm for computationally expensive multi-dimensional fitting, arXiv:2112.03413 (2021).
[14] F. You, I. Grossmann, Mixed-integer nonlinear programming models and algorithms for large-scale supply chain design with stochastic inventory management, Ind. Eng. Chem. Res. 47 (2008) 7070–7083.
[15] G. Yuan, T. Li, W. Hu, A conjugate gradient algorithm for large-scale nonlinear equations and image restoration problems, Appl. Numer. Math. 147 (2020) 129–141.
[16] X. Zhang, Y. Yang, A new hybrid conjugate gradient method close to the memoryless BFGS quasi-Newton method and its application in image restoration and machine learning, AIMS Math. 9 (2024) 27535–27556.
Journal of Mathematical Modeling
Volume 14, Issue 3
August 2026
Pages 941-951

Files

Share

How to cite

Statistics