PDF] Steepest Descent and Conjugate Gradient Methods with Variable Preconditioning
Por um escritor misterioso
Last updated 04 junho 2024
It is shown that the CG method with variable preconditioning under this assumption may not give improvement, compared to the steepest descent (SD) method, and a new elegant geometric proof of the SD convergence rate bound is given. We analyze the conjugate gradient (CG) method with variable preconditioning for solving a linear system with a real symmetric positive definite (SPD) matrix of coefficients $A$. We assume that the preconditioner is SPD on each step, and that the condition number of the preconditioned system matrix is bounded above by a constant independent of the step number. We show that the CG method with variable preconditioning under this assumption may not give improvement, compared to the steepest descent (SD) method. We describe the basic theory of CG methods with variable preconditioning with the emphasis on “worst case” scenarios, and provide complete proofs of all facts not available in the literature. We give a new elegant geometric proof of the SD convergence rate bound. Our numerical experiments, comparing the preconditioned SD and CG methods, not only support and illustrate our theoretical findings, but also reveal two surprising and potentially practically important effects. First, we analyze variable preconditioning in the form of inner-outer iterations. In previous such tests, the unpreconditioned CG inner iterations are applied to an artificial system with some fixed preconditioner as a matrix of coefficients. We test a different scenario, where the unpreconditioned CG inner iterations solve linear systems with the original system matrix $A$. We demonstrate that the CG-SD inner-outer iterations perform as well as the CG-CG inner-outer iterations in these tests. Second, we compare the CG methods using a two-grid preconditioning with fixed and randomly chosen coarse grids, and observe that the fixed preconditioner method is twice as slow as the method with random preconditioning.
Mathematics, Free Full-Text
matrices - How is the preconditioned conjugate gradient algorithm
Nonlinear Conjugate Gradient Methods for Unconstrained Optimization
PDF) A scaled three-term conjugate gradient method for
Steepest Descent Methods
Two Algorithms Related to the Method of Steepest Descent
The Conjugate Residual Method for Constrained Minimization
PDF) Preconditioned steepest descent-like methods for symmetric
Conjugate gradient method - Wikipedia
Gradient descent - Wikipedia
PDF) Toward The Optimal Preconditioned Eigensolver: Locally
PDF] Comparison of steepest descent method and conjugate gradient
Inexact Preconditioned Conjugate Gradient Method with Inner-Outer
Steepest Descent Methods
Recomendado para você
-
Introduction to Method of Steepest Descent04 junho 2024
-
Gradient descent - Wikipedia04 junho 2024
-
Illustration of the steepest descent method used to maximize the R04 junho 2024
-
Steepest Descent and Newton's Method in Python, from Scratch: A Comparison, by Nicolo Cosimo Albanese04 junho 2024
-
2 The steepest descent method: ) ( ) (k x and ) 2 ( ) ( ) ( k k k e x α04 junho 2024
-
The A-Z Guide to Gradient Descent Algorithm and Its Types04 junho 2024
-
MathType - The #Gradient descent is an iterative optimization #algorithm for finding local minimums of multivariate functions. At each step, the algorithm moves in the inverse direction of the gradient, consequently reducing04 junho 2024
-
Gradient Descent in Machine Learning - Javatpoint04 junho 2024
-
Solved] . 1. Solve the following using steepest descent algorithm. Start04 junho 2024
-
Solving unconstrained optimization problems using steepest descent algorithm : r/optimization04 junho 2024
você pode gostar
-
Viking Vs Dragon, Movie Poster • Ads of the World™04 junho 2024
-
King Kamehameha and Queen Kamamalu - Unique Artworks Collection - Paintings & Prints, People & Figures, Portraits, Other Portraits - ArtPal04 junho 2024
-
I have a really big subway surfers collection : r/WeirdFlexButOK04 junho 2024
-
Resident Evil 3 Remake - PS4: Buy Online at Best Price in Egypt - Souq is now04 junho 2024
-
One Piece Quando saem os spoilers do mangá 1058?04 junho 2024
-
File:John Armellino and William Holls USMC-100715-M-3680M-005.jpg04 junho 2024
-
Fortune Reigns by J. Clifton Slater - Audiobook04 junho 2024
-
Carlsen garante vaga na Final; Salimova perde a chance de conquistar o título no Feminino04 junho 2024
-
Otome Game Sekai wa Mob「AMV」- Fight Song ᴴᴰ / Leon ignored Olivia - BiliBili04 junho 2024
-
Sylveon (Pokémon) - Bulbapedia, the community-driven Pokémon encyclopedia04 junho 2024