"An efficient preconditioner for stochastic gradient descent optimization of image registration"

Yuchuan Qiao, Boudewijn P.F Lelieveldt and Marius Staring


Stochastic gradient descent (SGD) is commonly used to solve (parametric) image registration problems. In case of badly scaled problems, SGD however only exhibits sublinear convergence properties. In this paper we propose an efficient preconditioner estimation method to improve the convergence rate of SGD. Based on the observed distribution of voxel displacements in the registration, we estimate the diagonal entries of a preconditioning matrix, thus rescaling the optimization cost function. The preconditioner is efficient to compute and employ, and can be used for mono-modal as well as multi-modal cost functions, in combination with different transformation models like the rigid, affine and B-spline model. Experiments on different clinical data sets show that the proposed method indeed improves the convergence rate compared to SGD with speedups around 2-5 in all tested settings, while retaining the same level of registration accuracy.



PDF (12 pages, 500 kB) click to start download
From publisher link

Copyright © 2019 by the authors. Published version © 2019 by IEEE. Personal use of this material is permitted. However, permission to reprint or republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works, must be obtained from the copyright holder.


Source code

The source code of the methods described in this paper can be found in the image registration toolkit elastix, available at http://elastix.isi.uu.nl.

BibTeX entry

author = "{Yuchuan Qiao and Boudewijn P.F Lelieveldt and Marius Staring}",
title = "{An efficient preconditioner for stochastic gradient descent optimization of image registration}",
journal = "{IEEE Transactions on Medical Imaging}",
year = "{2019}",

last modified: 18-03-2019 |webmaster |Copyright 2004-2019 © by Marius Staring