"Evaluation of Registration Methods on Thoracic CT: The EMPIRE10 Challenge"

Keelin Murphy, Bram van Ginneken, Joseph M. Reinhardt, Sven Kabus, Kai Ding, Xiang Deng, Kunlin Cao, Kaifang Du, Gary E. Christensen, Vincent Garcia, Tom Vercauteren, Nicholas Ayache, Olivier Commowick, Gregoire Malandain, Ben Glocker, Nikos Paragios, Nassir Navab, Vladlena Gorbunova, Jon Sporring, Marleen de Bruijne, Xiao Han, Mattias P. Heinrich, Julia A. Schnabel, Mark Jenkinson, Cristian Lorenz, Marc Modat, Jamie R. McClelland, Sebastien Ourselin, Sascha E.A. Muenzing, Max A. Viergever, Dante De Nigris, D.L. Collins, Tal Arbel, Marta Peroni, Rui Li, Gregory C. Sharp, Alexander Schmidt-Richberg, Jan Ehrhardt, Rene Werner, Dirk Smeets, Dirk Loeckx, Gang Song, Nicholas Tustison, Brian Avants, James C. Gee, Marius Staring, Stefan Klein, Berend C. Stoel, Martin Urschler, Manuel Werlberger, Jef Vandemeulebroucke, Simon Rit, David Sarrut and Josien P.W. Pluim


EMPIRE10 (Evaluation of Methods for Pulmonary Image REgistration 2010) is a public platform for fair and meaningful comparison of registration algorithms which are applied to a database of intrapatient thoracic CT image pairs. Evaluation of nonrigid registration techniques is a nontrivial task. This is compounded by the fact that researchers typically test only on their own data, which varies widely. For this reason, reliable assessment and comparison of different registration algorithms has been virtually impossible in the past. In this work we present the results of the launch phase of EMPIRE10, which comprised the comprehensive evaluation and comparison of 20 individual algorithms from leading academic and industrial research groups. All algorithms are applied to the same set of 30 thoracic CT pairs. Algorithm settings and parameters are chosen by researchers expert in the configuration of their own method and the evaluation is independent, using the same criteria for all participants. All results are published on the EMPIRE10 website (http://empire10.isi.uu.nl). The challenge remains ongoing and open to new participants. Full results from 24 algorithms have been published at the time of writing. This paper details the organization of the challenge, the data and evaluation methods and the outcome of the initial launch with 20 algorithms. The gain in knowledge and future work are discussed.



PDF (20 pages, 1808 kB) click to start download
From publisher link

Copyright © 2011 by the authors. Published version © 2011 by IEEE. Personal use of this material is permitted. However, permission to reprint or republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works, must be obtained from the copyright holder.


BibTeX entry

author = "{Keelin Murphy and Bram van Ginneken and Joseph M. Reinhardt and Sven Kabus and Kai Ding and Xiang Deng and Kunlin Cao and Kaifang Du and Gary E. Christensen and Vincent Garcia and Tom Vercauteren and Nicholas Ayache and Olivier Commowick and Gregoire Malandain and Ben Glocker and Nikos Paragios and Nassir Navab and Vladlena Gorbunova and Jon Sporring and Marleen de Bruijne and Xiao Han and Mattias P. Heinrich and Julia A. Schnabel and Mark Jenkinson and Cristian Lorenz and Marc Modat and Jamie R. McClelland and Sebastien Ourselin and Sascha E.A. Muenzing and Max A. Viergever and Dante De Nigris and D.L. Collins and Tal Arbel and Marta Peroni and Rui Li and Gregory C. Sharp and Alexander Schmidt-Richberg and Jan Ehrhardt and Rene Werner and Dirk Smeets and Dirk Loeckx and Gang Song and Nicholas Tustison and Brian Avants and James C. Gee and Marius Staring and Stefan Klein and Berend C. Stoel and Martin Urschler and Manuel Werlberger and Jef Vandemeulebroucke and Simon Rit and David Sarrut and Josien P.W. Pluim}",
title = "{Evaluation of Registration Methods on Thoracic CT: The EMPIRE10 Challenge}",
journal = "{IEEE Transactions on Medical Imaging}",
volume = "{30}",
number = "{11}",
pages = "{1901 - 1920}",
month = "{November}",
year = "{2011}",

last modified: 12-08-2014 |webmaster |Copyright 2004-2019 © by Marius Staring