This paper reviews some of the recent techniques which have been used to register multiple images of the same patient. Image registration is a problem which has been receiving significant attention from the medical image processing community in recent years. A successful image registration can aid in patient diagnosis, treatment assessment, image guided interventions, surgery planning and surgery. At present the majority of work has focused on rigid body transformations of images. We shall discuss some of the approaches used and outline a key automatic method in detail. In order to allow image registration of parts of the body which do not remain rigid, either due to patient movement or a change in pathology, nonlinear deformation techniques are being developed. We shall talk of the history of these methods before explaining deformations using landmarks and a recent extension to allow the definition of rigid structures in such warps in more detail. Validation of these methods is of great importance and we shall discuss work which has already been carried out on this topic for rigid body registrations as well as ideas for the validation of deformation algorithms.
Get full access to this article
View all access options for this article.
References
1.
Brown LG.A survey of image registration techniques . ACM Computing Surveys1992; 24: 325-375 .
2.
Van den Elsen PA , Pol EJD , Viergever MA.Medical image matching - a review with classification . IEEE Engineering in Medicine and Biology1993; 26-39 .
3.
Maurer Jr CR , Fitzpatrick JM.A review of medical image registration. In: Macuinas RJ ed. Interactive image-guided neurosurgery. Park Ridge, IL: American Association of Neurological Surgeons , 1993: 17-44.
4.
Ayache N.Medical computer vision, virtual reality and robotics . Image and Vision Computing1995; 13: 295-313 .
5.
Maintz JBA. Retrospective registration of tomographic brain images. PhD thesis, University of Utrecht, 1996.
6.
Pietrzyk U , Herholz K , Fink G , Jacobs Aet al.An interactive technique for three dimensional image registration: validation for PET, SPECT, MRI and CT brain studies . Journal of Nuclear Medicine1994; 35: 2011-2018 .
7.
Malison RT , Miller EG , Greene R , McCarthy Get al.Computer-assisted coregistration of multislice SPECT and MR images by fixed external fiducials . Journal of Computer Assisted Tomography1993; 17: 952-960 .
8.
Erdi YE , Wessels BW , DeJagger R , Erdi AKet al.A new fiducial alignment system to overlay abdominal computed tomography or magnetic resonance anatomical images with radiolabeled antibody single-photon emission computed tomographic scans . Cancer1994; 73(suppl 3): 923-931 .
9.
Scott AM , Macapinlac H , Zhang J , Daghighian Fet al.Image registration of SPECT and CT images using an external fiduciary band and three-dimensional surface fitting in metastatic thyroid cancer . Journal of Nuclear Medicine1995; 36: 100-103 .
10.
Carrau RL , Snyderman CH , Curtin HD , Janecka IPet al.Computer-assisted intraoperative navigation during skull base surgery . American Journal of Otolaryngology1996; 17: 95-101 .
11.
Hill DLG , Hawkes DJ , Crossman JE , Gleeson MJet al.Registration of MR and CT images for skull based surgery using point-like anatomical features . British Journal of Radiology1991; 64: 1030-1035 .
12.
Neelin P , Crossman J , Hawkes DJ , Ma Yet al.Validation of and MRI/PET landmark registration method using 3D simulated PET images and point simulations . Computerized Medical Imaging and Graphics1993; 17: 351-356 .
13.
Hill DLG , Hawkes DJ , Gleeson MJ , Cox TCSet al.Accurate frameless registration of MR and CT images of the head: applications in planning surgery and radiation therapy . Radiology1994; 191: 447-454 .
14.
Banerjee S , Mukherjee DP , Majumdar DD.Point landmarks for registration of CT and MR images . Pattern Recognition Letters1995; 16: 1033-1042 .
15.
Pelizzari CA , Chen GTY , Spelbring DR , Weichselbaum RRet al.Accurate three-dimensional registration of CT, PET, and/or MR images of the brain . Journal of Computer Assisted Tomography1989; 13: 20-26 .
16.
Jiang H , Robb RA , Holton KS.A new approach to 3-D registration of multimodality medical images by surface matching . In: Robb RA ed. Visualization in biomedical computing, SPIE Proc. Vol. 1808, 1992: 196-213 .
17.
Woods RP , Cherry SR , Mazziotta JC.Rapid automated algorithm for aligning and reslicing PET images . Journal of Computer Assisted Tomography1992: 16: 620-633 .
18.
Woods RP , Mazziotta JC , Cherry SR.MRIPET registration with automated algorithm . Journal of Computer Assisted Tomography1993; 17: 536-546 .
19.
Hill DLG , Studholme C , Hawkes DJ.Voxel similarity measures for automated image registration . In: Robb RA ed. Visualisation in biomedical computing, SPIE Proc. Vol. 2359, 1994: 205-216 .
20.
Van den Elsen PA , Pol EJD , Sumanaweera TS , Hemler PFet al.Grey value correlation techniques used for automatic matching of CT and MR brain and spine images . In: Robb RA ed. Visualization in biomedical computing, SPIE Proc. Vol. 2359, 1994: 227-237 .
21.
Collignon A , Maes F , Delaere D , Vandermeulen Det al.Automated multimodality image registration using information theory. In: Bizais Y , Barillot C , DiPaola R eds. Information processing in medical imaging, Dordrecht: Kluwer , 1995: 263-274.
22.
Viola P , Wells WM.Alignment by maximization of mutual information . In: Proceedings of the 5th international conference on computer vision, 1995: 16-23 .
23.
Studholme C , Hill DLG , Hawkes DJ.Multi resolution voxel similarity measures for MRPET registration. In: Bizais Y , Barillot C , diPaola R eds. Information processing in medical imaging. Dordrecht: Kluwer , 1995: 287-298.
24.
Studholme C , Hill DLG , Hawkes DJ.Automated 3D registration of truncated MR and CT images of the head . In: Pycock D ed. Proceedings of the British Machine Vision Conference, Vol. 1, 1995: 27-37 .
25.
Studholme C , Hill DLG , Hawkes DJ.Automated 3D registration of MR and CT images of the head . Medical Image Analysis1996; 1: 163-175 .
Terzopoulos D , Metaxas D.Dynamic 3D models with local and global deformations: deformable superquadrics . IEEE PAMI1991; 13: 703-714 .
28.
Miller MI , Christenson GE , Amit Y , Grenander U.Mathematical textbook of deformable neuroanatomies . In: Proceedings of the National Academy of Sciences of the USA1993; 90: 11944-11948 .
29.
Christenson CA , Rabbitt RD , Miller MI , Joshi SCet al.Topological properties of smooth anatomic maps. In: Bizais Y , Barillot C , DiPaola R eds. Information Processing in Medical Imaging1995; 101-112.
30.
McInerney T , Terzopoulos D.Deformable models in medical image analysis: a survey . Medical Image Analysis1996; 1: 91-108 .
31.
Bookstein FL.Thin-plate splines and the atlas problem for biomedical images. In: Colchester ACF , Hawkes DJ eds. Information Processing in Medical Imaging1991; 326-342.
32.
Bookstein FL , Green WDK.A feature space for edgels in images with landmarks . Journal of Mathematical Imaging and Vision1993; 3: 231-261 .
33.
Arad N , Dyn N , Reisfeld D , Yeshurun Y.Image warping by radial basis functions: application to facial expressions . CVGIP: Graphical Models and Image Processing1994; 56: 161-172 .
34.
Arad N , Reisfeld D.Image warping using few anchor points and radial functions . Computer Graphics Forum1995; 14: 35-46 .
35.
Mardia KV , Kent JT , Goodall CR , Little JA.Kriging and splines with derivative information . Biometrika1996; 83: 207-221 .
36.
Little JA , Hill DLG , Hawkes DJ.Deformations incorporating rigid structures . In: Proceedings of the IEEE workshop on mathematical methods in biomedical image analysis1996: 104-113 .
37.
Jankovic V , Ruzicky E , Niepel L.Smooth morphological transformation of CT and MR medical data . In: Computer analysis of images and pattern 5th international conference1993: 674-678 .
38.
Mardia KV , Little JA.Image warping using derivative information. In: Bookstein FL , Duncan JS , Lange N , Wilson DC eds. Mathematical Methods in Medical Imaging III, SPIE Vol. 2099, San Diego, California , 1994: 16-31.
39.
Maes F , Collignon A , Vandermeulen D , Marchal Get al.Multi-modality image registration by maximization of mutual information . In: Proceedings of the IEEE workshop on mathematical methods in biomedical image analysis1996: 14-22 .
40.
Schonemann PH , Carroll RM.Fitting one matrix to another under choice of a central dilation and a rigid motion . Psychometrika1970; 35: 247-255 .
41.
Arun KS , Huang TS , Blosten SD.Least squares fitting of two 3-d point sets . IEEE PAMI1987; 9: 698-700 .
42.
Clarke RH , Horsley V.On a method of investigating the deep ganglia and tracts of the central nervous system (cerebellum) . British Medical Journal1906; 2: 1799-1800 .
43.
Leksell L.A stereotaxic apparatus for intracerebral surgery . Acta Chirigica Scandinavia1949; 99: 229-233 .
44.
Spiegel EA , Wycis HT , Marks M , Lee AJ.Stereotaxic apparatus for operations on the human brain . Science1949; 106: 349-350 .
45.
Cohen DS , Lustgarten JH , Miller E , Khandji AGet al.Effects of coregistration of MR and CT images on MR stereotactic accuracy . Journal of Neurosurgery1995; 82: 772-779 .
46.
Maurer Jr CR , Fitzpatrick JM , Galloway Jr RL , Wang MYet al.The accuracy of image-guided neurosurgery using implantable fiducial markers. In: Lemke HU , Inamura K , Jaffe CC , Vannier MW eds. Computer assisted radiology. Berlin: Springer , 1995: 1197-1202.
47.
Ellis RE , Toksvig-Larsen S , Marcacci M , Caramella Det al.A biocompatible fiducial marker for evaluating the accuracy of CT image registration. In: Lemke HU , Vannier MW , Inamura K , Farman AG eds. Computer assisted radiology, Vol. 1124. Amsterdam: Excerpta Medica , 1996: 693-698.
48.
Bookstein FL.Morphometric tools for landmark data. Cambridge: Cambridge University Press , 1991: 55-66.
49.
Evans AC , Marrett S , Torrescorzo J , Ku Set al.MRI-PET correlation in three dimensions using a volume of interest (VOI) atlas . Journal of Cerebral Blood Flow and Metabolism1991; 11: A69-A78 .
Reza FM.An introduction to information theory. New York: Dover , 1994.
52.
Duda RO , Hart PE.Pattern classification and scene analysis. New York: John Wiley , 1973.
53.
Strother SC , Anderson JR , Xu XL , Liow JSet al.Quantitative comparisons of image registration techniques based on high-resolution MRI of the brain . Journal of Computer Assisted Tomography1994; 18: 954-962 .
54.
Hemler PF , van den Elsen PA , Sumanaweera TS , Napel Set al.A quantitative comparison of residual error for three different multimodality registration techniques. In: Bizais Y , Barillot C , DiPaola R eds. Information processing in medicalimaging. Dordrecht: Kluwer , 1995; 251-262.
55.
West J , Fitzpatrick JM , Wang MYet al.Comparison and evaluation of retrospective intermodality image registration techniques. In: Medical Imaging 1996: image processing, Vol. 2710. SPIE , 1996: 332-347.
56.
Talairach J , Tournoux P.A coplanar stereotaxic atlas of a human brain. Stuttgart: Thieme , 1988.
57.
Duchon J.Interpolation des fonctions de deux variables suivant le principe de la flexion des plaques mince . RAIRO Analyse Numerique1976; 10: 5-12 .
58.
Meinguet J.Multivariate interpolation at arbitrary points made simple . Journal of Applied Mathematics and Physics (ZAMP)1979; 30: 292-304 .
59.
Matheron G.The intrinsic random functions and their applications . Advances in Applied Problems1973; 5: 439-468 .
60.
Cressie NAC.Statistics for spatial data, second edition. John Wiley , 1993.
61.
Micchelli CA.Interpolation of scattered data: Distance matrices and conditionally positive definite functions . Constructive Approximation1986; 2: 11-22 .
62.
Wahba G.Spline models for observational data. Philadelphia, PA: Society for Industrial and Applied Mathematics , 1990.
63.
Terzopoulus D.Multilevel computational processes for visual surface recognition . Computer Vision, Graphics and Image Processing1983; 24: 52-96 .
64.
Bookstein FL.Principal warps: thin-plate splines and the decomposition of deformations . IEEE PAMI1989; 11: 567-585 .
65.
Kumar S , Goldof D.Automatic tracking of SPAMM grid and the estimation of deformation parameters from cardiac MR images . IEEE Transactions on Medical Imaging1994; 13(1).
66.
Edwards PJ , Hill DLG , Little JA , Sahni VASet al.Medical image registration incorporating deformations . In: Pycock D ed. Proceedings of the British machine vision conference1995; 691-699 .
67.
Ruprecht D , Müller H.Image warping with scattered data interpolation . IEEE Computer Graphics and Applications1995; 15: 37-43 .
68.
Ruprecht D , Nagel R , Müller H.Spatial free-form deformation with scattered data interpolation methods . Computers and Graphics1995; 19: 63-71 .
69.
Watson GS.Smoothing and interpolation by kriging and with splines . Mathematical Geology1984; 16: 601-615 .
70.
Kent JT , Mardia KV.The link between kriging and thin-plate splines. In: Kelly FP ed. Probability, statistics and optimization. New York: John Wiley , 1994: 324-339.
71.
Rohr K , Stiehl HS , Sprengel R , Beil Wet al.Point-based elastic registration of medical image data using approximating thin-plate splines. In: Hohne KH , Kikinis R eds. Visualization in biomedical computing. Berlin: Springer , 1996: 297-306.
72.
Marcus LF , Corti M , Loy A , Naylor GJPet al. eds. Advances in morphometrics. NATO ASI Series A: Life Sciences, Vol. 384. New York: Plenum , 1996.
73.
Myers DE.Kriging, cokriging, radial basis functions and the role of positive definiteness . Computers and Mathemtical Applications1992; 24: 139-148 .
74.
Green WDK.The thin-plate spline and images with curving features . In: Mardia KV , Gill CA , Dryden IL eds. Proceedings of the 16th Leeds applied shape research workshop1996: 79-87 .
75.
Bookstein FL.Landmark methods for forms without landmarks: Localizing group differences in outline shape . In: Proceedings of the IEEE workshop on mathematical methods in biomedical image analysis1996: 279-289 .
76.
Shepard D.A two-dimensional interpolation function for irregularly spaced data . In: Proceedings of the 23rd national conference of the ACM. New York: ACM, 1968: 517-524 .
77.
Borgefors G.Distance transformations in digital images . Computer Vision, Graphics and Image Processing1986; 34: 344-371 .
