Images and data representing morphology, function, and metabolism are medically produced in the scope of specific protocols and pathologies. Although generally assessed individually, these data can also be merged together into a multidimensional digital space that simulates the reality of the patient from many different perspectives. This space can then be navigated at will along any dimension, not only for diagnosis but also to plan, simulate, or monitor surgery or other types of therapy. These approaches can be used for addressing various research or clinical needs such as the primary and secondary assessments of complex pathologies, including cancer and epilepsy. Concepts such as those presented in this article represent an adequate foundation not only for an optimum exploitation of all available information for in-vivo assessment and therapy guidance but also for a more effective assessment of the full scope and requirements of live systems simulation(s) accurate enough for supporting clinical and research developments.
Adelson, P. D.
, Black, P., Madsen, J. R., Kramer, U., Rockoff, M. A., Riviello, J. J., Helmer, S. L., Mikati, M.,& Holmes, G. L. (1995). Use of subdural grids and strip electrodes to identify a seizure focus in children. Pediatric Neurosurgery, 22, 174-180.
2.
Ames, A. L.
, Nadeau, D. R., & Moreland, J. L. (1996). The VRML source book.New York: John Wiley.
3.
Appel, R. D.
, Palagi, P., Walther, D., Vargas, J. R., Sanchez, J. C., Ravier, F., Pasquali, C.,& Hochstrasser, D. F. (1997). MelanieII: Athird generation software package for analysis of two-dimensional electrophoresis images—I. Features and user interface. Electrophoresis, 18, 2724-2734.
4.
Arun, K. S.
, Huang, T. S.,& Blostein, S. D. (1987). Least square fitting of two 3-D point sets. IEEE Transaction on Pattern Analysis and Machine Intelligence, 9, 698-700.
5.
Behrens, E.
, Zentner, J., van Roost, D., Hufnagel, A., Elger, C. E., & Schramm, J. (1994). Subdural and depth electrodes in the presurgical evaluation of epilepsy. Acta Neurochirurgica, 12(1-4), 84-87.
6.
Bidaut, L.
(in press). Model-based integration of invasive electrophysiology with other modalities. Proceedings SPIE Medical Imaging.
7.
Bidaut, L. M.
, Pascual-Marqui, R., Delavelle, J., Naimi, A., Seeck, M., Michel, C., Slosman, D., Ratib, O., Ruefenacht, D., Landis, T., de Tribolet, N., Scherrer, J. R., & Terrier, F. (1996). Three-to five-dimensional biomedical multisensor imaging for the assessment of neurological (dys)function. Journal of Digital Imaging, 9(4), 185-198.
8.
Blend, M. J.
, de Leon, O. A., Jobe, T. H., Lin, Q., Sychra, J. J., & Gaviria, M. (1997). Cerebral perfusion SPECT imaging in epileptic and non epileptic seizures. Clinical Nuclear Medicine, 22(6), 363-368.
9.
Chen, L. S.
, Mitchell, W. G., Horton, E. J.,& Snead, O. C. (1995). Clinical utility of video-EEG monitoring. Pediatric Neurology, 12(3), 220-224.
10.
Duncan, J. S.
(1997). Imaging and epilepsy. Brain, 120(Part2), 339-377.
11.
Emerson, R. G.
, Turner, C. A., Pedley, T. A., Walczak, T. S.,& Forgione, M. (1995). Propagation patterns of temporal spikes. Electroencephalography and Clinical Neurophysiology, 94(5), 338-348.
12.
Fois, A.
, Farnetani, M. A., Balestri, P., Buoni, S., Di Cosmo, G., Vattimo, A., Guazelli, M., Guzzardi, R., & Salvadori, P. A. (1995). EEG, PET, SPET and MRI in intractable childhood epilepsies: Possible surgical correlations. Child’s Nervous System, 11(12), 672-678.
13.
Friston, K. J.
, Frith, C. D., Liddle, P. F., & Frackowiak, R. S. (1991). Comparing functional (PET) images: The assessment of significant change. Journal of Cerebral Blood Flow Metabolism, 11, 690-699.
14.
Gaillard, W. D.
, White, S., Malow, B., Flamini, R., Weinstein, S., Sato, S., Kufta, C., Schiff, S., Devinsky, O., Fazilat, S., et al. (1995). FDG-PET in children and adolescents with partial seizures: Role in epilepsy surgery evaluation. Epilepsy Research, 20(1), 77-84.
15.
Gandhe, A. J.
, Hill, D. J., Studholme, C., Hawkes, D. J., Ruff, C. F., Cox, T. C., Gleeson, M. J.,& Strong, A. J. (1994). Combined and three-dimensional rendered multimodal data for planning cranial bas surgery: A prospective evaluation. Neurosurgery, 35(3), 463-470.
16.
Gilliam, F.
,& Wyllie, E. (1996). Diagnostic testing of seizure disorders. Neurologic Clinics, 14(1), 61-84.
17.
Held, K.
, Kops, E. R., Krause, B. J., Wells, W. M., Kikinis, R.,& Muller-Gartner, H. W. (1997). Markov random field segmentation of brain MR images. IEEE Transactions in Medical Imaging, 16(6), 878-886.
18.
Holmes, G. L.
(1996). Intractable epilepsy in children. Epilepsia, 37, 14-27.
19.
Jacquez, J. A.
(1988). Compartmental analysis in biology and medicine.Ann Arbor: University of Michigan Press.
20.
Knowlton, R. C.
, Laxer, K. D., Ende, G., Hawkins, R. A., Wond, S. T., Matson, G. B., Rowley, H. A., Fein, G., & Weiner, M. W. (1997). Presurgical multimodality neuroimaging in electroencephalographic lateralized temporal lobe epilepsy. Annals of Neurology, 42(6), 829-837.
21.
Koles, Z. J.
(1998). Trends in EEG source localization. Electroencephalography and Clinical Neurophysiology, 106(2), 127-137.
22.
Le, J.
,& Gevins, A. (1993). Method to reduce blur distortion from EEG’s using a realistic head model. IEEE Transactions in Biomedical Engineering, 40(6), 517-528.
23.
Levin, D. N.
, Hu, X. P., Tan, K. K., Galhotra, S., Pelizzari, C. A., Chen, G. T., Beck, R. N., Chen, C. T., Cooper, M. D., Mullan, J. F., et al. (1989). The brain: Integrated three-dimensional display of MR and PET images. Radiology, 172(3), 783-789.
24.
Loew, M. H.
(1997). Issues in multimodality medical image registration. Journal of Digital Imaging, 10(3s1), 24-25.
25.
Mangin, J.-F.
, Frouin, V., Bloch, I., Bendriem, B.,& Lopez-Krahe, J. (1994). Fast nonsupervised 3-D registration of PET and MR images of the brain. Journal of Cerebral Blood Flow and Metabolism, 14, 749-762.
26.
Marin, G.
, Guerin, C., Baillet, S., Garnero, L., & Meunier, G. (1998). Influence of skull anisotropy for the forward and inverse problem in EEG: Simulation studies using FEM on realistic head models. Human Brain Mapping, 6(4), 250-269.
27.
Meyer, C. R.
, Boes, J. L., Kim, B., Bland, P., Zasadny, K. R., Kison, P. V., Koral, K., Frey, K. A.,& Wahl, R. L. (1997). Demonstration of accuracy and clinical versatility of mutual information for automatic multimodality image fusion using affine and thin plate spline warped geometric deformations. Medical Image Analysis, 3, 195-206.
28.
Meyer, C. R.
, Leichtman, G. S., Brunberg, J. A., Wahl, R. L., & Quint, L. E. (1995). Simultaneous usage of homologous points, lines and planes for optimal 3-D linear registration of multimodality imaging data. IEEE Transactions in Medical Imaging, 14(1), 1-11.
29.
Nagata, T.
, Tanaka, F., Yonekura, Y., Ikeda, A., Nishizawa, S., Ishizu, K., Okazawa, H., Terada, K., Mikuni, N., Yamamoto, I., et al. (1995). Limited value of interictal brain perfusion SPECT for detection of epileptic foci: High resolution SPECT studies in comparison with FDG-PET. Annals of Nuclear Medicine, 9(2), 59-63.
30.
Nocera, L.
, & Gee, J. C. (1997). Robust partial volume tissue classification of cerebral MRI scans. Proceedings SPIE Medical Imaging, 3034, 312-322.
31.
Nunez, P. L.
, Silberstein, R. B., Cadusch, P. J.,& Wijesinghe, R. (1993). Comparison of high resolution EEG methods having different theoretical bases. Brain Topography, 5(4), 361-364.
32.
Nunez, P. L.
, & Westdorp, A. F. (1994). The surface Laplacian, high resolution EEG and controversies. Brain Topography, 6(3), 221-226.
33.
Pascual-Marqui, R. D.
, Michel, C. M., & Lehmann, D. (1994). Low resolution electromagnetic tomography: A new method for localizing electrical activity in the brain. International Journal of PsychoPhysiology, 18, 49-65.
34.
Pelizzari, C. A.
, Chen, G.T.Y., Spelbring, D. R., Weichselbaum, R. R., & Chen, C. T. (1989). Accurate three-dimensional registration of CT, PET, and/or MR images of the brain. Journal of Computer Assisted Tomography, 13, 20-26.
35.
Pietrzyk, U.
, Herholz, K., Fink, G., Jacobs, A., Mielke, R., Slansky, I., Wurker, M., & Heiss, W. D. (1994). An interactive technique for three-dimensional image registration: Validation for PET, SPECT, MRIand CT brain studies. Journal of Nuclear Medicine, 35(12), 2011-2018.
36.
Pirotte, B.
, Goldman, S., Bidaut, L. M., Luxen, A., Stanus, E., Brucher, J. M., Balériaux, D., Brotchi, J., & Levivier, M. (1995). Use of positron emission tomography (PET) in stereotactic conditions for brain biopsy. Acta Neurochirurgica, 134(1-2), 79-82.
37.
Ratib, O.
, Ligier, Y.,& Scherrer, J.-R. (1994). Digital image management in medicine. Computerised Medical Imaging and Graphics, 18,73-84.
38.
Rosenbaum, T. J.
, Laxer, K. D., Vessely, M., & Smith, W. D. (1986). Subdural electrodes for seizure focus localization. Neurosurgery, 19, 73-81.
39.
Schulder, M.
, Maldjian, J. A., Liu, W. C., Holodny, A. I., Kalnin, A. T., Mun, I. K., & Carmel, P. W. (1998). Functional image-guided surgery of intracranial tumors located in or near the sensorimotor cortex. Journal of Neurosurgery, 89(3), 412-418.
40.
Sperling, M. R.
(1997). Clinical challenges in invasive monitoring in epilepsy surgery. Epilepsia, 38(Suppl. 4), 6-12.
41.
Strauss, E.
,& Wada, J. (1988). Hand preference and proficiency and cerebral speech dominance determined by the carotid amytal test. Journal of Clinical and Experimental Neuropsychology, 10(2), 169-174.
42.
van Herk, M.
, & Kooy, H. M. (1994). Automatic three-dimensional correlation of CT-CT, CT-MRI, and CT-SPECT using chamfer matching. Medical Physics, 21, 1163-1178.
43.
Wells, W. M.
, Grimson, W.E.L., Kikinis, R., & Jolesz, F. A. (1996). Adaptative segmentation of MRI data. IEEE Transactions in Medical Imaging, 15(4), 429-442.
44.
West, J.
, Fitzpatrick, J. M., Wang, M. Y., et al. (1997). Comparison and evaluation of retrospective intermodality brain image registration techniques. Journal of Computer Assisted Tomography, 21(4), 554-566.
45.
Woods, R.
, Mazziotta, J. C.,& Cherry, S. (1993). MRI-PET registration with automated algorithm. Journal of Computer Assisted Tomography, 17, 536-546.
