Photoacoustic imaging has been developed as a new biomedical molecular imaging modality. Due to its similarity to conventional ultrasound imaging in terms of signal detection and image generation, dual-modal photoacoustic and ultrasound imaging has been applied to visualize physiological and morphological information in biological systems in vivo. By complementing each other, dual-modal photoacoustic and ultrasound imaging showed synergistic advances in photoacoustic imaging with the guidance of ultrasound images. In this review, we introduce our recent progresses in dual-modal photoacoustic and ultrasound imaging systems at various scales of study, from preclinical small animals to clinical humans. A summary of the works reveals various strategies for combining the structural information of ultrasound images with the molecular information of photoacoustic images.
KimCFavazzaCWangLV. In vivo photoacoustic tomography of chemicals: high-resolution functional and molecular optical imaging at new depths.Chem Rev2010;110:2756–82
3.
XiaJYaoJWangLV. Photoacoustic tomography: principles and advances.Prog Electromagn Res2014;147:1–22
4.
WangDWangYWangWLuoDChitgupiUGengJZhouYWangLLovellJFXiaJ. Deep tissue photoacoustic computed tomography with a fast and compact laser system.Biomed Opt Exp2017;8:112–23
5.
WangSLinJWangTChenXHuangP. Recent advances in photoacoustic imaging for deep-tissue biomedical applications.Theranostics2016;6:2394
6.
NtziachristosV. Going deeper than microscopy: the optical imaging frontier in biology.Nat Methods2010;7:603–14
7.
BiRDinishUGohCCImaiTMoothancheryMLiXKimJYJeonSPuYKimCNgLGWangLVOlivoM. In vivo label-free functional photoacoustic monitoring of ischemic reperfusion.J Biophoton2019;12:e201800454
8.
ToiMAsaoYMatsumotoYSekiguchiHYoshikawaATakadaMKataokaMEndoTKawaguchi-SakitaNKawashimaM. Visualization of tumor-related blood vessels in human breast by photoacoustic imaging system with a hemispherical detector array.Sci Rep2017;7:41970
9.
LiaoL-DLinC-TShihY-YIDuongTQLaiH-YWangP-HWuRTsangSChangJ-YLiM-L. Transcranial imaging of functional cerebral hemodynamic changes in single blood vessels using in vivo photoacoustic microscopy.J Cereb Blood Flow Metabol2012;32:938–51
10.
YaoJWangLYangJ-MMaslovKIWongTTLiLHuangC-HZouJWangLV. High-speed label-free functional photoacoustic microscopy of mouse brain in action.Nat Methods2015;12:407–10
11.
LinLXiaJWongTTLiLWangLV. In vivo deep brain imaging of rats using oral-cavity illuminated photoacoustic computed tomography.J Biomed Opt2015;20:016019
12.
YaoJWangLV. Photoacoustic brain imaging: from microscopic to macroscopic scales.Neurophotonics2014;1:011003
13.
ZhangYJeonMRichLJHongHGengJZhangYShiSBarnhartTEAlexandridisPHuizingaJD. Non-invasive multimodal functional imaging of the intestine with frozen micellar naphthalocyanines.Nat Nanotechnol2014;9:631–8
14.
LeeDBeackSYooJKimSKLeeCKwonWHahnSKKimC. In vivo photoacoustic imaging of livers using biodegradable hyaluronic acid-conjugated silica nanoparticles.Adv Func Mater2018;28:1800941
VonkJKukačkaJSteinkampPde WitJVoskuilFHooghiemstraWBaderMJüstelDNtziachristosVvan DamG. Multispectral optoacoustic tomography for in vivo detection of lymph node metastases in oral cancer patients using an EGFR-targeted contrast agent and intrinsic tissue contrast: a proof-of-concept study.Photoacoustics2022;26:100362
17.
ParkBParkSKimJKimC. Listening to drug delivery and responses via photoacoustic imaging.Adv Drug Deliv Rev2022;184:114235
18.
DasSSBharadwajPBilalMBaraniMRahdarATaboadaPBungauSKyzasGZ. Stimuli-responsive polymeric nanocarriers for drug delivery, imaging, and theragnosis.Polymers2020;12:1397
19.
CaoTGNKangJHKimWLimJKangSJYouJYHoangQTKimWJRheeWJKimC. Engineered extracellular vesicle-based sonotheranostics for dual stimuli-sensitive drug release and photoacoustic imaging-guided chemo-sonodynamic cancer therapy.Theranostics2022;12:1247
20.
XiaJKimCFLovellJ. Opportunities for photoacoustic-guided drug delivery.Curr Drug Targets2015;16:571–81
21.
GuoTTangQGuoYQiuHDaiJXingCZhuangSHuangG. Boron quantum dots for photoacoustic imaging-guided photothermal therapy.ACS Appl Mater Interfaces2020;13:306–11
22.
MiaoZ-HWangHYangHLiZZhenLXuC-Y. Glucose-derived carbonaceous nanospheres for photoacoustic imaging and photothermal therapy.ACS Appl Mater Interfaces2016;8:15904–10
23.
KouJDouDYangL. Porphyrin photosensitizers in photodynamic therapy and its applications.Oncotarget2017;8:81591
24.
ChenYXuCChengYChengQ. Photostability enhancement of silica-coated gold nanostars for photoacoustic imaging guided photothermal therapy.Photoacoustics2021;23:100284
25.
ChoiHChoiWKimJKongWHKimKSKimCHahnSK. Multifunctional nanodroplets encapsulating naphthalocyanine and perfluorohexane for bimodal image-guided therapy.Biomacromolecules2019;20:3767–77
26.
NohIKimMKimJLeeDOhDKimJKimCJonSKimY-C. Structure-inherent near-infrared bilayer nanovesicles for use as photoacoustic image-guided chemo-thermotherapy.J Control Release2020;320:283–92
27.
JeongWYKangMSLeeHLeeJHKimJHanD-WKimKS. Recent trends in photoacoustic imaging techniques for 2D nanomaterial-based phototherapy.Biomedicines2021;9:80
28.
BellAG. The photophone.Science1880;1:130–4
29.
LeeHKimJKimH-HKimC-SKimJ. Review on optical imaging techniques for multispectral analysis of nanomaterials.Nanotheranostics2022;6:50
30.
LiMTangYYaoJ. Photoacoustic tomography of blood oxygenation: a mini review.Photoacoustics2018;10:65–73
31.
LeeCJeonMJeonMYKimJKimC. In vitro photoacoustic measurement of hemoglobin oxygen saturation using a single pulsed broadband supercontinuum laser source.Appl Opt2014;53:3884–9
32.
WangXStoicaGXieXKuGWangLV. Noninvasive imaging of hemoglobin concentration and oxygenation in the rat brain using high-resolution photoacoustic tomography.J Biomed Opt2006;11:024015
33.
BreathnachAConcannonLAaltoLDorairajJSubhashHMKellyJLeahyMJ (eds.) Assessment of cutaneous melanoma and pigmented skin lesions with photoacoustic imaging. In: Proceedings SPIE, Photonic therapeutics and diagnostics XI, San Francisco, CA, 7–12 February 2015
34.
WangBKarpioukAYeagerDAmirianJLitovskySSmallingREmelianovS. Intravascular photoacoustic imaging of lipid in atherosclerotic plaques in the presence of luminal blood.Opt Lett2012;37:1244–6
35.
JansenKWuMvan der SteenAFvan SoestG. Lipid detection in atherosclerotic human coronaries by spectroscopic intravascular photoacoustic imaging.Opt Express2013;21:21472–84
36.
CaoYKoleAHuiJZhangYMaiJAllooshMSturekMChengJ-X. Fast assessment of lipid content in arteries in vivo by intravascular photoacoustic tomography.Sci Rep2018;8:1–10
37.
KimJParkSLeeCKimJYKimC. Organic nanostructures for photoacoustic imaging.ChemNanoMat2015;2:156–66
38.
HanSLeeDKimSKimH-HJeongSKimJ. Contrast agents for photoacoustic imaging: a review focusing on the wavelength range.Biosensors2022;12:594
39.
KilianHIMaCZhangHChenMNilamAQuinnBTangYXiaJYaoJLovellJF. Intraperitoneal administration for sustained photoacoustic contrast agent imaging.Photoacoustics2022;28:100406
40.
JiangZDingYLovellJFZhangY. Design and application of organic contrast agents for molecular imaging in the Second Near Infrared (NIR-II) window.Photoacoustics2022;28:100426
41.
ChoiWParkBChoiSOhDKimJKimC. Recent advances in contrast-enhanced photoacoustic imaging: overcoming the physical and practical challenges.Chem Rev. Epub ahead of print 16 January 2023. DOI:10.1021/acs.chemrev.2c00627.
42.
KyeHSongYNinjbadgarTKimCKimJ. Whole-body photoacoustic imaging techniques for preclinical small animal studies.Sensors2022;22:5130
43.
KalvaSKDean-BenXLRazanskyD. Single-sweep volumetric optoacoustic tomography of whole mice.Photonics Res2021;9:899–908
44.
LiLZhuLMaCLinLYaoJWangLMaslovKZhangRChenWShiJ. Single-impulse panoramic photoacoustic computed tomography of small-animal whole-body dynamics at high spatiotemporal resolution.Nat Biomed Eng2017;1:0071
45.
XiaJWangL. Small-animal whole-body photoacoustic tomography: a review.IEEE Trans Biomed Eng2013;61:1380–9
46.
SteinbergIKimJSchneiderMKHyunDZlitniAHopperSMKlapTSonnGADahlJJKimC. Superiorized Photo-Acoustic Non-NEgative Reconstruction (SPANNER) for clinical photoacoustic imaging.IEEE Trans Med Imag2021;40:1888–97
AttiaABEBalasundaramGMoothancheryMDinishUBiRNtziachristosVOlivoM. A review of clinical photoacoustic imaging: current and future trends.Photoacoustics2019;16:100144
49.
HanSLeeHKimCKimJ. Review on multispectral photoacoustic analysis of cancer: thyroid and breast.Metabolites2022;12:382
KothapalliS-RSonnGAChoeJWNikoozadehABhuyanAParkKKCristmanPFanRMoiniALeeBCWuJCarverTETrivediDShiibaLSteinbergIHulandDMRasmussenMFLiaoJCBrooksJDKhuri-YakubPTGambhirSS. Simultaneous transrectal ultrasound and photoacoustic human prostate imaging.Sci Transl Med2019;11:eaav2169
52.
YangMZhaoLHeXSuNZhaoCTangHHongTLiWYangFLinL. Photoacoustic/ultrasound dual imaging of human thyroid cancers: an initial clinical study.Biomed Opt Exp2017;8:3449–57
53.
AhnJKimJYChoiWKimC. High-resolution functional photoacoustic monitoring of vascular dynamics in human fingers.Photoacoustics2021;23:100282
54.
AhnJBaikJWKimDChoiKLeeSParkS-MKimJYNamSHKimC. In vivo photoacoustic monitoring of vasoconstriction induced by acute hyperglycemia.Photoacoustics2023;30:100485
55.
JeonMKimJKimC. Multiplane spectroscopic whole-body photoacoustic imaging of small animals in vivo.Med Biol Eng Comput2016;54:283–94
56.
LeeCKimJZhangYJeonMLiuCSongLLovellJFKimC. Dual-color photoacoustic lymph node imaging using nanoformulated naphthalocyanines.Biomaterials2015;73:142–8
57.
ParkSKimJJeonMSongJKimC. In vivo photoacoustic and fluorescence cystography using clinically relevant dual modal indocyanine green.Sensors2014;14:19660–8
58.
SongJKimJHwangSJeonMJeongSKimCKimS. “Smart” gold nanoparticles for photoacoustic imaging: an imaging contrast agent responsive to the cancer microenvironment and signal amplification via pH-induced aggregation.Chem Commun2016;52:8287–90
59.
KwonNKimKHParkSChoYParkE-YLimJÇetindereSTümaySOKimWJLiX. Hexa-BODIPY-cyclotriphosphazene based nanoparticle for NIR fluorescence/photoacoustic dual-modal imaging and photothermal cancer therapy.Biosens Bioelectron2022;216:114612
60.
ParkE-YParkSLeeHKangMKimCKimJ. Simultaneous dual-modal multispectral photoacoustic and ultrasound macroscopy for three-dimensional whole-body imaging of small animals.Photonics2021;8:13
61.
LeeHHanSParkSChoSYooJKimCKimJ. Ultrasound-guided breath-compensation in single-element photoacoustic imaging for three-dimensional whole-body images of mice.Front Phys2022;10:457
62.
KimJYLeeCParkKLimGKimC. Fast optical-resolution photoacoustic microscopy using a 2-axis water-proofing MEMS scanner.Sci Rep2015;5:7932
63.
MaslovKZhangHFHuSWangLV. Optical-resolution photoacoustic microscopy for in vivo imaging of single capillaries.Opt Lett2008;9:929–31
64.
BaikJWKimHSonMChoiJKimKGBaekJHParkYHAnJChoiHYRyuSYKimJYByunKKimC. Intraoperative label-free photoacoustic histopathology of clinical specimens.Laser Photonics Rev2021;15:2100124
65.
ParkBHanMParkJKimTRyuHSeoYKimWJKimHHKimC. A photoacoustic finder fully integrated with a solid-state dye laser and transparent ultrasound transducer.Photoacoustics2021;23:100290
66.
ChenRHeYShiJYungCHwangJWangLVZhouQ. Transparent high-frequency ultrasonic transducer for photoacoustic microscopy application.IEEE Trans Ultrason Ferroelectr Freq Contr2020;67:1848–53
67.
RenDSunYShiJChenR (eds.) A review of transparent sensors for photoacoustic imaging applications.Photonics2021;8:324
68.
DangiAAgrawalSKothapalliS-R. Lithium niobate-based transparent ultrasound transducers for photoacoustic imaging.Opt Lett2019;44:5326–9
69.
ParkJParkBKimTJungSChoiWAhnJYoonDKimJJeonSLeeD. Quadruple ultrasound, photoacoustic, optical coherence, and fluorescence fusion imaging with a transparent ultrasound transducer.Proc Natl Acad Sci USA2021;118:e1920879118
70.
ChoiWParkE-YJeonSKimC. Clinical photoacoustic imaging platforms.Biomed Eng Lett2018;8:139–55
71.
KimCErpeldingTNJankovicLWangLV. Performance benchmarks of an array-based hand-held photoacoustic probe adapted from a clinical ultrasound system for non-invasive sentinel lymph node imaging.Philos Trans A Math Phys Eng Sci2011;369:4644–50
72.
MenezesGLPijnappelRMMeeuwisCBisschopsRVeltmanJLavinPTVan De VijverMJMannRM. Downgrading of breast masses suspicious for cancer by using optoacoustic breast imaging.Radiology2018;288:355–65
73.
NeuschlerEIButlerRYoungCABarkeLDBertrandMLBöhm-VélezMDestounisSDonlanPGrobmyerSRKatzenJ. A pivotal study of optoacoustic imaging to diagnose benign and malignant breast masses: a new evaluation tool for radiologists.Radiology2017;287:398–412
74.
KimJParkSJungYChangSParkJZhangYLovellJFKimC. Programmable real-time clinical photoacoustic and ultrasound imaging system.Sci Rep2016;6:35137
75.
JeonSParkE-YChoiWManaguliRjong LeeKKimC. Real-time delay-multiply-and-sum beamforming with coherence factor for in vivo clinical photoacoustic imaging of humans.Photoacoustics2019;15:100136
76.
KimJParkE-YParkBChoiWLeeKJKimC. Towards clinical photoacoustic and ultrasound imaging: probe improvement and real-time graphical user interface.Exp Biol Med2020;245:321–9
77.
ChitgupiUNyayapathiNKimJWangDSunBLiCCarterKHuangWCKimCXiaJ. Surfactant-stripped micelles for NIR-II photoacoustic imaging through 12 cm of breast tissue and whole human breasts.Adv Mater2019;31:1902279
78.
ParkBLeeKMParkSYunMChoiH-JKimJLeeCKimHKimC. Deep tissue photoacoustic imaging of nickel (II) dithiolene-containing polymeric nanoparticles in the second near-infrared window.Theranostics2020;10:2509–21
79.
ParkSParkGKimJChoiWJeongUKimC. Bi2Se3 nanoplates for contrast-enhanced photoacoustic imaging at 1064 nm.Nanoscale2018;10:20548–58
80.
KimWChoiWAhnJLeeCKimC. Wide-field three-dimensional photoacoustic/ultrasound scanner using a two-dimensional matrix transducer array.Opt Lett2023;48:343–6
81.
ParkE-YLeeHHanSKimCKimJ. Photoacoustic imaging systems based on clinical ultrasound platform.Exp Biol Med2022;247:551–60
82.
KimJParkBHaJSteinbergIHooperSMJeongCParkE-YChoiWLiangTBaeJ-SManaguliRKimYGambhirSSLimD-JKimC. Multiparametric photoacoustic analysis of human thyroid cancers in vivo.Cancer Res2021;81:4849–60
83.
ParkBBangCHLeeCHanJHChoiWKimJParkGSRhieJWLeeJHKimC. 3D wide-field multispectral photoacoustic imaging of human melanomas in vivo: a pilot study.J Eur Acad Dermatol Venereol2020;35:669–76
84.
KimJKimYHParkBSeoHMBangCHParkGSParkYMRhieJWLeeJHKimC. Multispectral ex vivo photoacoustic imaging of cutaneous melanoma for better selection of the excision margin.Br J Dermatol2018;179:780–2
85.
ParkSJangJKimJKimYSKimC. Real-time triple-modal photoacoustic, ultrasound, and magnetic resonance fusion imaging of humans.IEEE Trans Med Imag2017;36:1912–21
86.
ChoiWParkE-YJeonSYangYParkBAhnJChoSLeeCSeoD-KChoJ-HKimC. Three-dimensional multistructural quantitative photoacoustic and US imaging of human feet in vivo.Radiology2022;303:467–73
87.
KratkiewiczKPattynAAlijabbariNMehrmohammadiM. Ultrasound and photoacoustic imaging of breast cancer: clinical systems, challenges, and future outlook.J Clin Med2022;11:1165
88.
PirasDXiaWSteenbergenWVan LeeuwenTGManoharS. Photoacoustic imaging of the breast using the Twente photoacoustic mammoscope: present status and future perspectives.IEEE J Sel Top Quantum Electron2009;16:730–9
89.
ZhangMKimHSJinTYiAMoonWK. Ultrasound-guided photoacoustic imaging for the selective detection of EGFR-expressing breast cancer and lymph node metastases.Biomed Opt Exp2016;7:1920–31
90.
DimaANtziachristosV. In-vivo handheld optoacoustic tomography of the human thyroid.Photoacoustics2016;4:65–9
91.
RollWMarkwardtNAMasthoffMHelfenAClaussenJEisenblätterMHasenbachAHermannSKarlasAWildgruberM. Multispectral optoacoustic tomography of benign and malignant thyroid disorders: a pilot study.J Nucl Med2019;60:1461–6
92.
WangBKarpioukAYeagerDAmirianJLitovskySSmallingREmelianovS. In vivo intravascular ultrasound-guided photoacoustic imaging of lipid in plaques using an animal model of atherosclerosis.Ultrasound Med Biol2012;38:2098–103
93.
HoriguchiATsujitaKIrisawaKKasamatsuTHirotaKKawaguchiMShinchiMItoKAsanoTShinmotoH. A pilot study of photoacoustic imaging system for improved real-time visualization of neurovascular bundle during radical prostatectomy.Prostate2016;76:307–15
94.
Lediju BellMAKuoNPSongDYKangJUBoctorEM. In vivo visualization of prostate brachytherapy seeds with photoacoustic imaging.J Biomed Opt2014;19:126011
95.
MallidiSWatanabeKTimermanDSchoenfeldDHasanT. Prediction of tumor recurrence and therapy monitoring using ultrasound-guided photoacoustic imaging.Theranostics2015;5:289
96.
WangXLuoYChenYChenCYinLYuTHeWMaC. A skull-removed chronic cranial window for ultrasound and photoacoustic imaging of the rodent brain.Front Neurosci2021;15:673740
97.
KimMJengG-SPelivanovIO’DonnellM. Deep-learning image reconstruction for real-time photoacoustic system.IEEE Trans Med Imag2020;39:3379–90
98.
SchellenbergMDreherKKHolzwarthNIsenseeFReinkeASchreckNSeitelATizabiMDMaier-HeinLGröhlJ. Semantic segmentation of multispectral photoacoustic images using deep learning.Photoacoustics2022;26:100341
99.
ChoiSYangJLeeSYKimJLeeJKimWJLeeSKimC. Deep learning enhances multiparametric dynamic volumetric photoacoustic computed tomography in vivo (DL-PACT).Adv Sci2023;10:2202089
100.
KimJKimGLiLZhangPKimJYKimYKimHHWangLVLeeSKimC. Deep learning acceleration of multiscale superresolution localization photoacoustic imaging.Light: Sci Appl2022;11:1–12
