Tumor grade assessment is critical to the treatment of cancers. A pathologist typically evaluates grade by examining morphologic organization in tissue using hematoxylin and eosin (H&E) stained tissue sections. Fourier transform infrared spectroscopic (FT-IR) imaging provides an alternate view of tissue in which spatially specific molecular information from unstained tissue can be utilized. Here, we examine the potential of IR imaging for grading colon cancer in biopsy samples. We used a 148-patient cohort to develop a deep learning classifier to estimate the tumor grade using IR absorption. We demonstrate that FT-IR imaging can be a viable tool to determine colorectal cancer grades, which we validated on an independent cohort of surgical resections. This work demonstrates that harnessing molecular information from FT-IR imaging and coupling it with morphometry is a potential path to develop clinically relevant grade prediction models.
SiegelR.L.MillerK.D.Goding SauerA.FedewaS.A., et al. “Colorectal Cancer Statistics, 2020”. CA. Cancer J. Clin.2020. 70(3): 145-164. doi: 10.3322/Caac.21601.
2.
HamiltonS.R.AaltonenL.A.. Pathology and Genetics of Tumours of the Digestive System. Lyon: International Agency for Research on Cancer, 2000.
3.
GriffinM.R.BergstralhE.J.CoffeyR.J.BeartR.W.MeltonL.J.III. “Predictors of Survival After Curative Resection of Carcinoma of the Colon and Rectum”. Cancer. 1987. 60(9): 2318-2324.
4.
WiggersT.ArendsJ.W.VolovicsA.. “Regression Analysis of Prognostic Factors in Colorectal Cancer After Curative Resections”. Dis Colon. Rectum.1988. 31(1): 33-41.
5.
ChapuisP.H.DentO.F.FisherR.NewlandR.C., et al. “A Multivariate Analysis of Clinical and Pathological Variables in Prognosis After Resection of Large Bowel Cancer”. Br. J. Surg.1985. 72(9): 698-702.
6.
BarresiV.BonettiL.R.IeniA.BrancaG., et al. “Histologic Grading Based on Counting Poorly Differentiated Clusters in Preoperative Biopsy Predicts Nodal Involvement and PTNM Stage in Colorectal Cancer Patients”. Hum. Pathol.2014. 45(2): 268-275. doi: 10.1016/J.Humpath.2013.07.046.
7.
DerwingerK.KodedaK.Bexe-LindskogE.TaflinH.. “Tumour Differentiation Grade is Associated with TNM Staging and the Risk of Node Metastasis in Colorectal Cancer”. Acta. Oncol.2010. 49(1): 57-62. doi: 10.3109/02841860903334411.
8.
BlenkinsoppW.K.Stewart-BrownS.BlesovskyL.KearneyG.FieldingL.P.. “Histopathology Reporting in Large Bowel Cancer”. J. Clin. Pathol.1981. 34(5): 509-513. doi: 10.1136/JCP.34.5.509.
9.
ChandlerI.HoulstonR.S.. “Interobserver Agreement in Grading of Colorectal Cancers-Findings from a Nationwide Web-Based Survey of Histopathologists”. Histopathology. 2008. 52(4): 494-499. doi: 10.1111/J.1365-2559.2008.02976.X.
10.
EstevaA.KuprelB.NovoaR.A.KoJ., et al. “Dermatologist-Level Classification of Skin Cancer with Deep Neural Networks”. Nature. 2017. 542(7639): 115-118. doi: 10.1038/Nature21056.
11.
UenoH.KajiwaraY.ShimazakiH.ShintoE., et al. “New Criteria for Histologic Grading of Colorectal Cancer”. Am. J. Surg. Pathol.2012;36(2):193-201. doi:10.1097/PAS.0b013e318235edee.
12.
UenoH.HaseK.HashiguchiY.ShimazakiH., et al. “Site-Specific Tumor Grading System in Colorectal Cancer”. Am. J. Surg. Pathol.2014. 38(2): 197-204. doi: 10.1097/PAS.0000000000000113.
13.
KainzP.PfeifferM.UrschlerM.. “Segmentation and Classification of Colon Glands with Deep Convolutional Neural Networks and Total Variation Regularization”. PeerJ. 2017. 5: E3874. doi: 10.7717/Peerj.3874.
14.
SirinukunwattanaK.RazaS.E.A.TsangY.-W.SneadD.R.J., et al.. “Locality Sensitive Deep Learning for Detection and Classification of Nuclei in Routine Colon Cancer Histology Images”. IEEE. Trans. Med. Imag.2016. 35(5): 1196-1206. doi: 10.1109/TMI.2016.2525803.
15.
KorbarB.OlofsonA.M.MiraflorA.P.NickaC.M., et al. “Deep Learning for Classification of Colorectal Polyps on Whole-slide Images”. J. Pathol. Inf.2017. 8: 30.
16.
BychkovD.LinderN.TurkkiR.NordlingS., et al. “Deep Learning Based Tissue Analysis Predicts Outcome in Colorectal Cancer”. Sci. Rep.2018. 8(1): 3395. doi: 10.1038/S41598-018-21758-3.
17.
RathoreS.IftikharM.A.ChaddadA.NiaziT., et al. “Segmentation and Grade Prediction of Colon Cancer Digital Pathology Images Across Multiple Institutions”. Cancers. 2019. 11(11): 1700. doi: 10.3390/Cancers11111700.
18.
Ehteshami BejnordiB.TimofeevaN.Otte-HöllerI.KarssemeijerN.van der LaakJ.A.W.M.. “Quantitative Analysis of Stain Variability in Histology Slides and an Algorithm for Standardization”. In: GurcanM.N.MadabhushiA., editors. International Society for Optics and Photonics Medical Imaging 2014: Digital Pathology. Proc. SPIE. 2014. 9041: 904108. doi: 10.1117/12.2043683.
19.
McGavinM.D.. “Factors Affecting Visibility of a Target Tissue in Histologic Sections”. Veterinary Pathology. 2014. 51(1): 9-27. doi: 10.1177/0300985813506916.
20.
HanahanD.a WeinbergR.. “Hallmarks of Cancer: The Next Generation”. Cell. 2011. 144(5): 646-674. doi: 10.1016/J.Cell.2011.02.013.
21.
DiemM.ErginA.RemiszewskiS.MuX., et al. “Infrared Micro-Spectroscopy of Human Tissue: Principles and Future Promises”. Faraday Discuss. 2016. 187(0): 9-42. doi: 10.1039/C6fd00023a.
TiwariS.Kajdacsy-BallaA.WhiteleyJ.ChengG., et al. “INFORM: INFrared-Based ORganizational Measurements of Tumor and Its Microenvironment to Predict Patient Survival”. Sci. Adv.2021. 7(6): eabb8292.
24.
NallalaJ.LloydG.R.ShepherdN.StoneN.. “High-Resolution FTIR Imaging of Colon Tissues for Elucidation of Individual Cellular and Histopathological Features”. Analyst. 2016. 141(2): 630-639. doi: 10.1039/C5an01871d.
25.
SongC.L.VardakiM.Z.GoldinR.D.KazarianS.G.. “Fourier Transform Infrared Spectroscopic Imaging of Colon Tissues: Evaluating the Significance of Amide I and C-H Stretching Bands in Diagnostic Applications with Machine Learning. Anal. Bioanal. Chem.2019. 411(26): 6969-6981. doi: 10.1007/S00216-019-02069-6.
26.
Kallenbach-ThieltgesA.GrosserüschkampF.MosigA.DiemM., et al. “Immunohistochemistry, Histopathology and Infrared Spectral Histopathology of Colon Cancer Tissue Sections”. J Biophot. 2013. 6(1): 88-100. doi: 10.1002/Jbio.201200132.
27.
LaschPWäscheWMcCarthyWJMullerGNaumannD. “Imaging of Human Colon Carcinoma Thin Sections by FT-IR Microspectrometry”. Proc. SPIE 3257, Infrared Spectroscopy: New Tool in Medicine. BiOS '98 International Biomedical Optics Symposium. San Jose, California; 24 April, 1998.
28.
LaschP.HaenschW.NaumannD.DiemM.. “Imaging of Colorectal Adenocarcinoma Using FT-IR Microspectroscopy and Cluster Analysis”. Biochim. Biophys. Acta. (BBA)-Mol. Basis. Dis.2004. 1688: 176-186. doi: 10.1016/J.Bbadis.2003.12.006.
29.
NallalaJ.PiotO.DieboldM.-D.GobinetC., et al. “Infrared Imaging as a Cancer Diagnostic Tool: Introducing a New Concept of Spectral Barcodes for Identifying Molecular Changes in Colon Tumors”. Cytometry. 2013. 83A(3): 294-300. doi: 10.1002/Cyto.A.22249.
30.
MayerichD.M.WalshM.Kadjacsy-BallaA.MittalS.BhargavaR.. “Breast Histopathology Using Random Decision Forests-Based Classification of Infrared Spectroscopic Imaging Data”. In: GurcanMNMadabhushiA, editors. Medical Imaging 2014: Digital Pathology. Proc. SPIE. 2014. 9041: 904107, San Diego, California; 20 March 2014. doi: 10.1117/12.2043783.
31.
FabianH.ThiN.A.N.EidenM.LaschP., et al. “Diagnosing Benign and Malignant Lesions in Breast Tissue Sections by Using IR-Microspectroscopy”. Biochim. Biophys. Acta. Biomembr.2006. 1758: 874-882. doi: 10.1016/J.Bbamem.2006.05.015.
32.
VerdonckM.DenayerA.DelvauxB.GaraudS., et al. “Characterization of Human Breast Cancer Tissues by Infrared Imaging”. Analyst. 2016. 141(2): 606-619. doi: 10.1039/C5an01512j.
33.
BenardA.DesmedtC.SmolinaM.SzternfeldP., et al. “Infrared Imaging in Breast Cancer: Automated Tissue Component Recognition and Spectral Characterization of Breast Cancer Cells as Well as the Tumor Microenvironment”. Analyst. 2014. 139: 1044-1056. doi: 10.1039/C3an01454a.
34.
PeñarandaF.NaranjoV.LloydG.R.KastlL., et al. “Discrimination of Skin Cancer Cells Using Fourier Transform Infrared Spectroscopy”. Comput. Biol. Med.2018. 100: 50-61. doi: 10.1016/J.Compbiomed.2018.06.023.
35.
KrishnaC.M.SockalingumG.D.BhatR.A.VenteoL., et al. “FTIR and Raman Microspectroscopy of Normal, Benign, and Malignant Formalin-Fixed Ovarian Tissues”. Anal Bioanal Chem. 2007. 387(5): 1649-1656. doi: 10.1007/S00216-006-0827-1.
36.
TiwariS.ReddyV.B.BhargavaR.RamanJ.. “Computational Chemical Imaging for Cardiovascular Pathology: Chemical Microscopic Imaging Accurately Determines Cardiac Transplant Rejection”. PLoS One. 2015. 10(5): E0125183. doi: 10.1371/Journal.Pone.0125183.
37.
TiwariS.RamanJ.ReddyV.GhetlerA., et al. “Towards Translation of Discrete Frequency Infrared Spectroscopic Imaging for Digital Histopathology of Clinical Biopsy Samples”. Anal. Chem.2016. 88(20): 10183-10190. doi: 10.1021/Acs.Analchem.6b02754.
38.
NallalaJ.DieboldM.-D.GobinetC.BouchéO., et al. “Infrared Spectral Histopathology for Cancer Diagnosis: A Novel Approach for Automated Pattern Recognition of Colon Adenocarcinoma”. Analyst. 2014. 139(16): 4005-4015. doi: 10.1039/C3an01022h.
39.
HirschmuglC.J.GoughK.M.. “Fourier Transform Infrared Spectrochemical Imaging: Review of Design and Applications with a Focal Plane Array and Multiple Beam Synchrotron Radiation Source”. Appl. Spectrosc.2012. 66(5): 475-491.
KrafftC.SteinerG.BeleitesC.SalzerR.. “Disease Recognition by Infrared and Raman Spectroscopy”. J. Biophot.2009. 2(1–2): 13-28. doi: 10.1002/Jbio.200810024.
42.
BhargavaR.. “Towards a Practical Fourier Transform Infrared Chemical Imaging Protocol for Cancer Histopathology”. Anal. Bioanal. Chem.2007. 389(4): 1155-1169. doi: 10.1007/S00216-007-1511-9.
43.
TiwariS.BhargavaR.. “Extracting Knowledge from Chemical Imaging Data Using Computational Algorithms for Digital Cancer Diagnosis”. Yale J Biol Med. 2015. 88(2): 131-143.
44.
BakerM.J.TrevisanJ.BassanP.BhargavaR., et al. “Using Fourier Transform IR Spectroscopy to Analyze Biological Materials”. Nat. Protoc.2014. 9(8): 1771-1791. doi: 10.1038/Nprot.2014.110.
45.
PounderF.N.ReddyR.K.BhargavaR.. “Development of a Practical Spatial-Spectral Analysis Protocol for Breast Histopathology Using Fourier Transform Infrared Spectroscopic Imaging”. Faraday Discuss. 2016. 187(0): 43-68. doi: 10.1039/C5fd00199d.
46.
BerishaS.LotfollahiM.JahanipourJ.GurcanI., et al. “Deep Learning for FTIR Histology: Leveraging Spatial and Spectral Features with Convolutional Neural Networks”. Analyst. 2019. 144(5): 1642-1653. doi: 10.1039/C8an01495g.
47.
GervasoniA.Monasterio MuñozR.M.WenglerG.S.RizziA., et al. “Molecular Signature Detection of Circulating Tumor Cells Using a Panel of Selected Genes”. Cancer Lett. 2008. 263(2): 267-279. doi: 10.1016/J.Canlet.2008.01.003.
48.
MordechaiS.ShufanE.Porat KatzB.S.SalmanA.. “Early Diagnosis of Alzheimer’s Disease Using Infrared Spectroscopy of Isolated Blood Samples Followed by Multivariate Analyses”. Analyst. 2017. 142(8): 1276-1284. doi: 10.1039/C6an01580h.
49.
NallalaJ.JeynesC.SaundersS.SmartN., et al. “Characterization of Colorectal Mucus Using Infrared Spectroscopy: A Potential Target for Bowel Cancer Screening and Diagnosis”. Lab. Invest.2020. 100(8): 1102-1110. doi: 10.1038/S41374-020-0418-3.
YehK.KenkelS.LiuJ.-N.BhargavaR.. “Fast Infrared Chemical Imaging with a Quantum Cascade Laser”. Anal. Chem.2015. 87(1): 485-493. doi: 10.1021/Ac5027513.
52.
KimberJ.A.KazarianS.G.. “Spectroscopic Imaging of Biomaterials and Biological Systems with FTIR Microscopy or with Quantum Cascade Lasers”. Anal. Bioanal. Chem.2017. 409(25): 5813-5820. doi: 10.1007/S00216-017-0574-5.
53.
KoleM.R.ReddyR.K.SchulmerichM.V.GelberM.K.BhargavaR.. “Discrete frequency infrared microspectroscopy and imaging with a tunable quantum cascade laser”. Analytical chemistry2012. 84(23): 10366-10372. doi: 10.1021/ac302513f.
54.
LiberdaD.HermesM.KoziolP.StoneN.WrobelT.P.. “Translation of an Esophagus Histopathological FT-IR Imaging Model to a Fast Quantum Cascade Laser Modality”. J. Biophot.2020. 13(8): E202000122. doi: 10.1002/Jbio.202000122.
55.
PillingM.J.HendersonA.BirdB.BrownM.D., et al. “High-Throughput Quantum Cascade Laser (QCL) Spectral Histopathology: A Practical Approach Towards Clinical Translation”. Faraday Discuss. 2016. 187: 135-154. doi: 10.1039/C5fd00176e.
56.
KuepperC.Kallenbach-ThieltgesA.JuetteH.TannapfelA., et al. “Quantum Cascade Laser-Based Infrared Microscopy for Label-Free and Automated Cancer Classification in Tissue Sections”. Sci. Rep.2018. 8(1): 1-10. doi: 10.1038/S41598-018-26098-W.
57.
KuepperC.GrosserueschkampF.Kallenbach-ThieltgesA.MosigA., et al. “Label-Free Classification of Colon Cancer Grading Using Infrared Spectral Histopathology”. Faraday Discuss. 2016. 187(0): 105-118. doi: 10.1039/C5fd00157a.
RazavianA.S.AzizpourH.SullivanJ.CarlssonS.. “CNN Features Off-The-Shelf: An Astounding Baseline for Recognition”. In: 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops. Columbus, Ohio; June 23–28 June 2014. doi:10.1109/CVPRW.2014.131.
60.
DonahueJ.JiaY.VinyalsO.HoffmanJ., et al. “DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition”. Int. Conf. Mach. Learn.2014. 32: 647-655.
61.
GaberA.JohanssonM.StenmanU.-H.HotakainenK., et al. “High Expression of Tumour-Associated Trypsin Inhibitor Correlates with Liver Metastasis and Poor Prognosis in Colorectal Cancer”. Br. J. Cancer. 2009. 100(10): 1540-1548. doi: 10.1038/Sj.Bjc.6605047.
62.
KrizhevskyA.SutskeverI.HintonG.E.. “Imagenet Classification with Deep Convolutional Neural Networks”. Adv Neural Inf Process Syst. 2012. 25: 1097-1105.
63.
HeK.ZhangX.RenS.SunJ.. “Deep Residual Learning for Image Recognition”. 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Las Vegas, Nevada; 27–30 June 2016. Pp. 770-778. doi: 10.1109/CVPR.2016.90.
64.
KingmaD.P.BaJ.. “Adam: A Method for Stochastic Optimization”. International Conference on Learning Representations (ICLR). San Diego, California; 7–9 May 2016. ArXiv 1412.6980.
65.
WilleminkM.J.KoszekW.A.HardellC.WuJ., et al. “Preparing Medical Imaging Data for Machine Learning”. Radiology. 2020. 295(1): 4-15. doi: 10.1148/Radiol.2020192224.
66.
AhmadJ.MuhammadK.BaikS.W.. “Data Augmentation-Assisted Deep Learning of Hand-Drawn Partially Colored Sketches for Visual Search”. PLoS One. 2017. 12(8): E0183838. doi: 10.1371/Journal.Pone.0183838.
67.
PanS.J.YangQ.. “A Survey on Transfer Learning”. IEEE. Trans. Knowl. Data Eng.2010. 22(10): 1345-1359. doi: 10.1109/TKDE.2009.191.
SchnellM.MittalS.FalahkheirkhahK.MittalA.BhargavaR.. “All-Digital Histopathology by Infrared-Optical Hybrid Microscopy”. Proc. Natl. Acad. Sci. Unit. States. Am.2020. 117(7): 3388-3396. doi: 10.1073/Pnas.1912400117.
71.
SongC.L.KazarianS.G.. “Effect of Controlled Humidity and Tissue Hydration on Colon Cancer Diagnostic via FTIR Spectroscopic Imaging”. Anal. Chem.2020. 92(14): 9691-9698. doi: 10.1021/Acs.Analchem.0c01002.
72.
KazarianS.G.ChanK.L.A.. “ATR-FTIR Spectroscopic Imaging: Recent Advances and Applications to Biological Systems”. Analyst. 2013. 138(7): 1940-1951. doi: 10.1039/C3an36865c.
73.
SongC.L.KazarianS.G.. “Micro ATR-FTIR Spectroscopic Imaging of Colon Biopsies with a Large Area Ge Crystal”. Spectrochim Acta. Mol. Biomol. Spectrosc.2020. 228: 117695. doi: 10.1016/J.Saa.2019.117695.
74.
LiQ.-B.XuZ.ZhangN.-W.ZhangL., et al. “In Vivo and in Situ Detection of Colorectal Cancer Using Fourier Transform Infrared Spectroscopy”. World J. Gastroenterol. 2005. 11(3): 327-330.
75.
YehK.BhargavaR.. “Discrete Frequency Infrared Imaging Using Quantum Cascade Lasers for Biological Tissue Analysis”. In: Mahadevan-JansenA.PetrichW., editors. Biomedical Vibrational Spectroscopy 2016: Advances in Research and Industry. Proc. SPIE. 2016. 9704: 970406. doi: 10.1117/12.2230003.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
