切换至 "中华医学电子期刊资源库"

中华临床医师杂志(电子版) ›› 2026, Vol. 20 ›› Issue (03) : 244 -248. doi: 10.3877/cma.j.issn.1674-0785.2026.03.012

综述

多模态医学图像融合技术在眼底病领域的应用研究进展
景娇娜, 姚家奇()   
  1. 210029 南京,南京医科大学附属儿童医院眼科
  • 收稿日期:2025-12-23 出版日期:2026-03-30
  • 通信作者: 姚家奇
  • 基金资助:
    江苏省妇幼保健协会科研课题(FYX202339)

Application of multi-modal medical image fusion in fundus diseases: a review

Jiaona Jing, Jiaqi Yao()   

  1. Department of Ophthalmology, Children's Hospital of Nanjing Medical University, Nanjing 210029, China
  • Received:2025-12-23 Published:2026-03-30
  • Corresponding author: Jiaqi Yao
引用本文:

景娇娜, 姚家奇. 多模态医学图像融合技术在眼底病领域的应用研究进展[J/OL]. 中华临床医师杂志(电子版), 2026, 20(03): 244-248.

Jiaona Jing, Jiaqi Yao. Application of multi-modal medical image fusion in fundus diseases: a review[J/OL]. Chinese Journal of Clinicians(Electronic Edition), 2026, 20(03): 244-248.

眼底疾病是导致视力损害的重要原因,其精确诊断与精准治疗依赖于高质量的医学影像。多模态医学图像融合(MMIF)技术能够整合不同模态的眼底图像(如光学相干断层扫描、眼底彩色照相、眼底荧光血管造影等),形成信息互补,弥补单一模态在结构显示、功能评估上的局限性。这篇文章系统综述了MMIF技术在年龄相关性黄斑变性(AMD)、糖尿病视网膜病变(DR)、视网膜静脉阻塞(RVO)、息肉状脉络膜血管病变(PCV)等疾病中的应用,主要包括在病灶识别、分类诊断和鉴别诊断等方面的最新研究进展,为今后人工智能技术在眼底病领域的深度探索与实践提供重要参考。

Fundus diseases are a leading cause of vision impairment, and their accurate diagnosis and treatment rely on high-quality medical imaging. Multi-modal medical image fusion (MMIF) integrates various fundus imaging modalities-such as optical coherence tomography, color fundus photography, and fundus fluorescein angiography-to compensate for the limitations of individual modalities in structural and functional assessment. This review systematically summarizes recent advances in the application of MMIF to major fundus diseases, including age-related macular degeneration (AMD), diabetic retinopathy (DR), retinal vein occlusion (RVO), and polypoidal choroidal vasculopathy (PCV), with a focus on lesion identification, disease classification, and differential diagnosis. The review aims to provide a valuable reference for further artificial intelligence-driven research and practice in the field of fundus diseases.

1
Dogra A, Ahuja CK, Kumar S. Image integration procedures in multisensory medical images: a comprehensive survey of the state-of-the-art paradigms [J]. Curr Med Imaging, 2022, 18(5): 476-495.
2
Zhang C, Yang Z, He X, et al. Multimodal intelligence: representation learning, information fusion, and applications [J]. IEEE J Sel Top Signal Process, 2020, 14(2): 478-493.
3
Baltrušaitis T, Ahuja C, Morency LP. Multimodal machine learning: A survey and taxonomy update [J]. IEEE Trans Pattern Anal Mach Intell, 2022, 44(10): 6479-6496.
4
Haribabu M, Guruviah V, Yogarajah P. Recent advancements in multimodal medical image fusion techniques for better diagnosis: An overview [J]. Curr Med Imaging, 2023, 19(7): 673-694.
5
Bousquet E, Duraffour P, Debillon L, et al. Birdshot chorioretinopathy: A review[J]. J Clin Med, 2022, 11(16): 4772.
6
Siak J, Mahendradas P, Chee SP. Multimodal imaging in anterior uveitis [J]. Ocul Immunol Inflamm, 2017, 25(3): 434-446.
7
Acón D, Wu L. Multimodal imaging in diabetic macular edema [J]. Asia Pac J Ophthalmol (Phila), 2018, 7(1): 22-27.
8
Li J, Chen J, Tang Y, et al. Transforming medical imaging with transformers? A comparative review of key properties, current progresses, and future perspectives [J]. Medical Image Analysis, 2023, 85: 102762.
9
Azam MA, Khan KB, Salahuddin S, et al. A review on multimodal medical image fusion: compendious analysis of medical modalities, multimodal databases, fusion techniques and quality metrics[J]. Comput Biol Med, 2022, 144: 105253.
10
Fonti R, Conson M, Del Vecchio S. PET/CT in radiation oncology [J]. Semin Oncol, 2019, 46(3): 202-209.
11
Xie C, Vardhanabhuti V. PET/CT: nasopharyngeal cancers [J]. PET Clin, 2022, 17(2): 285-296.
12
Tawfik N, Elnemr HA, Fakhr M, et al. Multimodal medical image fusion using stacked auto-encoder in NSCT domain [J]. J Digit Imaging, 2022, 35(5): 1308-1325.
13
Baltrusaitis T, Ahuja C, Morency LP. Multimodal machine learning: A survey and taxonomy [J]. IEEE Trans Pattern Anal Mach Intell, 2019, 41(2): 423-443.
14
贾紫婷. 多模态医学图像融合的关键技术研究 [J]. 计算机时代, 2020(7): 4-6, 11.
15
何俊, 张彩庆, 李小珍, 等. 面向深度学习的多模态融合技术研究综述 [J]. 计算机工程, 2020, 46(5): 1-11.
16
Huang R, Lin Z, Dou H, et al. AW3M: An auto-weighting and recovery framework for breast cancer diagnosis using multi-modal ultrasound [J]. Med Image Anal, 2021, 72: 102137.
17
Nie D, Zhang H, Adeli E, et al. 3D deep learning for multi-modal imaging-guided survival time prediction of brain tumor patients [J]. Med Image Comput Comput Assist Interv, 2016, 9901: 212-220.
18
Maqsood SU. Multi-modal medical image fusion based on two-scale image decomposition and sparse representation [J]. Biomed Signal Process Control, 2020, 57: 101810.
19
Alseelawi N, Hazim HT, Salim Alrikabi HT. A novel method of multimodal medical image fusion based on hybrid approach of NSCT and DTCWT [J]. Int J Online Biomed Eng, 2022, 18(3): 114-133.
20
Thakoor KA, Yao J, Bordbar D, et al. A multimodal deep learning system to distinguish late stages of AMD and to compare expert vs. AI ocular biomarkers [J]. Sci Rep, 2022, 12(1): 2585.
21
Chen M, Jin K, Yan Y, et al. Automated diagnosis of age-related macular degeneration using multi-modal vertical plane feature fusion via deep learning [J]. Med Phys, 2022, 49(4): 2324-2333.
22
Yoo TK, Choi JY, Seo JG, et al. The possibility of the combination of OCT and fundus images for improving the diagnostic accuracy of deep learning for age-related macular degeneration: a preliminary experiment [J]. Med Biol Eng Comput, 2019, 57(3): 677-687.
23
Chou YB, Hsu CH, Chen WS, et al. Deep learning and ensemble stacking technique for differentiating polypoidal choroidal vasculopathy from neovascular age-related macular degeneration [J]. Sci Rep, 2021, 11(1): 7130.
24
Xu Z, Wang W, Yang J, et al. Automated diagnoses of age-related macular degeneration and polypoidal choroidal vasculopathy using bi-modal deep convolutional neural networks [J]. Br J Ophthalmol, 2021, 105(4): 561-566.
25
Cennamo G, Montorio D, Fossataro F, et al. Evaluation of vessel density in disorganization of retinal inner layers after resolved diabetic macular edema using optical coherence tomography angiography [J]. PLoS One, 2021, 16(1): e0244789.
26
Sarao V, Veritti D, Lanzetta P. Automated diabetic retinopathy detection with two different retinal imaging devices using artificial intelligence: a comparison study [J]. Graefes Arch Clin Exp Ophthalmol, 2020, 258(12): 2647-2654.
27
Couturier A, Rey PA, Erginay A, et al. Widefield OCT-angiography and fluorescein angiography assessments of nonperfusion in diabetic retinopathy and edema treated with anti-vascular endothelial growth factor [J]. Ophthalmology, 2019, 126(12): 1685-1694.
28
Gong R, Han R, Guo J, et al. Quantitative evaluation of hard exudates in diabetic macular edema by multicolor imaging and their associations with serum lipid levels [J]. Acta Diabetol, 2021, 58(9): 1161-1167.
29
Hsu MY, Chiou JY, Liu JT, et al. Deep learning for automated diabetic retinopathy screening fused with heterogeneous data from EHRs can lead to earlier referral decisions [J]. Transl Vis Sci Technol, 2021, 10(9): 18.
30
范雯, 王晓玲, 马枭, 等. 基于超广角荧光素眼底血管造影图像行糖尿病视网膜病变分期的多模态深度学习模型研究 [J]. 中华眼底病杂志, 2022, 38(2): 139-145.
31
Hua CH, Kim K, Huynh-The T, et al. Convolutional network with twofold feature augmentation for diabetic retinopathy recognition from multi-modal images [J]. IEEE J Biomed Health Inform, 2021, 25(7): 2686-2697.
32
Nagasawa T, Tabuchi H, Masumoto H, et al. Accuracy of diabetic retinopathy staging with a deep convolutional neural network using ultra-wide-field fundus ophthalmoscopy and optical coherence tomography angiography [J]. J Ophthalmol, 2021, 2021: 6651175.
33
Yannuzzi LA, Shakin JL, Fisher YL, et al. Peripheral retinal detachments and retinal pigment epithelial atrophic tracts secondary to central serous pigment epitheliopathy. 1984 [J]. Retina, 2012, 32 Suppl 1: 1554-1572.
34
Imamura Y, Fujiwara T, Spaide RF. Fundus autofluorescence and visual acuity in central serous chorioretinopathy [J]. Ophthalmology, 2011, 118(4): 700-705.
35
Bujarborua D, Nagpal PN, Deka M. Smokestack leak in central serous chorioretinopathy [J]. Graefes Arch Clin Exp Ophthalmol, 2010, 248(3): 339-351.
36
Xu J, Wan C, Yang W, et al. A novel multi-modal fundus image fusion method for guiding the laser surgery of central serous chorioretinopathy [J]. Math Biosci Eng, 2021, 18(4): 4797-4816.
37
Xu J, Shen J, Jiang Q, et al. Research on the segmentation of biomarker for chronic central serous chorioretinopathy based on multimodal fundus image [J]. Dis Markers, 2021, 2021: 1040675.
38
Abdolrahimzadeh S, Di Pippo M, Ciancimino C, et al. Choroidal vascularity index and choroidal thickness: potential biomarkers in retinitis pigmentosa [J]. Eye (Lond), 2023, 37(9): 1766-1773.
39
Ayton LN, Guymer RH, Luu CD. Choroidal thickness profiles in retinitis pigmentosa [J]. Clin Exp Ophthalmol, 2013, 41(4): 396-403.
40
Jauregui R, Park KS, Duong JK, et al. Quantitative comparison of near-infrared versus short-wave autofluorescence imaging in monitoring progression of retinitis pigmentosa [J]. Am J Ophthalmol, 2018, 194: 120-125.
41
Liu T, Ling C, Hahn L, et al. Prediction of visual impairment in retinitis pigmentosa using deep learning and multimodal fundus images [J]. Br J Ophthalmol, 2023, 107(10): 1484-1489.
42
Yassin SH, Wang Y, Freeman WR, et al. Efficacy and accuracy of artificial intelligence to overlay multimodal images from different optical instruments in patients with retinitis pigmentosa [J]. Clin Exp Ophthalmol, 2023, 51(5): 446-452.
43
Kang EY, Yeung L, Lee YL, et al. A Multimodal imaging-based deep learning model for detecting treatment-requiring retinal vascular diseases: model development and validation study [J]. JMIR Med Inform, 2021, 9(5): e28868.
44
He X, Deng Y, Fang L, et al. Multi-modal retinal image classification with modality-specific attention network [J]. IEEE Trans Med Imaging, 2021, 40(6): 1591-1602.
45
Li X, Jia M, Islam MT, et al. Self-supervised feature learning via exploiting multi-modal data for retinal disease diagnosis [J]. IEEE Trans Med Imaging, 2020, 39(12): 4023-4033.
[1] 郑燕, 朱琳, 宋颖, 后利珠, 赵丹, 董凤林. 多模态超声对亚厘米级伴微钙化乳腺结节良恶性的鉴别诊断价值[J/OL]. 中华医学超声杂志(电子版), 2026, 23(02): 124-131.
[2] 潘辰蕊, 杨冰洁, 沈会明, 王颖彦, 韩佳豪, 李嘉. 多模态超声联合免疫炎症指标预测乳腺癌腋窝淋巴结转移的价值[J/OL]. 中华医学超声杂志(电子版), 2025, 22(10): 969-975.
[3] 袁强, 范慈勃, 韩丽丽, 陈光, 陈纲, 赵锁. 融合病理图像与报告的多模态模型用于乳腺癌预后预测[J/OL]. 中华普外科手术学杂志(电子版), 2026, 20(04): 374-378.
[4] 唐玥, 陈家璐, 覃德龙, 李宗龙, 汤朝晖, 全志伟. 基于AI的多模态影像在肝癌诊治中应用及面临挑战[J/OL]. 中华肝脏外科手术学电子杂志, 2026, 15(01): 4-9.
[5] 邓应连, 李婕, 苗理, 章敏慧, 尹维丹, 张利伟. 早产儿视网膜病变筛查方法的研究进展[J/OL]. 中华眼科医学杂志(电子版), 2026, 16(03): 169-173.
[6] 范罗丹, 和丹, 王羽, 纪田波, 周素洁, 刘江平. 一过性白点综合征多模态检测特征的临床研究[J/OL]. 中华眼科医学杂志(电子版), 2026, 16(01): 28-33.
[7] 王飞, 王忠. 功能神经导航联合术中荧光素钠及术中超声技术在脑转移瘤手术中的应用[J/OL]. 中华神经创伤外科电子杂志, 2026, 12(02): 118-122.
[8] 赵文龙, 刘冬, 达娜, 古力米热, 张经, 木拉地力, 吉文玉. 多模态技术在儿童脑功能区肿瘤切除术中的应用进展[J/OL]. 中华神经创伤外科电子杂志, 2026, 12(01): 45-51.
[9] 汤为, 文海涛, 屈耀铭, 马安东, 黄成燕, 芮琦虹, 蒋春秀, 王显龙. 脑实质内表皮样囊肿影像特征及误判分析[J/OL]. 中华神经创伤外科电子杂志, 2026, 12(01): 39-44.
[10] 顾雨佳, 王晓军, 曹海波, 周林强, 石磊, 于涛, 任峰, 蒋才奇, 卞杰勇. 多模态辅助定位在合并颅骨缺损脑积水脑室-腹腔分流术中的临床应用[J/OL]. 中华神经创伤外科电子杂志, 2026, 12(01): 24-29.
[11] 林嘉琪, 邵雨薇, 栾春亮, 舒晴, 田峻. 多模态生物力学评估在非特异性腰痛临床决策中的研究进展[J/OL]. 中华老年骨科与康复电子杂志, 2026, 12(01): 59-64.
[12] 刘雅玲, 张丽娜. 重症神经:2025[J/OL]. 中华重症医学电子杂志, 2026, 12(02): 118-123.
[13] 张敏洁, 刘艳龙. 多模态影像学检查技术与AI放射组学在诊断输尿管肿瘤中的研究进展[J/OL]. 中华诊断学电子杂志, 2026, 14(02): 133-137.
[14] 徐林, 简讯, 刘道权, 易东, 鄢华. 人工智能在心脑血管内介入诊疗中的应用进展——从单一影像模式到多模态影像融合[J/OL]. 中华脑血管病杂志(电子版), 2026, 20(03): 334-341.
[15] 李媛媛, 马欣, 董静. 缺血性脑血管病患者卵圆孔未闭多模态影像学诊断的研究进展[J/OL]. 中华脑血管病杂志(电子版), 2026, 20(01): 101-106.
阅读次数
全文


摘要


AI


AI小编
你好!我是《中华医学电子期刊资源库》AI小编,有什么可以帮您的吗?