AI rolls out a new track! The world's first multimodal AI endoscopic agent was unveiled
Updated on: 01-0-0 0:0:0

Youth Daily Youth Shanghai Reporter Gu Jinhua/Wen Changxin/Photo

他是为患者解读内镜报告的“秒懂通译官”,是辅助医生并预警风险的“手术智囊伙伴”,还是会“思考”懂“调度”的“科室大管家”……4月12日,集这三重“身份”为一身的全球首个基于多模态大模型驱动的消化内镜全场景智能体“镜观”,在2025上海消化内镜学术大会上正式亮相。

Don't underestimate this AI endoscopic agent! In addition to one-on-one detailed interpretation of the report and answering questions, the first identity of "Mirror View" is the patient's personal medical consultant, and it can also deeply interpret the disease-related situation through the knowledge graph and special disease database, so as to further realize the functions of prevention science popularization and health promotion. Its second identity is the doctor's "surgical think tank partner", and the doctor can obtain real-time lesion analysis during surgery through the eye movement and voice interaction functions carried by the "mirror view". At the same time, the system can also automatically generate structured reports, so doctors only need to check and fill in the gaps and make final confirmations, and the paperwork time can be reduced to at least 50%. The system is also equipped with a diagnosis and treatment standard library, which can intelligently warn of operational risks and provide real-time guidance for grassroots doctors.

The system is developed based on the domestic AI computing platform, and the data resource integration and intelligent analysis are carried out through the "management cockpit" to achieve precise regulation and control of department operation. In terms of security, the security architecture of "data is not discharged" has been achieved, which also enables the system to be quickly deployed in grassroots hospitals.

In the next three years, the platform plans to access 2000 medical institutions across the country and train 0 grassroots doctors to help achieve the equalization of medical resources and the universalization of diagnosis and treatment capabilities. With the implementation of the "Mirror View" ecological alliance, a new model of smart medical care that is patient-centered, data-driven, and technology-supported is taking shape at an accelerated pace.

据悉,4月11-13日,由复旦大学附属中山医院主办的“2025上海消化内镜学术大会暨第十七届中日ESD论坛”在上海国际会议中心召开。作为亚太地区最具影响力的消化内镜盛会,本届大会以“智镜无界·共塑健康未来”为主题,汇聚了全球超5000名专家学者,通过17个分论坛、90场主题报告及全天候手术直播,展现消化内镜从“超级微创”到“数字智能”的跨时代跃迁。

At the conference, the "Mirror View" agent jointly developed by Zhongshan Hospital affiliated to Fudan University was officially released. According to reports, "Endoscopy" is the world's first full-scene intelligent body of digestive endoscopy that deeply integrates big data, AI technology and medical resources, through the integration of more than one million endoscopic images, the construction of a multi-modal basic model of digestive endoscopy, and relying on domestic independent AI chips to achieve the safe deployment of the hospital end-side, forming a complete intelligent chain of "perception-decision-execution-evolution".

For the first time, the conference also cooperated with Endoscopy on Air, the world's largest endoscopy video teaching platform, through which the team of Professor Zhou Pinghong from the Endoscopy Center of Zhongshan Hospital broadcast 6 difficult surgeries to Europe and the United States in real time. This cooperation not only provides a valuable opportunity for overseas medical colleagues to observe China's endoscopic surgery technology, but also becomes an important window to show China's medical level.

不久前在西班牙巴塞罗那举行的欧洲消化内镜协会年会上,复旦大学附属中山医院内镜中心周平红教授、蔡明琰副主任医师团队历经7年自主研发的“一次性使用电圈套切开刀”荣获2025年新器械创新奖。

During the R&D process, the team and engineers repeatedly ran in to improve the design, completed the pre-market clinical research with multiple centers across the country, and finally obtained the EU certification and the domestic medical device registration certificate. The product can significantly simplify the endoscopic mucosal dissection (ESD) process, reduce the number of instrument exchanges, and significantly reduce the cost of treatment while ensuring safe and effective surgery. Prof. Lorenzo Fuccio, Chairman of the ESGE Research Committee, said at the award ceremony: "This device is revolutionary and will significantly reduce the cost of a wide range of endoscopic procedures, and its clinical application is expected to be further expanded. He is particularly looking forward to the Chinese team working with European doctors to carry out follow-up clinical studies.

值得一提的是,中山医院内镜中心在过去近二十年始终引领国际内镜微创诊疗发展,培养了大批来自欧美、非洲等地的医师。本次大会上,来自葡萄牙、埃及、西班牙等国的“中山学徒”纷纷展示高质量研究成果并进行手术演示,他们特别感谢中山医院的培养对其职业生涯的重要影响。

[Source: Youth Daily]