|
|
|
| Editing and Processing of Chinese Abstract in Medical Journals Empowered by DeepSeek Technology |
| GUAN Xin1,DING Yiling2,LIN Lin3,ZHANG Shiyue1,CHEN Sihan1,LI Xinwei1,HAN Hongzhi1,LI Xinxin4,XING Xiangyu5,*,ZHANG Haiyang3,* |
1. Editorial Department of Journal of Jilin University (Medicine Edition), Changchun, 130021, China 2. Harbin Normal University, 150025, Harbin China 3. Editorial Office of International Journal of Geriatrics, 130021, Changchun, China 4. Jilin University Library, 130000, Changchun, China 5. Editorial Department of Journal of Clinical Hepatology, 130021, Changchun, China |
|
|
|
|
Abstract This study presents a systematic evaluation of DeepSeek, a cutting-edge Chinese-developed large language model (LLM), focusing on its application in editing and refining Chinese-language abstracts for medical journals. It employed a comprehensive methodology, analyzing 60 medical research abstracts from the Journal of Jilin University (Medical Edition). These texts were processed using DeepSeek-R1, the latest version of the model released in January 2025, which was specifically integrated into Microsoft Word to simulate practical editorial workflows. To ensure methodological rigor, this study implemented a dual evaluation framework combining quantitative metrics with qualitative expert assessments conducted by three senior medical editors with extensive publishing experience. In terms of basic language refinement, the model demonstrated remarkable proficiency, accurately identifying and correcting grammatical errors in 95% of cases compared to benchmarks set by human editors. It performed particularly well in handling complex Chinese sentence structures, including resolving issues with subject-verb agreement, proper comma usage, and logical coherence. Moreover, the model exhibited strong performance in language simplification, reducing wordiness by 44.7% across the test corpus while preserving essential meaning, a capability that could substantially improve the clarity and accessibility of medical research reporting. However, the evaluation also revealed critical limitations that currently restrict DeepSeek's utility for comprehensive medical editing. Notably, the model struggled with domain-specific challenges, achieving only 22.4% accuracy in standardizing domain-specific medical terminology. Several technical factors underlying these limitations were identified. First, the model's training data appears insufficient to comprehensively cover the full spectrum of medical sub-specialties and their evolving terminologies. Second, DeepSeek exhibits constrained ability to contextualize information within the rigorous framework of medical research reporting, occasionally prioritizing linguistic fluency over scientific precision. Third, the analysis suggests that the model has difficulty keeping pace with rapid advancements in medical science, occasionally providing outdated terminology or conceptual frameworks. Despite these limitations, the model's processing speed, approximately 20 times faster than human editors, positions it as a transformative tool for revolutionizing manuscript turnaround times, particularly during periods of high submission volume. Its consistent performance in fundamental language polishing suggests valuable applications for initial manuscript screening and formatting standardization. A tiered editorial workflow is recommended, where DeepSeek handles initial language refinement and formatting, followed by specialized human editors focusing on content validation and scientific accuracy. To maximize future potential of the model, three key development directions are proposed: (1) expanding medical domain-specific training data, particularly for emerging specialties and technologies; (2) developing hybrid models that integrate linguistic analysis with medical knowledge graphs; and (3) creating customizable modules that journals can adapt to their specific stylistic and terminological requirements. These findings.
|
|
Published: 09 July 2025
|
|
Corresponding Authors:
Xiangyu XING,Haiyang ZHANG
|
|
|
|
| 1 |
仲文明, 王迪, 田莎. 生成式人工智能与神经网络机器翻译人工译后编辑效率对比研究[J]. 翻译研究与教学, 2024 (2): 96- 105.
|
| 2 |
李侗桐, 高瑞婧, 田佳. ChatGPT在中文科技期刊摘要文字编辑中的实用性测试与分析[J]. 中国科技期刊研究, 2023, 34 (8): 1014- 1019.
|
| 3 |
宋爽. DeepSeek:很多惊叹,更多惊喜[N]. 人民日报海外版,2025-02-06(2).
|
| 4 |
张明华, 李静怡. 人工智能在科技期刊编辑中的应用前景[J]. 中国科技期刊研究, 2022, 33 (5): 567- 573.
|
| 5 |
黄晓明, 郑雅文. 人工智能辅助编辑系统在科技期刊中的应用研究[J]. 编辑学报, 2023, 35 (4): 412- 418.
|
| 6 |
夏玲, 向晓莉, 李宜蔓, 等. 机器翻译医学论文摘要的现状分析及作者与编辑协同路径研究[J]. 中国科技期刊研究, 2024, 35 (12): 1757- 1766.
|
| 7 |
陈小明. 生成式人工智能技术对医学科技期刊学术生产与出版的影响[J]. 编辑学报, 2023, 35 (S1): 132- 136.
|
| 8 |
庞丽, 王利鹏, 高森, 等. 中文医学科技期刊摘要标准化现状调研与分析[J]. 中国科技期刊研究, 2022, 33 (4): 458- 464.
|
| 9 |
闾海荣, 江瑞, 张学工, 等. DeepSeek与医学大语言模型:技术创新与医疗服务模式重构[J]. 医学信息学杂志, 2025, 46 (2): 1- 7.
|
| 10 |
刘益东. AI科教革命, 从精准考核、主题PI制与教学系统重构开始[J]. 深圳社会科学, 2025, 8 (2): 104- 114.
|
|
|
|