|
|
|
| An Empirical Study on Impact Evaluation System for Policy-Oriented Financial Journals |
| ZHANG Wei,QIN Ting,BAI Haochen |
| Editorial Department of Tsinghua Financial Review, PBC School of Finance, Tsinghua University, 100084, Beijing, China |
|
|
|
|
Abstract Policy-oriented financial journals serve as critical platforms for disseminating financial policies and facilitating interdisciplinary exchanges. However, the absence of a systematic, domain-specific evaluation framework has long constrained their development. This deficiency hinders both the objective assessment of their societal contributions and strategic improvements in content quality and reader engagement. Addressing this gap, this study develops a comprehensive multidimensional evaluation system specifically designed for policy-oriented financial journals, aiming to provide a robust methodological foundation for assessing their impact and guiding their future development. The proposed evaluation system encompasses five core dimensions that collectively capture the unique characteristics and societal value of policy-oriented financial journals. The first dimension, policy influence, evaluates journals' alignment with national strategic priorities and their engagement with policymakers. Brand influence assesses institutional recognition and citation-based metrics that reflect academic prestige. Practical influence examines the extent of industry adoption and the relevance of published case studies to real-world applications. International influence measures cross-border collaboration patterns and the proportion of non-Chinese contributing authors. Finally, social influence quantifies contributions to public discourse through media visibility and public engagement metrics. These five primary dimensions are operationalized through 20 quantifiable secondary indicators, establishing a comprehensive and balanced assessment framework. Methodologically, this study employs a sophisticated mixed-methods approach that combines bibliometric analysis, expert surveys, and advanced semantic mining techniques applied to policy texts. The research analyzes data from a diverse sample of 84 domestic and international financial journals published in 2023, ensuring broad representation across different types of policy-oriented publications. The empirical findings reveal significant heterogeneity in influence patterns among journals. Domestically oriented journals demonstrate superior performance in policy alignment metrics, reflecting their closer connection to national policy priorities. In contrast, internationally focused journals exhibit stronger performance in cross-border collaboration indicators, highlighting their global networking advantages. The study identifies several critical pathways for enhancing journal impact, including the optimization of policy-practice synergy mechanisms and the strategic utilization of digital media platforms to expand dissemination channels and audience reach. The development of this refined, evidence-based evaluation tool represents a significant advancement in the field. It provides practical solutions for journals to overcome developmental bottlenecks and contributes to theoretical discussions about differentiated evaluation systems in academic publishing. The findings offer valuable, actionable insights for various stakeholders in the academic publishing ecosystem, including journal editors seeking to enhance their publication's impact, policymakers interested in evidence-based policy dissemination, and indexing bodies responsible for developing fair and inclusive evaluation standards. This research advances the establishment of a more equitable and effective ecosystem for policy-relevant academic communication while supporting the ongoing refinement of China's categorized journal evaluation framework. The proposed multidimensional approach addresses current limitations in journal assessment methodologies and provides a foundation for future research in this important area of academic publishing.
|
|
Published: 19 August 2025
|
|
|
|
| 一级指标 | 二级指标 | 收集与计算方法 | 政策影响力 (Ca) (0.5) | 政策类文献数量占比(C1)(0.1) | 基于中国知网手动收集样本期刊2023年全年刊发的政策类文章数量,与总发文量相比得出 | | 前瞻性政策文章占比(C2)(0.1) | 收集2023年金融政策文件,提取每项政策的关键词。以政策发布日期为界,基于中国知网手动统计样本期刊在政策出台前(2023年1月1日至发布日)发表的所有含政策关键词的文章数,与总发文量相比得出 | | 后顾性政策文章占比(C3)(0.1) | 基于2023年金融政策文件及其关键词库,基于中国知网手动统计样本期刊在政策出台后(发布日至2023年12月31日)发表的所有含政策关键词的文章数,与总发文量相比得出 | | 政策相关者署名文献数量占比(C4)(0.1) | 基于中国知网手动统计样本期刊2023年政策相关者署名文章数,与总发文量相比得出 | | 主要发文机构中监管机构占比(C5)(0.05) | 基于中国知网内置发文机构数据,手动统计样本期刊2023年排名前10的发文机构,得出其中监管机构占比 | | 办刊机构属性(C6)(0.05) | 手动统计样本期刊办刊机构类型并按照下列标准赋分:监管单位、学会、行业协会—3;高校—2;金融机构等其他—1 | 品牌影响力 (Cb) (0.21) | 核心期刊(C7)(0.03) | 基于中国知网手动核对样本期刊是否属于CSSCI、中文核心、AMI核心 | | 基金资助文献量(C8)(0.01) | 中国知网期刊2023年基金资助文献量数据 | | 全媒体渠道(C9)(0.05) | 手动核对样本期刊是否开设微信公众号、今日头条、抖音、微博平台账户 | | 品牌美誉度(C10)(0.10) | 向8位专家组专业人士发送AHP层次分析问卷,利用平均数得出 | | 品牌搜索量(C11)(0.02) | 使用Python 3.9编程语言及第三方库pytrends(版本5.0.0)统计样本期刊百度词条搜索量 | 实践影响力 (Cc) (0.15) | 发文量(C12)(0.04) | 基于中国知网统计样本期刊2023年发文量数据 | | 下载量(C13)(0.04) | 基于中国知网统计样本期刊2023年下载量数据 | | 会议活动(C14)(0.07) | 基于百度搜索、微信公众号统计前10页样本期刊2023年会议、活动次数 | 国际影响力 (Cd) (0.09) | 双语出版(C15)(0.01) | 中国知网JTP双语出版样本期刊情况 | | 国际引用(C16)(0.02) | 中国知网2023年国际引用次数数据 | | 国际编委(C17)(0.02) | 样本期刊2023年版权页编委名单外籍编委数量情况 | | 国际作者(C18)(0.04) | 基于中国知网统计2023年样本期刊外籍作者数量 | 社会影响力 (Ce) (0.05) | 社会责任文章数量(C19)(0.03) | 基于中国知网统计2023年样本期刊社会责任关键词(如ESG、公司治理)文章数量 | | 社会责任文章下载量(C20)(0.02) | 基于中国知网统计2023年样本期刊社会责任文章下载量 |
|
|
|
| | | 期刊名称 | 总分 | 政策影响力 | 品牌影响力 | 实践影响力 | 国际影响力 | 社会影响力 | | 中国金融 | 0.594 | 0.311 | 0.153 | 0.072 | 0.020 | 0.037 | | 清华金融评论 | 0.557 | 0.299 | 0.145 | 0.088 | 0.016 | 0.009 | | 中国外汇 | 0.448 | 0.282 | 0.099 | 0.041 | 0.020 | 0.006 | | 银行家 | 0.431 | 0.235 | 0.093 | 0.092 | 0.000 | 0.012 | | 中国农村金融 | 0.412 | 0.216 | 0.112 | 0.069 | 0.000 | 0.014 | | 金融研究 | 0.330 | 0.097 | 0.154 | 0.053 | 0.000 | 0.025 | | 债券 | 0.302 | 0.178 | 0.066 | 0.043 | 0.002 | 0.012 | | 农村金融研究 | 0.300 | 0.168 | 0.091 | 0.037 | 0.003 | 0.002 | | 中国外资 | 0.292 | 0.180 | 0.050 | 0.034 | 0.001 | 0.027 | | 金融发展研究 | 0.285 | 0.153 | 0.098 | 0.020 | 0.014 | 0.001 |
|
|
|
| 指标 | 峰度 | 偏度 | 均值 | 中位数 | | 政策影响力 | 1.783 | 1.129 | 0.114 | 0.104 | | 品牌影响力 | -1.110 | 0.577 | 0.067 | 0.062 | | 实践影响力 | 4.176 | 1.758 | 0.024 | 0.021 | | 国际影响力 | 1.122 | 1.542 | 0.005 | 0.001 | | 社会影响力 | 1.363 | 1.245 | 0.009 | 0.006 |
|
|
|
| 1 |
中共中央宣传部教育部科技部印发《关于推动学术期刊繁荣发展的意见》的通知[EB/OL].(2021-06-23)[2025-06-20]. https://www.nppa.gov.cn/xxfb/zcfg/gfxwj/202106/t20210623_4514.html.
|
| 2 |
教育部办公厅关于开展清理“唯论文、唯帽子、唯职称、唯学历、唯奖项”专项行动的通知[EB/OL].(2018-12-31)[2025-06-20]. https://www.gov.cn/zhengce/zhengceku/2018-12/31/content_5441533.htm.
|
| 3 |
赵蓉英, 王旭. 国际OA期刊影响力评价与比较[J]. 情报资料工作, 2019 (2): 5- 13.
|
| 4 |
赵蓉英, 王旭. 多维视角下学术期刊影响力评价研究[J]. 情报科学, 2019 (11): 3- 10.
|
| 5 |
丁红艺, 董伟. 科技期刊社会责任治理存在问题及对策研究[J]. 学报编辑论丛, 2024, 742- 749.
|
| [1] |
ZHANG Huan,SUN Hong,QI Dexiang. Evaluating International Communication Effectiveness of Chinese Online Games: Principles, Methods, and Indicator Systems[J]. Science-Technology & Publication, 2025, 44(6): 52-63. |
| [2] |
JIANG Chengcheng,HAN Jianmin,FU Yu. Reflections on the Construction of Evaluation System for Themed-Publishing in the New Era[J]. Science-Technology & Publication, 2025, 44(6): 113-121. |
| [3] |
LIN Runhua,ZHU Yehua,LIU Zhiyuan,LI Na. Determinants of Comprehensive Scientific and Technological Journals' Impact: A Study and Its Implications[J]. Science-Technology & Publication, 2025, 44(5): 51-59. |
| [4] |
LIU Zhiqiang,WANG Jing,ZHANG Fangying,WU Lingye,ZHANG Tieming,ZHANG Xin. Policy-Guided and Innovation-Driven Development: Review and Prospect of Chinese-language STM Journals in 2024[J]. Science-Technology & Publication, 2025, 44(3): 66-77. |
|
|
|
|