基于模糊集合的评审决策信息融合

引用本文: 王璐, 李根梓, 戴亚飞, 付雪峰. 基于模糊集合的评审决策信息融合[J]. 物理化学学报, 2023, 39(3): 221002. doi: 10.3866/PKU.WHXB202210029 shu

Citation: Lu Wang, Genzi Li, Yafei Dai, Xuefeng Fu. On Information Fusion by Fuzzy Sets for Decision Making in Peer Review[J]. Acta Physico-Chimica Sinica, 2023, 39(3): 221002. doi: 10.3866/PKU.WHXB202210029 shu

基于模糊集合的评审决策信息融合

王璐 ^{1, 2,} ,
李根梓 ^3, ,
戴亚飞 ^1, ,
付雪峰 ^{1,
,}

1.
国家自然科学基金委员会, 北京 100085
2.
苏州大学功能纳米与软物质研究院, 江苏苏州 215123
3.
雁栖湖基础制造技术研究院(北京)有限公司, 北京 101407

通讯作者: 付雪峰, fuxf@nsfc.gov.cn

摘要: 同行评议是评价、评审和评估等活动的重要实施方式，尤其对于科学基金项目的评审，同行评议是保证项目质量的有效措施。同行评议过程中固有的模糊属性，会导致评审结果在一定程度上偏离被评价对象的内在价值。本文针对同行评议的模糊属性，提出一种评审决策信息融合的方法，通过对专家评分进行关联分析和自适应调整，实现评审结果围绕被评价对象的内在价值等关键指标达成共识，助力科学基金的评审机制改革和评审决策的智能化。

关键词:

同行评议
/ 模糊集合
/ 共识

English

On Information Fusion by Fuzzy Sets for Decision Making in Peer Review

Lu Wang ^{1, 2,} ,
Genzi Li ^3, ,
Yafei Dai ^1, ,
Xuefeng Fu ^{1,
,}

1.
National Natural Science Foundation of China, Beijing 100085, China
2.
Institute of Functional Nano & Soft Materials (FUNSOM), Soochow University, Suzhou 215123, Jiangsu Province, China
3.
Yanqi Lake Institute of Basic Manufacturing Technology (Beijing) Co., Ltd., Beijing 101407, China

Corresponding author: Xuefeng Fu, Email: fuxf@nsfc.gov.cn

Received Date: 21 October 2022
Accepted Date: 24 October 2022
Available Online: 15 March 2023

Abstract: Peer review plays a crucial role in quality insurance of projects, especially for natural science projects, in evaluation or assessment activities. However, the results of assessment by reviewers for a proposal may scatter due to the intrinsic fuzzy attributes in the peer review process. Specifically, it may introduce a review bias with razor-thin margins in the conversion of descriptive opinions into quantified scores. The accumulation of the bias might cause overturning in the results of evaluation, leading proposals toward a twilight zone between approval and rejection. Here, a novel approach to handling scores in evaluation is presented to address the ambiguity of brink in a tight competition, whereby correlation information from multiple sources could be merged to improve the degree of consensus among reviewers for each proposal according to its essential value. This method may provide an alternate evaluation mechanism for proposal reviews and help tackle the challenges in decision intelligence.

Key words:

Peer review
/ Fuzzy sets
/ Consensus

1. [1]
  Wade, N. Science 1973, 179 (4069), 158. doi: 10.1126/science.179.4069.158
2. [2]
  Maclane, S. Science 1975, 190 (4215), 617. doi: 10.1126/science.190.4215.61
3. [3]
  Scott, A. Futures 2007, 39 (7), 827. doi: 10.1016/j.futures.2006.12.009
4. [4]
  Rosenthal, R. Behav. Brain Sci. 1982, 5 (2), 235. doi: 10.1017/S0140525X00011614
5. [5]
  Blackburn, J. L. HakelM, D. Psychol. Sci. 2006, 17 (5), 378. doi: 10.1111/j.1467-9280.2006.01715.x
6. [6]
  Lee, C. J.; Sugimoto, C. R.; Zhang, G.; Cronin, B. J. Association Inf. Sci. Technol. 2013, 64 (1), 2. doi: 10.1002/asi.22784
7. [7]
  付雪峰, 戴亚飞, 黄艳, 崔琳, 陈拥军. 物理化学学报, 2020, 36 (8), 2004048. doi: 10.3866/PKU.WHXB202004048Fu, X. F.; Dai, Y. F.; Huang, Y.; Cui, L.; Chen, Y. J. Acta Phys. -Chim. Sin. 2020, 36 (8), 2004048. doi: 10.3866/PKU.WHXB202004048
8. [8]
  Zadeh, L. A. Inf. Control 1965, 8 (3), 338. doi: 10.1016/S0019-9958(65)90241-X
9. [9]
  Zadeh, L. A. Inf. Sci. 1975, 8 (3), 199. doi: 10.1016/0020-0255(75)90036-5
10. [10]
  Zadeh, L. A. Inf. Sci. 1975, 8 (4), 301. doi: 10.1016/0020-0255(75)90046-8
11. [11]
  Chakraborty, S.; YehC, H. A Simulation based Comparative Study of Normalization Procedures in Multiattribute Decision Making. Proceedings of the 6th WSEAS International Conference on Artificial Intelligence, Knowledge Engineering and Data Bases, Corfu Island, Greece, World Scientific and Engineering Academy and Society (WSEAS), 2007.
12. [12]
  Rust, J.; Golombok, S. Modern Psychometrics: The Science of Psychological Assessment, 3rd ed.; Routledge: New York, NY, USA, 2009.
13. [13]
  Marsh, H. W.; Jayasinghe, U. W.; Bond, N. W. Am. Psychol. 2008, 63 (3), 160. doi: 10.1037/0003-066X.63.3.160
14. [14]
  Vehtari, A.; Gelman, A.; Gabry, J. Statist. Comput. 2017, 27 (5), 1413. doi: 10.1007/s11222-016-9696-4
15. [15]
  Geisser, S. J. Am. Statist. Association 1975, 70 (350), 320. doi: 10.1080/01621459.1975.10479865

扫一扫看文章

计量

PDF下载量: 8
文章访问数: 855
HTML全文浏览量: 92

通讯作者: 陈斌, bchen63@163.com

1.
沈阳化工大学材料科学与工程学院沈阳 110142

基于模糊集合的评审决策信息融合

通讯作者: 付雪峰, fuxf@nsfc.gov.cn

English

On Information Fusion by Fuzzy Sets for Decision Making in Peer Review

Corresponding author: Xuefeng Fu, Email: fuxf@nsfc.gov.cn

CCS Chemistry：嵌段共聚物自组装成 “三明治”二维有机材料，实现纳米级压力传感功能

CCS Chemistry：颜徐州、鲍哲南：你的皮肤可能是一片SPMs

CCS Chemistry：工作高效不疲劳，只须让催化剂动起来

CCS Chemistry：静电组装导向聚合- 聚电解质纳米凝胶量化制备新策略

CCS Chemistry：金黄色葡萄球菌醛基脱氢酶是如何识别特异性底物的？

计量

通讯作者: 陈斌, bchen63@163.com

中国化学会秘书处

基于模糊集合的评审决策信息融合

通讯作者: 付雪峰, fuxf@nsfc.gov.cn

English

On Information Fusion by Fuzzy Sets for Decision Making in Peer Review

Corresponding author: Xuefeng Fu, Email: fuxf@nsfc.gov.cn

CCS Chemistry：嵌段共聚物自组装成 “三明治”二维有机材料，实现纳米级压力传感功能

CCS Chemistry：颜徐州、鲍哲南： 你的皮肤可能是一片SPMs

CCS Chemistry：工作高效不疲劳，只须让催化剂动起来

CCS Chemistry：静电组装导向聚合- 聚电解质纳米凝胶量化制备新策略

CCS Chemistry：金黄色葡萄球菌醛基脱氢酶是如何识别特异性底物的？

计量

文章相关

通讯作者: 陈斌, bchen63@163.com

中国化学会秘书处

CCS Chemistry：颜徐州、鲍哲南：你的皮肤可能是一片SPMs