Home

Citation: Lu Wang, Genzi Li, Yafei Dai, Xuefeng Fu. On Information Fusion by Fuzzy Sets for Decision Making in Peer Review[J]. Acta Physico-Chimica Sinica, ;2023, 39(3): 221002. doi: 10.3866/PKU.WHXB202210029 shu

On Information Fusion by Fuzzy Sets for Decision Making in Peer Review

Lu Wang ^{1, 2} ,
Genzi Li ³ ,
Yafei Dai ¹ ,
Xuefeng Fu ^1,,

1.
National Natural Science Foundation of China, Beijing 100085, China
2.
Institute of Functional Nano & Soft Materials (FUNSOM), Soochow University, Suzhou 215123, Jiangsu Province, China
3.
Yanqi Lake Institute of Basic Manufacturing Technology (Beijing) Co., Ltd., Beijing 101407, China

Corresponding author: Xuefeng Fu, fuxf@nsfc.gov.cn
Received Date: 21 October 2022
Accepted Date: 24 October 2022
Available Online: 27 October 2022

Peer review plays a crucial role in quality insurance of projects, especially for natural science projects, in evaluation or assessment activities. However, the results of assessment by reviewers for a proposal may scatter due to the intrinsic fuzzy attributes in the peer review process. Specifically, it may introduce a review bias with razor-thin margins in the conversion of descriptive opinions into quantified scores. The accumulation of the bias might cause overturning in the results of evaluation, leading proposals toward a twilight zone between approval and rejection. Here, a novel approach to handling scores in evaluation is presented to address the ambiguity of brink in a tight competition, whereby correlation information from multiple sources could be merged to improve the degree of consensus among reviewers for each proposal according to its essential value. This method may provide an alternate evaluation mechanism for proposal reviews and help tackle the challenges in decision intelligence.
- Peer review,
- Fuzzy sets,
- Consensus
1. [1]
  Wade, N. Science 1973, 179 (4069), 158. doi: 10.1126/science.179.4069.158 doi: 10.1126/science.179.4069.158
2. [2]
  Maclane, S. Science 1975, 190 (4215), 617. doi: 10.1126/science.190.4215.61 doi: 10.1126/science.190.4215.61
3. [3]
  Scott, A. Futures 2007, 39 (7), 827. doi: 10.1016/j.futures.2006.12.009 doi: 10.1016/j.futures.2006.12.009
4. [4]
  Rosenthal, R. Behav. Brain Sci. 1982, 5 (2), 235. doi: 10.1017/S0140525X00011614 doi: 10.1017/S0140525X00011614
5. [5]
  Blackburn, J. L. HakelM, D. Psychol. Sci. 2006, 17 (5), 378. doi: 10.1111/j.1467-9280.2006.01715.x doi: 10.1111/j.1467-9280.2006.01715.x
6. [6]
  Lee, C. J.; Sugimoto, C. R.; Zhang, G.; Cronin, B. J. Association Inf. Sci. Technol. 2013, 64 (1), 2. doi: 10.1002/asi.22784 doi: 10.1002/asi.22784
7. [7]
  Fu, X. F.; Dai, Y. F.; Huang, Y.; Cui, L.; Chen, Y. J. Acta Phys. -Chim. Sin. 2020, 36 (8), 2004048. doi: 10.3866/PKU.WHXB202004048
8. [8]
  Zadeh, L. A. Inf. Control 1965, 8 (3), 338. doi: 10.1016/S0019-9958(65)90241-X doi: 10.1016/S0019-9958(65)90241-X
9. [9]
  Zadeh, L. A. Inf. Sci. 1975, 8 (3), 199. doi: 10.1016/0020-0255(75)90036-5 doi: 10.1016/0020-0255(75)90036-5
10. [10]
  Zadeh, L. A. Inf. Sci. 1975, 8 (4), 301. doi: 10.1016/0020-0255(75)90046-8 doi: 10.1016/0020-0255(75)90046-8
11. [11]
  Chakraborty, S.; YehC, H. A Simulation based Comparative Study of Normalization Procedures in Multiattribute Decision Making. Proceedings of the 6th WSEAS International Conference on Artificial Intelligence, Knowledge Engineering and Data Bases, Corfu Island, Greece, World Scientific and Engineering Academy and Society (WSEAS), 2007.
12. [12]
  Rust, J.; Golombok, S. Modern Psychometrics: The Science of Psychological Assessment, 3rd ed.; Routledge: New York, NY, USA, 2009.
13. [13]
  Marsh, H. W.; Jayasinghe, U. W.; Bond, N. W. Am. Psychol. 2008, 63 (3), 160. doi: 10.1037/0003-066X.63.3.160 doi: 10.1037/0003-066X.63.3.160
14. [14]
  Vehtari, A.; Gelman, A.; Gabry, J. Statist. Comput. 2017, 27 (5), 1413. doi: 10.1007/s11222-016-9696-4 doi: 10.1007/s11222-016-9696-4
15. [15]
  Geisser, S. J. Am. Statist. Association 1975, 70 (350), 320. doi: 10.1080/01621459.1975.10479865 doi: 10.1080/01621459.1975.10479865
1. [1]
  Yahui Ma , Leiyang Lv . Pears on the Journey of Fruits. University Chemistry, 2024, 39(9): 64-73. doi: 10.12461/PKU.DXHX202404029
2. [2]
  Lihong Niu , Huaping Xu , Ying Yu . Synergizing Ideological and Political Education with Professional Education: Overcoming Challenges in Cultivating Innovative Talents in Basic Sciences under New Circumstances. University Chemistry, 2024, 39(6): 7-11. doi: 10.3866/PKU.DXHX202311090

Get Citation

PDF

XML

Metrics

PDF Downloads(8)
Abstract views(578)
HTML views(72)

通讯作者: 陈斌, bchen63@163.com

1.
沈阳化工大学材料科学与工程学院沈阳 110142

Address：Zhongguancun North First Street 2,100190 Beijing, PR China Tel: +86-010-82449177-888

DownLoad: Full-Size Img PowerPoint

Return