中国科学院机构知识库网格
Chinese Academy of Sciences Institutional Repositories Grid
What makes a successful rebuttal in computer science conferences?: A perspective on social interaction

文献类型:期刊论文

作者Huang, Junjie2,3; Huang, Win-bin4; Bu, Yi4; Cao, Qi2,3; Shen, Huawei2,3; Cheng, Xueqi1
刊名JOURNAL OF INFORMETRICS
出版日期2023-08-01
卷号17期号:3页码:14
关键词Peer review Rebuttal analysis Social network analysis Social interaction Rebuttal strategy Rebuttal success prediction
ISSN号1751-1577
DOI10.1016/j.joi.2023.101427
英文摘要With an exponential increase in submissionsto top-tier Computer Science (CS) conferences, more and more conferences have introduced a rebuttal stage to the conference peer review process. The rebuttal stage can be modeled as social interactions between authors and reviewers. A successful rebuttal often results in an increased review score after the rebuttal stage. In this paper, we con-duct an empirical study to determine the factors contributing to a successful rebuttal using over 3000 papers and 13,000 reviews from ICLR2022, one of the most prestigious computer science conferences. First, we observe a significant difference in review scores before and after the re-buttal stage, which is crucial for paper acceptance. Furthermore, we investigate factors from the reviewer's perspective using signed social network analysis. A notable finding is the increase in balanced network structure after the rebuttal stage. Subsequently, we evaluate several quantifi-able author rebuttal strategies and their effects on review scores. These strategies can help authors in improving their review scores. Finally, we used machine learning models to predict rebuttal success and validated the impact of potential factors analyzed in this paper. Our experiments demonstrate that the utilization of all features proposed in this study can aid in predicting the success of the rebuttal. In summary, this work presents a study on the impact factors of successful rebuttals from both reviewers' and authors' perspectives and lays the foundation for analyzing rebuttals with social network analysis.
资助项目National Natural Science Foundation of China[62102402] ; National Natural Science Foundation of China[U21B2046] ; National Key Ramp;D Program of China[2020AAA0105200] ; Beijing Academy of Artificial Intelligence (BAAI)
WOS研究方向Computer Science ; Information Science & Library Science
语种英语
WOS记录号WOS:001040011200001
出版者ELSEVIER
源URL[http://119.78.100.204/handle/2XEOYT63/21307]  
专题中国科学院计算技术研究所期刊论文_英文
通讯作者Huang, Junjie
作者单位1.Chinese Acad Sci, Inst Comp Technol, CAS Key Lab Network Data Sci & Technol, Beijing, Peoples R China
2.Univ Chinese Acad Sci, Beijing, Peoples R China
3.Chinese Acad Sci, Inst Comp Technol, Data Intelligence Syst Res Ctr, Beijing, Peoples R China
4.Peking Univ, Dept Informat Management, Beijing, Peoples R China
推荐引用方式
GB/T 7714
Huang, Junjie,Huang, Win-bin,Bu, Yi,et al. What makes a successful rebuttal in computer science conferences?: A perspective on social interaction[J]. JOURNAL OF INFORMETRICS,2023,17(3):14.
APA Huang, Junjie,Huang, Win-bin,Bu, Yi,Cao, Qi,Shen, Huawei,&Cheng, Xueqi.(2023).What makes a successful rebuttal in computer science conferences?: A perspective on social interaction.JOURNAL OF INFORMETRICS,17(3),14.
MLA Huang, Junjie,et al."What makes a successful rebuttal in computer science conferences?: A perspective on social interaction".JOURNAL OF INFORMETRICS 17.3(2023):14.

入库方式: OAI收割

来源:计算技术研究所

浏览0
下载0
收藏0
其他版本

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。