What makes a successful rebuttal in computer science conferences?: A perspective on social interaction
文献类型:期刊论文
作者 | Huang, Junjie2,3; Huang, Win-bin4; Bu, Yi4; Cao, Qi2,3; Shen, Huawei2,3; Cheng, Xueqi1 |
刊名 | JOURNAL OF INFORMETRICS
![]() |
出版日期 | 2023-08-01 |
卷号 | 17期号:3页码:14 |
关键词 | Peer review Rebuttal analysis Social network analysis Social interaction Rebuttal strategy Rebuttal success prediction |
ISSN号 | 1751-1577 |
DOI | 10.1016/j.joi.2023.101427 |
英文摘要 | With an exponential increase in submissionsto top-tier Computer Science (CS) conferences, more and more conferences have introduced a rebuttal stage to the conference peer review process. The rebuttal stage can be modeled as social interactions between authors and reviewers. A successful rebuttal often results in an increased review score after the rebuttal stage. In this paper, we con-duct an empirical study to determine the factors contributing to a successful rebuttal using over 3000 papers and 13,000 reviews from ICLR2022, one of the most prestigious computer science conferences. First, we observe a significant difference in review scores before and after the re-buttal stage, which is crucial for paper acceptance. Furthermore, we investigate factors from the reviewer's perspective using signed social network analysis. A notable finding is the increase in balanced network structure after the rebuttal stage. Subsequently, we evaluate several quantifi-able author rebuttal strategies and their effects on review scores. These strategies can help authors in improving their review scores. Finally, we used machine learning models to predict rebuttal success and validated the impact of potential factors analyzed in this paper. Our experiments demonstrate that the utilization of all features proposed in this study can aid in predicting the success of the rebuttal. In summary, this work presents a study on the impact factors of successful rebuttals from both reviewers' and authors' perspectives and lays the foundation for analyzing rebuttals with social network analysis. |
资助项目 | National Natural Science Foundation of China[62102402] ; National Natural Science Foundation of China[U21B2046] ; National Key Ramp;D Program of China[2020AAA0105200] ; Beijing Academy of Artificial Intelligence (BAAI) |
WOS研究方向 | Computer Science ; Information Science & Library Science |
语种 | 英语 |
WOS记录号 | WOS:001040011200001 |
出版者 | ELSEVIER |
源URL | [http://119.78.100.204/handle/2XEOYT63/21307] ![]() |
专题 | 中国科学院计算技术研究所期刊论文_英文 |
通讯作者 | Huang, Junjie |
作者单位 | 1.Chinese Acad Sci, Inst Comp Technol, CAS Key Lab Network Data Sci & Technol, Beijing, Peoples R China 2.Univ Chinese Acad Sci, Beijing, Peoples R China 3.Chinese Acad Sci, Inst Comp Technol, Data Intelligence Syst Res Ctr, Beijing, Peoples R China 4.Peking Univ, Dept Informat Management, Beijing, Peoples R China |
推荐引用方式 GB/T 7714 | Huang, Junjie,Huang, Win-bin,Bu, Yi,et al. What makes a successful rebuttal in computer science conferences?: A perspective on social interaction[J]. JOURNAL OF INFORMETRICS,2023,17(3):14. |
APA | Huang, Junjie,Huang, Win-bin,Bu, Yi,Cao, Qi,Shen, Huawei,&Cheng, Xueqi.(2023).What makes a successful rebuttal in computer science conferences?: A perspective on social interaction.JOURNAL OF INFORMETRICS,17(3),14. |
MLA | Huang, Junjie,et al."What makes a successful rebuttal in computer science conferences?: A perspective on social interaction".JOURNAL OF INFORMETRICS 17.3(2023):14. |
入库方式: OAI收割
来源:计算技术研究所
浏览0
下载0
收藏0
其他版本
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。