中国科学院机构知识库网格
Chinese Academy of Sciences Institutional Repositories Grid
LLM Plus Machine Learning Outperform Expert Rating to Predict Life Satisfaction from Self-Statement Text

文献类型:期刊论文

作者Huang,Feng3,4,5; Sun,Xia4,5; Mei,Aizhu4,5; Wang,Yilin2,4,5; Din,Huimin1; Zhu,Tingshao4,5
刊名IEEE Transactions on Computational Social Systems
出版日期2024
通讯作者邮箱zhuts@psych.ac.cn
DOI10.1109/TCSS.2024.3475413
文献子类综述
英文摘要

This study explores an innovative approach to predicting individual life satisfaction by combining large language models (LLMs) with machine learning (ML) techniques. Traditional life satisfaction assessments rely on self-report questionnaires, which can be time-consuming and resource intensive. To address these limitations, we developed a method that utilizes LLMs for feature extraction from open-ended self-statement texts, followed by ML prediction. We compared this approach with standalone LLM predictions and expert ratings. A sample of 378 participants completed the satisfaction with life scale (SWLS) and wrote self-statements about their current life situation. The LLM-based ML model, using a LightGBM regressor, achieved a correlation of 0.542 with self-reported SWLS scores, outperforming both the standalone LLM (r = 0.491) and expert ratings (r = 0.455). Effect size analysis revealed a statistically significant moderate effect size difference between the LLM-based ML model and expert ratings (Cohen's d = 0.499, 95% CI [0.043, 0.955]). These findings demonstrate the potential of integrating LLM and ML for an efficient and accurate assessment of life satisfaction, challenging conventional methods, and opening new avenues for psychological measurement. The study's implications extend to research, clinical practice, and policymaking, offering promising advancements in AI-assisted psychological assessment.

收录类别EI
语种英语
源URL[http://ir.psych.ac.cn/handle/311026/49080]  
专题心理研究所_中国科学院行为科学重点实验室
作者单位1.Renmin University of China, School of Education, Beijing; 100872, China
2.University of California San Diego, Department of Psychology, San Diego; CA; 92093, United States
3.City University of Hong Kong, Department of Data Science, College of Computing, Hong Kong; 999077, Hong Kong
4.University of Chinese Academy of Sciences, Department of Psychology, Beijing; 100049, China
5.Chinese Academy of Sciences, CAS Key Laboratory of Behavioral Science, Institute of Psychology, Beijing; 100101, China
推荐引用方式
GB/T 7714
Huang,Feng,Sun,Xia,Mei,Aizhu,et al. LLM Plus Machine Learning Outperform Expert Rating to Predict Life Satisfaction from Self-Statement Text[J]. IEEE Transactions on Computational Social Systems,2024.
APA Huang,Feng,Sun,Xia,Mei,Aizhu,Wang,Yilin,Din,Huimin,&Zhu,Tingshao.(2024).LLM Plus Machine Learning Outperform Expert Rating to Predict Life Satisfaction from Self-Statement Text.IEEE Transactions on Computational Social Systems.
MLA Huang,Feng,et al."LLM Plus Machine Learning Outperform Expert Rating to Predict Life Satisfaction from Self-Statement Text".IEEE Transactions on Computational Social Systems (2024).

入库方式: OAI收割

来源:心理研究所

浏览0
下载0
收藏0
其他版本

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。