[10/17/2024] LLMs for psychological assessment

• Sokratous, K., Fitch, A. K., Hintze, A., & Kvam, P. (2024). Machine learning tools for discovering the latent structure of behavioral data.

• Suh, J., Moon, S., Kang, M., & Chan, D. M. (2024). Rediscovering the Latent Dimensions of Personality with Large Language Models as Trait Descriptors. arXiv preprint arXiv:2409.09905.

• Peters, H., Cerf, M., & Matz, S. C. (2024). Large Language Models Can Infer Personality from Free-Form User Interactions. arXiv preprint arXiv:2405.13052.

• Wang, P., Zou, H., Yan, Z., Guo, F., Sun, T., Xiao, Z., & Zhang, B. (2024, September 23). Not Yet: Large Language Models Cannot Replace Human Respondents for Psychometric Research. https://doi.org/10.31219/osf.io/rwy9b

• Maeda, H. (2024). Field-Testing Multiple-Choice Questions With AI Examinees: English Grammar Items. Educational and Psychological Measurement, 00131644241281053.

• Peereboom, S., Schwabe, I., & Kleinberg, B. (2024). Cognitive phantoms in LLMs through the lens of latent variables. arXiv preprint arXiv:2409.15324.

• Zhang, S., Xu, J., & Alvero, A. J. (2024). Generative AI Meets Open-Ended Survey Responses: Participant Use of AI and Homogenization.

• Huang, J. T., Wang, W., Lam, M. H., Li, E. J., Jiao, W., & Lyu, M. R. (2023). Revisiting the Reliability of Psychological Scales on Large Language Models. arXiv e-prints, arXiv-2305.

• Liu, Y., Bhandari, S., & Pardos, Z. A. (2024). Leveraging LLM-Respondents for Item Evaluation: a Psychometric Analysis. arXiv preprint arXiv:2407.10899.

• Cui, Z., Li, N., & Zhou, H. (2024). Can AI Replace Human Subjects? A Large-Scale Replication of Psychological Experiments with LLMs. arXiv preprint arXiv:2409.00128.

• Lehr, S. A., Caliskan, A., Liyanage, S., & Banaji, M. R. (2024). ChatGPT as Research Scientist: Probing GPT’s capabilities as a Research Librarian, Research Ethicist, Data Generator, and Data Predictor. Proceedings of the National Academy of Sciences, 121(35), e2404328121.

• Herderich, A., Lasser, J., Aroyehun, S., Garcia, D., Galesic, M., & Garland, J. Measuring complex psychological and sociological constructs in large-scale text.

• Herderich, A., Freudenthaler, H. H., & Garcia, D. (2024). A computational method to reveal psychological constructs from text data. Psychological Methods.

• Laverghetta Jr, A., Luchini, S., Linell, A., Reiter-Palmon, R., & Beaty, R. (2024). The creative psychometric item generator: a framework for item generation and validation using large language models. arXiv preprint arXiv:2409.00202.