Evaluating alignment of behavioral dispositions in LLMs
Research paper
Google Research introduces a systematic evaluation framework that converts psychological questionnaires into situational judgment tests to measure how closely LLMs' behavioral dispositions align with human consensus.
Analysis of 25 LLMs reveals gaps where model behavior deviates from human agreement or fails to capture the range of human opinions.