Psychological questionnaires for LLM disposition evaluation
Standardized measures for assessing personality traits, adapted for LLM behavioral alignment studies.
Standardized, scientifically validated psychological questionnaires
Assessing personality traits and behavioral dispositions. Examples include IRI (empathy) and ERQ (emotion regulation), used to ground LLM Situational Judgment Tests in established psychometric validity.
Use established, scientifically validated psychological questionnaires like IRI and ERQ as a foundation for evaluating LLM behavioral dispositions. These instruments provide a reliable basis for creating LLM assessment scenarios.
Grounding LLM evaluations in peer-reviewed psychological instruments ensures that the traits being measured are well-defined and reliably assessed, providing a strong scientific basis for understanding model behavior.
- Evaluating alignment of behavioral dispositions in LLMs ↗Google Research · Google Research Blog · Apr 3, 2026 · paraphrased
First seen on Subvolts Apr 3, 2026. Updated Sep 11, 2026. Spotted a problem? Tell us.
- Evaluating alignment of behavioral dispositions in LLMsGoogle · Google Research Blog · Apr 3, 2026
The Playbook: reusable how-tos, prompts, configs and tips pulled out of the news.
- HeuristicMitigate alignment tax with mixed data fine-tuningMix original pre-training data into RL fine-tuning to reduce performance drops on academic tasks. · 10 min
- HeuristicCombine statistical covariates with foundation model embeddingsSynergistic value from fusing structured statistical data with latent foundation model representations. · 5 min
- HeuristicUse Constitutional Classifiers to block AI jailbreaksDefend AI models against jailbreaks using input/output classifiers trained on principles. · 10 min
- Anti-patternAssume LLM state policy answers are correct without verificationDo not trust LLM answers on state policy without cross-checking, as they may substitute data from other states. · 5 min
- HeuristicDiscovery-Execution framework predicts mathematical reasoning scalingUse a Discovery-Execution framework to predict how AI mathematical reasoning scales with compute. · 15 min
- HeuristicMeasure conditional execution for longer reasoning predictionsShort-budget success rates don't always capture longer reasoning potential; measure execution. · 10 min
Questions people ask
- Which AI tools does this work with?
- Any current model. It was seen with in the sources.
- Where did this come from?
- Google Research (Google Research Blog). Subvolts collected, normalized and credited it; the link above opens the original.