From the source
Apple researchers introduce a technique to study LLMs as information processing rules, using the deviation from Bayesian updates to measure internal inconsistencies in how LLMs update probabilistic beliefs from evidence.
- Their experiments show that non-Bayesian heuristic updates often outperform exact Bayesian updates in downstream tasks, suggesting LLMs' probabilistic world models are misspecified.
- The measure can provide diagnostics for issues in LLM-powered inferential systems.