Now you Bayes, now you don't: effects of set-problem and frequency-format mental representations on statistical reasoning

People appear to be Bayesian when statistical information is presented in terms of natural frequencies and non-Bayesian when presented in terms of single-event probabilities, unless the probabilities resemble natural frequencies, for example, as chances. The isomorphic format of chances, however, does not always facilitate performance to the extent that the format of natural frequencies does. Prior research has not addressed the underlying mechanism that accounts for this gap despite its theoretical significance. The mechanism explaining this external format gap could lie in the interpretation of the problem as a set-problem, which cues relevant problem model and arithmetic operations (the problem interpretation hypothesis) and/or in the interpretation of the format as frequencies, which may be easier to process (the format interpretation hypothesis). In two parallel experiments, we found support for the problem interpretation hypothesis only: set representations mediated solely the isomorphic format gap (Experiment 1: part A) and accounted for the transfer effect to natural frequencies (Experiment 1: part B); priming set representations improved performance with chances (Experiment 2). We discuss how the supported explanation corroborates the nested-sets rather than the ecological rationality account of statistical reasoning and how it helps explain individual differences in Bayesian reasoning.