Mathematical Psychology
About

Confidence Ratings

Confidence ratings in SDT enable the study of metacognition — the ability to monitor one's own decision accuracy — through type 2 SDT analyses and the meta-d′ framework.

Beyond the primary (type 1) decision of whether a signal is present, observers can also rate their confidence in that decision. These confidence ratings provide a window into metacognition — the ability to monitor and evaluate one's own cognitive processes. Type 2 SDT provides the mathematical framework for analyzing the relationship between confidence and accuracy.

Type 2 SDT and Meta-d′

Type 2 SDT Framework Type 1: discriminating signal from noise → d′
Type 2: discriminating correct from incorrect responses → meta-d′

Metacognitive efficiency: M_ratio = meta-d′ / d′
M_ratio = 1: metacognitively optimal
M_ratio < 1: metacognitive loss

The meta-d′ framework (Maniscalco & Lau, 2012) provides a signal detection measure of metacognitive sensitivity that is expressed in the same units as type 1 d′. The ratio meta-d′/d′ measures metacognitive efficiency: a ratio of 1 indicates that the observer uses all available perceptual information for confidence judgments; ratios below 1 indicate metacognitive loss.

Applications

The meta-d′ framework has been widely applied to study metacognition in perception, memory, and clinical populations. It has revealed that metacognitive efficiency is relatively stable within individuals across tasks but varies across clinical conditions — patients with lesions to prefrontal cortex show impaired metacognition (low meta-d′/d′) despite intact perceptual sensitivity.

Related Topics

References

  1. Maniscalco, B., & Lau, H. (2012). A signal detection theoretic approach for estimating metacognitive sensitivity from confidence ratings. Consciousness and Cognition, 21(1), 422–430. https://doi.org/10.1016/j.concog.2011.09.021
  2. Fleming, S. M., & Lau, H. C. (2014). How to measure metacognition. Frontiers in Human Neuroscience, 8, 443. https://doi.org/10.3389/fnhum.2014.00443
  3. Galvin, S. J., Podd, J. V., Drga, V., & Whitmore, J. (2003). Type 2 tasks in the theory of signal detectability: Discrimination between correct and incorrect decisions. Psychonomic Bulletin & Review, 10(4), 843–876. https://doi.org/10.3758/BF03196546
  4. Fleming, S. M., Weil, R. S., Nagy, Z., Dolan, R. J., & Rees, G. (2010). Relating introspective accuracy to individual differences in brain structure. Science, 329(5998), 1541–1543. https://doi.org/10.1126/science.1191883

External Links