Mathematical Psychology
About

Rating-Scale SDT

Rating-scale SDT extends the basic yes/no paradigm by having observers report confidence levels, placing multiple criteria along the evidence axis to generate a full ROC curve from a single condition.

In the rating-scale version of SDT, observers respond with confidence ratings rather than binary yes/no decisions. This is equivalent to placing multiple criteria along the internal evidence axis, with each criterion separating adjacent confidence categories. The advantage is that a complete ROC curve can be constructed from a single experimental condition, rather than requiring manipulation of bias across conditions.

Multiple Criteria

Rating-Scale SDT Model For k rating categories, there are k−1 criteria: c₁ < c₂ < ... < c_{k−1}

P(rating ≥ j | signal) = Φ(d′/2 − cⱼ)
P(rating ≥ j | noise) = Φ(−d′/2 − cⱼ)

Each criterion yields one ROC point

Constructing the ROC

Each criterion divides responses into "would have said yes" and "would have said no." Using criterion j, the hit rate is P(rating ≥ j | signal) and the false alarm rate is P(rating ≥ j | noise). This produces k−1 ROC points, tracing out the ROC curve. More extreme criteria produce conservative points (low hit rate, low false alarm rate); lenient criteria produce liberal points.

Rating-scale data are typically analyzed by fitting signal detection models (equal- or unequal-variance) to the full set of ROC points using maximum likelihood estimation. This provides more precise estimates of sensitivity and the variance ratio than binary data, and allows the researcher to assess the fit of the underlying distributional assumptions.

Related Topics

References

  1. Macmillan, N. A., & Creelman, C. D. (2005). Detection theory: A user's guide (2nd ed.). Lawrence Erlbaum Associates. https://doi.org/10.4324/9781410611147
  2. Wickens, T. D. (2002). Elementary signal detection theory. Oxford University Press. https://doi.org/10.1093/acprof:oso/9780195092509.001.0001
  3. Green, D. M., & Swets, J. A. (1966). Signal detection theory and psychophysics. Wiley. https://doi.org/10.1901/jeab.1969.12-475
  4. Swets, J. A., Tanner, W. P., & Birdsall, T. G. (1961). Decision processes in perception. Psychological Review, 68(5), 301–340. https://doi.org/10.1037/h0040547

External Links