Mathematical Psychology
About

True Score Theory

Classical Test Theory decomposes an observed score into a true score (the expected value across infinite replications) and random error.

X = T + E

Classical Test Theory (CTT), also known as True Score Theory, is the oldest and simplest psychometric framework. Its central axiom — that every observed score is the sum of a true score and random error — has been the foundation of psychological testing for over a century.

Classical Test Theory Model X = T + E

E(X) = T (expected observed score equals true score)
ρ(T,E) = 0 (true score and error are uncorrelated)
ρ(E₁,E₂) = 0 (errors across forms are uncorrelated)

Reliability

Reliability is defined as the ratio of true score variance to observed score variance: ρₓₓ = σ²_T / σ²_X. Since true scores are unobservable, reliability must be estimated through methods such as test-retest correlation, parallel forms, split-half methods, or internal consistency measures like Cronbach's alpha. Reliability ranges from 0 (all error) to 1 (no error), with values above 0.80 considered adequate for most research purposes.

Limitations

CTT has well-known limitations: its statistics are sample-dependent and test-dependent, meaning that item difficulty and discrimination values change with the sample, and person scores depend on which items were administered. Item Response Theory was developed specifically to overcome these limitations by modeling the relationship between latent ability and item responses directly.

Interactive Calculator

Each row is a participant's scores on multiple items (comma-separated). The calculator computes Cronbach's α for internal consistency: α = (k/(k−1))·(1 − Σσ²ᵢ/σ²ₓ).

Click Calculate to see results, or Animate to watch the statistics update one record at a time.

Related Topics

References

  1. Lord, F. M., & Novick, M. R. (1968). Statistical theories of mental test scores. Addison-Wesley. https://doi.org/10.1002/j.2333-8504.1966.tb00528.x
  2. Gulliksen, H. (1950). Theory of mental tests. Wiley. https://doi.org/10.1037/13240-000
  3. Novick, M. R. (1966). The axioms and principal results of classical test theory. Journal of Mathematical Psychology, 3(1), 1–18. https://doi.org/10.1016/0022-2496(66)90002-2

External Links