LW
Looking for information on scoring calibration
Scott asks whether there's an accepted method for measuring calibration separately from domain knowledge, noting that common scoring rules conflate the two.
2 min read 221 words
A thread through the archive
Essays tagged “measurement”. Follow an idea across the archive.
Scott asks whether there's an accepted method for measuring calibration separately from domain knowledge, noting that common scoring rules conflate the two.
Scott explains the Implicit Association Test (IAT), which measures unconscious associations by testing reaction times when categorizing concepts, and argues it's better understood as measuring distances in conceptual space rather than as a simple test for prejudice.