scorer reliability

Written by

The Information Architects of Encyclopaedia Britannica

Last updated

July 13, 2026

Quick Summary

Scorer reliability refers to the consistency with which different individuals scoring the same test agree on the results. This is particularly important when a test does not have a definitive answer key, such as those requiring subjective responses in writing or organization. In such cases, the preconceptions of different raters can lead to varying scores for the same test, indicating scorer unreliability. Tests that allow for objective scoring are generally preferred to minimize this issue. A reliability coefficient is a measure used to quantify the accuracy of a test or measuring instrument by comparing two sets of measurements taken from the same individuals.12

Summary created from Britannica articles using AI. AI can make mistakes, so verify using Britannica articles.

2 Britannica Sources

Ask Britannica AI about this topic

Britannica doesn't have a full article on this topic, so we've curated a list of our relevant coverage.

psychological testing
Primary characteristics of methods or instruments
Scorer reliability refers to the consistency with which different people who score the same test agree. For a test with a definite answer key, scorer reliability is of negligible concern. When the subject responds with his own words, handwriting, and organization of subject matter, however,…
Read More
Scorer reliability refers to the consistency with which different people who score the same test agree. For a test with a definite answer key, scorer reliability is of negligible concern. When the subject responds with his own words, handwriting, and organization of subject matter, however,…
Read More