Analyzing Spatial Responses: A Comparison Of IRT-Based Approaches
Quantitative Psychology: The 87th Annual Meeting Of The Psychometric Society, Bologna, Italy, 2022
We investigate two approaches for analyzing spatial coordinate responses using models inspired by Item Response Theory (IRT). In the first, we use a two-stage approach to first construct a pseudo-response matrix using the spatial information and then apply standard IRT techniques to estimate proficiency and item parameters. In the second approach, we introduce the Spatial Error Model and use the spatial coordinates directly to infer information about the true locations and participant precision. As a motivating example, we use a study from forensic science designed to measure how fingerprint examiners use minutiae (small details in the fingerprint that form the basis for uniqueness) to come to an identification decision. The study found substantial participant variability, as different participants tend to focus on different areas of the image and some participants mark more minutiae than others. Using simulated data, we illustrate the relative strengths and weaknesses of each modeling approach, and demonstrate the advantages of modeling the spatial coordinates directly in the Spatial Error Model.
Bayesian statistics, Spatial statistics, Item response theory, Applications
Amanda Luby; Thomas Daillak , '22; and Sherry Huang , '23.
"Analyzing Spatial Responses: A Comparison Of IRT-Based Approaches".
Quantitative Psychology: The 87th Annual Meeting Of The Psychometric Society, Bologna, Italy, 2022.