psychometrics

Bayesian psychometrics for diagnostic assessments: A proof of concept

Diagnostic assessments measure the knowledge, skills, and understandings of students at a smaller and more actionable grain size than traditional scale-score assessments. Results of diagnostic assessments are reported as a mastery profile, indicating …

Measuring the reliability of diagnostic mastery classifications at multiple levels

As the use of diagnostic assessment systems transitions from research applications to large-scale assessments for accountability purposes, reliability methods that provide evidence at each level of reporting are needed. The purpose of this paper is …

Instructionally embedded assessment: Patterns of use and outcomes

Dynamic Learning Maps® (DLM®) alternate assessments measure the knowledge, skills, and understandings of students with the most significant cognitive disabilities relative to grade-level alternate content standards (Essential Elements; …

Empirical methods for evaluating maps: Illustrations and results

Learning progressions and learning map structures are increasingly being used as the basis for the design of large-scale assessments. Of critical importance to these designs is the validity of the map structure used to build the assessments. Most …

Psychometric Considerations for Learning Maps-Based Assessments

Learning map models are a type of cognitive model composed of multiple interconnected learning targets and other critical knowledge and skills. The Dynamic Learning Maps (DLM) Alternate Assessment System uses learning maps models as the basis for …

Empirical methods for evaluating maps: Illustrations and results

Learning progressions and learning map structures are increasingly being used as the basis for the design of large-scale assessments. Of critical importance to these designs is the validity of the map structure used to build the assessments. Most …

Dynamic Learning Maps

The Dynamic Learning Maps® Alternate Assessment System is a large scale assessment administered by the Center for Accessible Teaching, Learning, and Assessment Systems at the University of Kansas.

Evaluating Model Estimation Processes for Diagnostic Classification Models

PhD dissertation submitted to the School of Education at the University of Kansas.

Measuring reliability of student mastery classification at multiple levels

As the use of diagnostic assessment systems transitions from research applications to large-scale assessments for accountability purposes, reliability methods that provide evidence at each level of reporting must are needed. The purpose of this paper …

A hierarchical IRT model for identifying group-level aberrant growth

As cheating on high-stakes tests continues to threaten the validity of score interpretations, approaches for detecting cheating proliferate. Most research focuses on individual scores, but recent events show group-level cheating is also occurring. …