About this Academy

The goals of this Academy are to familiarize participants with:

1. Features of assessment designs currently used in major large-scale assessments
   
2. Item Response Theory (IRT) and different models currently in use in major large-scale assessments
   
3. Population modeling approaches currently used in major large-scale assessments
4. Software currently available to conduct IRT analysis and population modeling
   

This Academy will cover basic topics related to Item Response Theory and Population Modeling as they relate to large-scale assessments. It will also train participants on the use of IRT and modeling software to conduct analysis that involve calculating item parameters and person scores. It will review advantages and disadvantages of different IRT models currently in use as well as procedures for setting up data to be analyzed with IRT software.

The topics covered will be the following:

• Basics of survey instrument design
  • Test design
  • Questionnaire design
• Classical item analysis
• Basic principles of IRT
  • Models
  • Estimating item parameters
  • Estimating person scores
• Linking scales
• Choosing a metric
• Using IRT for attitude and other background scales
• Principles of population modeling
  • Estimating population parameters
  • Multiple populations
  • Latent regression
  • Plausible values
• Hands-on use of IRT software for large-scale assessments
  • Using Parscale
    
  • DESI / DGROUP