You are here

Comparison of Methods for Detecting Differential Distractor Functioning

Title: A Comparison of Methods for Detecting Differential Distractor Functioning.
129 views
63 downloads
Name(s): Koon, Sharon, 1966-, author
Becker, Betsy Jane, professor co-directing dissertation
Kamata, Akihito, professor co-directing dissertation
Barbu, Adrian, university representative
Turner, Jeannine, committee member
Yang, Yanyun, committee member
Department of Educational Psychology and Learning Systems, degree granting department
Florida State University, degree granting institution
Type of Resource: text
Genre: Text
Issuance: monographic
Date Issued: 2010
Publisher: Florida State University
Place of Publication: Tallahassee, Florida
Physical Form: computer
online resource
Extent: 1 online resource
Language(s): English
Abstract/Description: This study examined the effectiveness of the odds-ratio method (Penfield, 2008) and the multinomial logistic regression method (Kato, Moen, & Thurlow, 2009) for measuring differential distractor functioning (DDF) effects in comparison to the standardized distractor analysis approach (Schmitt & Bleistein, 1987). Students classified as participating in free and reduced-price lunch programs served as the focal group and students not participating in these programs served as the reference group. The comparisons were conducted in such a way as to provide insight into two research questions: 1) whether the magnitude and pattern of the DDF effect is constant across all methods, and 2) whether the pattern of DDF effects support differential item functioning (DIF) findings. Measures of effect size are reported. In addition, the relationship between item characteristics and DIF and DDF effects were explored for patterns. Comparisons of three methods for detecting DDF were conducted in this study. The standardized distractor analysis and odds-ratio methods for detecting DDF were found to have very highly related results, with regard to both the magnitude and pattern of DDF effects. The multinomial logistic regression DDF results also were highly related to the standardized distractor analysis approach, but yielded slightly different patterns across distractors. The odds ratio and multinomial logistic regression methods are easily implemented with available software, such as the SPSS software package used in this study, unlike the standardized distractor analysis method which must be programmed. Despite these and the other discussed differences, all three methods present a viable option for use in improving test items included in statewide assessment programs.
Identifier: FSU_migr_etd-2840 (IID)
Submitted Note: A Dissertation submitted to the Department of Educational Psychology and Learning Systems in partial fulfillment of the requirements for the degree of Doctor of Philosophy.
Degree Awarded: Spring Semester, 2010.
Date of Defense: March 16, 2010.
Keywords: Multinomial Logistic Regression, Standardization, Odds Ratio, Differential Distractor Functioning, Differential Item Functioning
Bibliography Note: Includes bibliographical references.
Advisory Committee: Betsy Jane Becker, Professor Co-Directing Dissertation; Akihito Kamata, Professor Co-Directing Dissertation; Adrian Barbu, University Representative; Jeannine Turner, Committee Member; Yanyun Yang, Committee Member.
Subject(s): Educational psychology
Persistent Link to This Record: http://purl.flvc.org/fsu/fd/FSU_migr_etd-2840
Owner Institution: FSU

Choose the citation style.
Koon, S. (2010). A Comparison of Methods for Detecting Differential Distractor Functioning. Retrieved from http://purl.flvc.org/fsu/fd/FSU_migr_etd-2840