You are here

Bayesian Hierarchical Mixture Approach to Model Timing Data with Application to Writing Assessment

Title: A Bayesian Hierarchical Mixture Approach to Model Timing Data with Application to Writing Assessment.
206 views
56 downloads
Name(s): Li, Tingxuan, author
Almond, Russell George, professor directing thesis
Kim, Young-Suk, committee member
Yang, Yanyun, committee member
Department of Educational Psychology and Learning Systems, degree granting department
Florida State University, degree granting institution
Type of Resource: text
Genre: Text
Issuance: monographic
Date Issued: 2013
Publisher: Florida State University
Place of Publication: Tallahassee, Florida
Physical Form: computer
online resource
Extent: 1 online resource
Language(s): English
Abstract/Description: Deane (2011) proposed a multi-layer cognitive writing model. The 2009 Cognitively Based Assessment of, for, and as learning (CBAL) Writing pilot assessment was designed to support that multi-layer model of writing. One of the features of the assessment was that the keystroke activity of students writing essays were logged to computer files. The preliminary analysis (Almond, et al., 2012) developed an algorithm to classify the pauses in writing based on the keystroke and suggested the distribution for pause events is a mixture of lognormal distribution. This early research was a promising effort to tie the mixture components to the layers in the multi-layer writing model. However, the preliminary analysis with sample size of 68 needed to be repeated with the large data set. Moreover, the data needed to be hierarchically modeled so that the data can fit mixture components when the number of pause events is small per essay. To address these problems, the first part of this thesis aims to fit the large data set (CBAL Writing pilot 2009) in a mixture of lognormal distribution. Then, a distributional analysis was carried out to evaluate the fit of the model to the data. The result confirms the preliminary analysis result. Namely, the two-component mixture model provides an adequate description of the data. The second part of the thesis aims to estimate mixture parameters by using the Bayesian hierarchical model suggested in the preliminary analysis (Almond, et al., 2012). In the Bayesian framework, the hierarchical model is useful when the number of observed pause events is small per essay. Therefore, the proposed model becomes a mixture of k univariate lognormal heteroscedastic components in the Bayesian hierarchical framework. The evaluation of Bayesian model implementation primarily requires the convergence of the Markov chain Monte Carlo (MCMC) sampler. Diagnostic tools were used to assess the convergence of the MCMC sampler. The results show that the MCMC sampler converged for both the two- and the three-component models.
Identifier: FSU_migr_etd-8590 (IID)
Submitted Note: A Thesis submitted to the Department of Educational Psychology and Learning Systems in partial fulfillment of the requirements for the degree of Master of Science.
Degree Awarded: Fall Semester, 2013.
Date of Defense: June 26, 2013.
Keywords: Bayesian statistics, Mixture Model, Timing Data, Writing Assessment
Bibliography Note: Includes bibliographical references.
Advisory Committee: Russell George Almond, Professor Directing Thesis; Young-Suk Kim, Committee Member; Yanyun Yang, Committee Member.
Subject(s): Educational psychology
Persistent Link to This Record: http://purl.flvc.org/fsu/fd/FSU_migr_etd-8590
Owner Institution: FSU

Choose the citation style.
Li, T. (2013). A Bayesian Hierarchical Mixture Approach to Model Timing Data with Application to Writing Assessment. Retrieved from http://purl.flvc.org/fsu/fd/FSU_migr_etd-8590