我们的网站为什么显示成这样?

可能因为您的浏览器不支持样式,您可以更新您的浏览器到最新版本,以获取对此功能的支持,访问下面的网站,获取关于浏览器的信息:

|本期目录/Table of Contents|

 概化理论方差分量及其变异量估计:跨分布的模拟研究(PDF)

《心理学探新》[ISSN:1003-5184/CN:36-1228/B]

期数:
 2020年05期
页码:
 431-437
栏目:
 心理统计与测量
出版日期:
 2020-11-20

文章信息/Info

Title:
 Estimating Variance Components and Their Variabilities in Generalizability Theory:A Cross-distribution Simulation Study
文章编号:
1003-5184(2020)05-0431-07
作者:
 甄锋泉 张敏强 刘 颖
 (华南师范大学心理学院,广州 510631)
Author(s):
 Zhen Fengquan Zhang Minqiang Liu Ying
 (School of Psychology,South China Normal University,Guangzhou 510631)
关键词:
 概化理论 方差分量 模拟研究 数据分布
Keywords:
 Generalizability Theory variance component simulation study data distribution
分类号:
 B841.2
DOI:
 -
文献标识码:
 A
摘要:
 为考察概化理论中方差分量及其变异量估计的准确性,采用模拟研究的方法,探究Traditional法、Jackknife法、Bootstrap法和MCMC法在p×i×hp×(i:h)2种双侧面设计和正态、二项、多项、偏态分布4种数据类型下的表现。结果显示:(1)4种方法均能准确估计方差分量;(2)估计方差分量的标准误时,若数据正态分布,Traditional法最优,非正态分布时Bootstrap法最优;(3)估计方差分量的90%置信区间时,Bootstrap法在不同分布的数据下表现稳定,但容易受到侧面水平数的影响。综合来说,若数据呈正态分布,建议选用Traditional法; 若数据呈非正态分布,建议选用Bootstrap法。
Abstract:
 In terms ofeight simulation conditions(data with normal,dichotomous,polytomous and skew distribution with thep×i×handp×[i:h]designs),this article examined the applicability of Traditional method,Jackknife method,Bootstrap method and MCMC method for estimating variance components and their variabilities,in order to find out the best method to estimate variance components in various occasions.The result showed that:(1)All these methods could accurately estimate variance components without significant difference.(2)For standard errors of estimated variance components,Traditional method performed well in normally-distributed data,and Bootstrap method behaved best in nonnormally-distributed data.(3)In terms of 90% confidence intervals of estimated variance components,Bootstrap method was robust across different data types,but sensitive to sample sizes.Above all,we recommend traditional method for normally-distributed data,and Bootstrap method for nonnormally-distributed data.

参考文献/References

 黎光明.(2010).基于概化理论的方差分量变异量估计(博士学位论文).华南师范大学.
李向阳.(2015).高校辅导员半结构化面试的概化理论研究.内蒙古工业大学学报(社会科学版),24(1),33-36.
姚若松,刘泽,赵葆楠,苗群鹰.(2015).结构化面试中多源变异的概化分析.心理学探新,35(4),344-349.
Brennan,R.L.(2001).Generalizability theory.New York:Springer.
Brennan,R.L.,Harris,D.J.,& Hanson,B.A.(1987).The bootstrap and other procedures for examining the variability of estimated variance components in testing contexts(ACT Research Report Series 87-7).Iowa City,IA:American College Testing Program.
Burdick,R.K.,& Graybill,F.A.(1992).Confidence intervals on variance components.New York:Dekker.
Casabianca,J.M.,Lockwood,J.R.,& Mccaffrey,D.F.(2015).Trends in classroom observation scores.Educational & Psychological Measurement,75(2),311-337.
Clayson,P.E.,& Miller,G.A.(2016).ERP reliability analysis(ERA)toolbox:An open-source toolbox for analyzing the reliability of event-related brain potentials.International Journal of Psychophysiology,111,68-79.
Feng,W.(2002).Applicability of the jackknife procedure for estimating standard errors of variance component estimates in selected random effects G study designs.Unpublished Doctorial Dissertation,University of Iowa.
Jiang,Z.,& Raymond,M.(2018).The use of multivariate generalizability theory to evaluate the quality of subscores.Applied Psychological Measurement,42(8),595-612.
Karami,H.(2012).The relative impact of persons,items,subtests,and academic background on performance on a language proficiency test.Psychological Test & Assessment Modeling,54(3),211-226.
Kellermargulis,M.A.,Mercer,S.H.,& Thomas,E.L.(2015).Generalizability theory reliability of written expression curriculum-based measurement in universal screening.School Psychology Quarterly,31(3),383-392.
Lin,C.K.(2017).Working with sparse data in rated language tests:Generalizability theory applications.Language Testing,34(2),271-289.
Luecht,R.M.,& Smith,P.L.(1989).The effects of bootstrapping strategies on the estimation of variance components.Paper presented at the annual meeting of the American Educational Research Association,San Francisco,CA.
Mantzicopoulos,P.,French,B.F.,& Patrick,H.(2018).The mathematical quality of instruction(MQI)in kindergarten:An evaluation of the stability of the MQI using generalizability theory.Early Education & Development,29(6),893-908.
Mao,X.,Shin,D.,& Brennan,R.L.(2005).Estimating the variability of estimated variance components and related statistics using the MCMC procedure:An exploratory study.Paper presented at the annual meeting of the National Council on Measurement in Education,Montreal.
Medvedev,O.N.,Krägeloh,C.U.,Narayanan,A.,& Siegert,R.J.(2017).Measuring mindfulness:Applying generalizability theory to distinguish between state and trait.Mindfulness,8(4),1-11.
Meyer,J.P.,Liu,X.,& Mashburn,A.J.(2014).A practical solution to optimizing the reliability of teaching observation measures under budget constraints.Educational & Psychological Measurement,74(2),280-291.
Moore,J.L.(2010).Estimating standard errors of estimated variance components in generalizability theory using bootstrap procedures.Unpublished Doctorial Dissertation,University of Iowa.
Nalbantoglu Yilmaz,F.(2017).Reliability of scores obtained from self-,peer-,and teacher-assessments on teaching materials prepared by teacher candidates.Educational Sciences Theory & Practice,17(2),395-409.
Othman,A.R.(1995).Examining task sampling variability in science performance assessments.Unpublished Doctoral Dissertation,University of California,Santa Barbara.
Searle,S.R.(1971).Linear models.New York:Wiley.
Searle,S.R.,Casella,G.,& Mcculloch,C.E.(1992).Variance components.New York:Wiley.
Ting,N.,Burdick,R.K.,Graybill,F.A.,Jeyaratnam,S.,& Lu,T.F.C.(1990).Confidence intervals on linear combinations of variance components that are unrestricted in sign.Journal of Statistical Computation & Simulation,35(3-4),135-143.
Tong,Y.,& Brennan,R.L.(2004).Bootstrap procedures for estimating standard errors of estimated variance components for two-facet designs(CASMA Research Report No.5).Iowa City,IA:Center for Advanced Studies in Measurement and Assessment,University of Iowa.
Tong,Y.,& Brennan,R.L.(2007).Bootstrap estimates of standard errors in generalizability theory.Educational & Psychological Measurement,67(5),804-817.
Wiley,E.W.(2001).Bootstrap strategies for variance component estimation:Theoretical and empirical results.Unpublished Doctorial Dissertation,Stanford University,Stanford,CA.

备注/Memo

备注/Memo:
 -
更新日期/Last Update:  2020-10-20