我们的网站为什么显示成这样?

可能因为您的浏览器不支持样式,您可以更新您的浏览器到最新版本,以获取对此功能的支持,访问下面的网站,获取关于浏览器的信息:

|本期目录/Table of Contents|

 认知诊断测验的自动组卷方法(PDF)

《心理学探新》[ISSN:1003-5184/CN:36-1228/B]

期数:
 2023年06期
页码:
 550-557
栏目:
 心理统计与测量
出版日期:
 2023-12-20

文章信息/Info

Title:
 Research on Automated Test Assembly Method for Cognitive Diagnosis Tests
文章编号:
1003-5184(2023)06-0550-08
作者:
 马大付12秦春影13杨建芹3徐新爱3喻晓锋1
 (1.江西师范大学心理学院,南昌 330022; 2.山东省济南市教育教学研究院,济南 250002; 3.南昌师范学院数学与统计学院,南昌 330032)
Author(s):
 Ma Dafu12Qin Chunying13Yang Jianqin3Xu Xinai3Yu Xiaofeng1
 (1.School of Psychology,Jiangxi Normal University,Nanchang 330022; 2.Jinan Institute for Education and Teaching Research,Jinan 250002; 3.School of Mathematics and Statistics,Nanchang Normal University,Nanchang 330032)
关键词:
 认知诊断测验 自动组卷方法 组卷精度 组卷效率
Keywords:
 cognitive diagnosis tests automated test assembly assembly accuracy assembly efficiency
分类号:
 B841.2
DOI:
 -
文献标识码:
 A
摘要:
 认知诊断评估的重要一环是构建符合约束(统计约束与非统计约束)的诊断测验。其中构建测验的认知诊断自动测验组卷(cognitive diagnosis automated test assembly,CD-ATA)方法十分关键,受到广泛关注。文章通过梳理有关CD-ATA的研究,从组卷方法的类别、开发思路、组卷过程、方法对比及选用进行阐述与评析。最后,在已有方法基础上指出未来可从融合测验设计、非参数组卷、平行测验组卷、开发组卷软件、开展实证研究五个方面进行研究与探讨。
Abstract:
 Constructing diagnosis tests that meet test constraints(statistical constraints and non-statistical constraints)is an important part of cognitive diagnosis evaluation,which is helpful to realize the diagnosis evaluation of participants' attributes.The cognitive diagnosis automated test assembly(CD-ATA)is a commonly used diagnosis test assembly method.This paper first classifies the existing CD-ATA methods,and then discusses the test assembly ideas,test assembly processes,and connections between different methods.Secondly,it compares different methods to provide users with reference when selecting methods.Finally,on the basis of the existing methods,it is proposed that future research can be carried out from five aspects:fusion test design,non-parametric test assembly,parallel test assembly,developing test assembly software,and application scenario expansion.

参考文献/References

 丁树良,杨淑群,汪文义.(2010).可达矩阵在认知诊断测验编制中的重要作用.江西师范大学学报(自然科学版),34(5),490-494.
郭磊,郑禅金,边玉芳,宋乃庆,夏凌翔.(2016).认知诊断计算机化自适应测验中新的选题策略:结合项目区分度指标.心理学报,48(7),903-914.
罗照盛.(2012).项目反应理论基础.北京师范大学出版社.
唐小娟,丁树良,毛萌萌,俞宗火.(2013).基于属性层级结构的认知诊断测验的组卷.心理学探新,33(3),252-259.
唐小娟,丁树良,俞宗火.(2022).题目属性向量平衡策略的认知诊断测验设计.心理科学,45(6),1466-1474.
汪文义,宋丽红,丁树良.(2018).分类视角下认知诊断测验项目区分度指标及应用.心理科学,41(2),475-483.
Becker,B.,Debeer,D.,Sachse,K.A.,& Weirich,S.(2021).Automated test assembly in R:The eatATA package.Psych,3(2),96-112.
Chang,H.H.,& Ying,Z.L.(1996).A global information approach to computerized adaptive testing.Applied Psychological Measurement,20(3),213-229.
de la Torre,J.(2011).The generalized DINA model framework.Psychometrika,76(2),179-199.
Finkelman,M.,Kim,W.,& Roussos,L.A.(2009).Automated test assembly for cognitive diagnosis models using a genetic algorithm.Journal of Educational Measurement,46(3),273-292.
Finkelman,M.D.,de la Torre,J.,& Karp,J.A.(2020).Cognitive diagnosis models and automated test assembly:An approach incorporating response times.International Journal of Testing,20(4),299-320.
Finkelman,M.D.,Kim,W.,Roussos,L.,& Verschoor,A.(2010).A binary programming approach to automated test assembly for cognitive diagnosis models.Applied Psychological Measurement,34(5),310-326.
George,A.C.,Robitzsch,A.,Kiefer,T.,Groß,J.,& Ünlü,A.(2016).The R package CDM for cognitive diagnosis models.Journal of Statistical Software,74(2),1-24.
Hartz,S.M.(2002).A Bayesian framework for the unified model for assessing cognitive abilities:Blending theory with practicality.(Unpublished doctoral disseration).University of Illinois at Urbana-Champign.
Henson,R.,& Douglas,J.(2005).Test construction for cognitive diagnosis.Applied Psychological Measurement,29(4),262-277.
Henson,R.,Roussos,L.A.,Douglas,J.,& He,X.M.(2008).Cognitive diagnosis attribute-level discrimination indices.Applied Psychological Measurement,32(4),275-288.
Henson,R.,DiBello,L.,& Stout,B.(2018).A generalized approach to defining item discrimination for DCMs.Measurement:Interdisciplinary Research and Perspectives,16(1),18-29.
Kim,S.(2004).An automated test assembly for unidimensional IRT tests containing cognitive diagnostic elements.(Unpublished doctoral disseration).The University of Texas at Austin.
Kuo,B.C.,Pai,H.S.,& de la Torre.(2016).Modified cognitive diagnosis index and modified attribute-level discrimination index for test construction.Applied Psychological Measurement,40(5),315-330.
Li,G.Y.,Cai,Y.,Gao,X.L.,Wang,D.X.,& Tu,D.B.(2021).Automated test assembly for multistage testing with cognitive diagnosis.Frontiers in Psychology,12,509844.
Lin,Y.,Gong,Y.J.,& Zhang,J.(2017).An adaptive ant colony optimization algorithm for constructing cognitive diagnosis tests.Applied Soft Computing,52,1-13.
Lin,Y.,Jiang,Y.S.,Gong,Y.J.,Zhan,Z.H.,& Zhang,J.(2019).A discrete multiobjective particle swarm optimizer for automated assembly of parallel cognitive diagnosis tests.IEEE Transactions on Cybernetics,49(7),2792-2805.
Rupp,A.A.,Templin,J.,& Henson,R.J.(2010).Diagnostic measurement:Theory,methods,and applications.New York:Guilford Press.
Shao,C.,Liu,S.,Yang,H.,& Tsai,T.H.(2020).Automated test assembly using SAS operations research software in a medical licensing examination.Applied Psychological Measurement,44(3),219-233.
Shi,Q.Z.,Ma,W.C.,Robitzsch,A.,Sorrel,M.A.,& Man,K.W.(2021).Cognitively diagnosis analysis using the G-DINA model in R.Psych,3(4),812-835.
Song,L.H.,& Wang,W.Y.(2019).An attribute-specific item discrimination index in cognitive diagnosis.Quantitative Psychology,169-181.
Su,Y.H.,& Chu,K.H.(2021).Improving the measurement efficiency in test construction related to cognitive diagnosis models.Quantitative Psychology,243-251.
van der Linden,W.J.(2006).A lognormal model for response times on test items. Journal of Educational and Behavioral Statistics,31(2),181-204.
Veldkamp,B.P.,Matteucci,M.,& de Jong,M.G.(2013).Uncertainties in the item parameter estimates and robust automated test assembly.Applied Psychological Measurement,37(2),123-139.
von Davier,M.,& Lee,Y.S.(2019).Handbook diagnostic classification models.New York:Springer.
Wang,W.Y.,Song,L.H.,Chen,P.,& Ding,S.(2019).An item-level expected classification accuracy and its applications in cognitive diagnosis assessment.Journal of Educational Measurement,56(1),51-75.
Wang,W.Y.,Zheng,J.J.,Song,L.H.,Tu,Y.K.,& Gao,P.(2021).Test assembly for cognitive diagnosis using mixed-integer linear programming.Frontiers in Psychology,12,623077.
Zeng,L.Y.,Ding,S.L.,& Gan,D.W.(2010).Test construction for cognitive diagnosis.In 2010 Asia-Pacific conference on wearable computing systems(pp.12-15).Shenzhen:IEEE.

备注/Memo

备注/Memo:
 基金项目:国家自然科学基金(62341207,32360208),教育部教育考试院“十四五”规划支撑专项课题“高考实施过程中的科目跨年分数的转换研究”(NEEA2021050),江西省教育厅科技项目(GJJ2202013,GJJ212608,GJJ212602,GJJ2202018)。
通讯作者:喻晓锋,E-mail:xyu6@jxnu.edu.cn。
更新日期/Last Update:  2023-12-20