我们的网站为什么显示成这样？

可能因为您的浏览器不支持样式，您可以更新您的浏览器到最新版本，以获取对此功能的支持，访问下面的网站，获取关于浏览器的信息：

|本期目录/Table of Contents|

 基于项目作答反应时间的作弊甄别研究进展(PDF)

《心理学探新》[ISSN:1003-5184/CN:36-1228/B]

期数:
 2023年03期
页码:
 278-288
栏目:
 心理统计与测量
出版日期:
 2023-07-20

文章信息/Info

Title:
 Advances in Cheating Detection Research Based on Item Response Time:A Review
文章编号:
1003-5184(2023)03-0278-11
作者:
 杨志明 徐庆树
 (湖南师范大学外国语学院,长沙 410081)
Author(s):
 Yang Zhiming Xu Qingshu
 (Foreign Studies College,Hunan Normal University,Changsha 410081)
关键词:
 项目作答反应时间;  作弊甄别;  个人拟合
Keywords:
 item response time;  cheating detection;  person fit analysis
分类号:
 B841.2
DOI:
 -
文献标识码:
 A
摘要:
 随着基于计算机的测试逐渐普及,搜集、记录、分析考生的项目作答反应时间数据成为可能,越来越多的研究者开始基于这一数据开展考试的作弊甄别研究。然而,此类研究国外较多,国内则非常之少。提出“两种三类”的作弊行为分类标准,从参数建模法、非参数建模法两个维度,对基于项目作答反应时间的作弊研究进行梳理,评述其在甄别各类作弊行为中的应用实践和甄别效果,并对未来的研究方向做出展望。
Abstract:
 As Computer Based Tests(CBT)become more and more popular,it is possible to collect,record,and analyze test takers' item response time.More and more researchers have started to conduct cheating screening studies based on this data.In this paper,we sort out the cheating detection researches based on item response time from two dimensions:parametric modelling method and non-parametric modelling method.At the same time,this paper proposes “two kinds and three types” of cheating behaviour classification criteria,and introduces the application practices and detection results of parametric and non-parametric modelling methods in the detection of various types of cheating behaviours,which provides a reference for related researchers.Furthermore,this paper also points out the direction of future studies in this field.

参考文献/References

 窦刚,刘荣华,范诚.(2021).基于卷积神经网络的考场不当行为识别.中国考试,(2),56-62+94.doi:10.19360/j.cnki.11-3303/g4.2021.02.006
郭小军,罗照盛.(2019).速度与准确率权衡:被试反应状态评价与建模.心理与行为研究,(5),589-595.
郭小军,罗照盛,严娟.(2022).项目间多维测验作答时间数据分析:潜在特质速度间效应建模.心理科学,(5),1222-1229.doi:10.16719/j.cnki.1671-6981.20220525.
胡佳琪,黄美薇,骆方.(2020).考试作弊甄别技术的研究进展:个体作弊的甄别.中国考试,(11),32-36.doi:10.19360/j.cnki.11-3303/g4.2020.11.006
刘玥,刘红云,游晓锋,杨建芹.(2022).用于处理不努力作答的标准化残差系列方法和混合多层模型法的比较.心理学报,(4),411-425.
骆方,王欣夷,徐永泽,封慰.(2020).考试作弊甄别技术的研究进展:团体作弊的甄别.中国考试,(11),37-41.doi:10.19360/j.cnki.11-3303/g4.2020.11.007
孟祥斌.(2016).项目反应时间的对数偏正态模型.心理科学,(3),727-734.doi:10.16719/j.cnki.1671-6981.20160332.
彭恒利.(2015).惩治考试作弊的困境与出路之我见.中国考试,(2),13-19.doi:10.19360/j.cnki.11-3303/g4.2015.02.003
汪大勋,郭莹莹.(2022).融合反应时的多级评分IRT模型开发及其应用研究.心理学探新,22(3),269-278+288.
严娟,郭小军,罗照盛.(2022).多维人格测验的反应与反应时联合建模分析.江西师范大学学报(自然科学版),(5),453-459.doi:10.16357/j.cnki.issn1000-5862.2022.05.03.
詹沛达.(2019).计算机化多维测验中作答时间和作答精度数据的联合分析. 心理科学,(1),170-178.doi:10.16719/j.cnki.1671-6981.20190126.
詹沛达,Hong Jiao,Kaiwen Man.(2020).多维对数正态作答时间模型:对潜在加工速度多维性的探究.心理学报,(9),1132-1142.
张龙飞,王晓雯,蔡艳,涂冬波.(2020).心理与教育测验中异常反应侦查新技术:变点分析法.心理科学进展,(9),1462-1477.
钟小缘,喻晓锋,苗莹,秦春影,彭亚风,童昊.(2022).基于作答时间数据的改变点分析在检测加速作答中的探索——已知和未知项目参数.心理学报,(10),1277-1292.
Bolsinova,M.,& Maris,G.(2016).A test for conditional independence between response time and accuracy.British Journal of Mathematical and Statistical Psychology,69(1),62-79.doi:10.1111/bmsp.12059
Bolsinova,M.,Tijmstra,J.,& Molenaar,D.(2017).Response moderation models for conditional dependence between response time and response accuracy.British Journal of Mathematical and Statistical Psychology,70(2),257-279.doi:10.1111/bmsp.12076
Chen,Y.,Lu,Y.,& Moustaki,I.(2019).Statistical Analysis of Item Preknowledge in Educational Tests:Latent Variable Modelling and Statistical Decision Theory.arXiv e-prints.arXiv:1911.09408.
Cizek,G.J.(1999).Cheating on tests:How to do it,detect it,and prevent it.New York,NY:Routledge.
Cizek,G.J.,& Wollack,J.A.(2017).Handbook of quantitative methods for detecting cheating on tests.New York:Routledge.
Crittenden,V.L.,Hanna,R.C.,& Peterson,R.A.(2009).The cheating culture:A global societal phenomenon.Business Horizons,52(4),337-346.doi:10.1016/j.bushor.2009.02.004
Domingue,B.W.,Kanopka,K.,Stenhaug,B.,Sulik,M.J.,Beverly,T.,Brinkhuis,M.,...Yeatman,J.(2022).Speed-accuracy trade-off?Not so fast:Marginal changes in speed have inconsistent relationships with accuracy in real-world settings.Journal of Educational and Behavioral Statistics,47(5),576-602.
De Boeck,P.,& Jeon,M.(2019).An overview of models for response times and processes in cognitive tests.Frontiers in Psychology,10.doi:10.3389/fpsyg.2019.00102
Drasgow,F.,Levine,M.V.,& Williams,E.A.(1985).Appropriateness measurement with polychotomous item response models and standardized indices.British Journal of Mathematical and Statistical Psychology,38(1),67-86.
Eckerly,C.A.(2017).Detecting preknowledge and item compromise:Understanding the status quo.Handbook of Quantitative Methods for Detecting Cheating on Tests,101-123.
Kamalov,F.,Sulieman,H.,& Santandreu Calonge,D.(2021).Machine learning based approach to exam cheating detection.PLoS One,16(8),e0254340.doi:10.1371/journal.pone.0254340
Liang,K.,Tu,D.,& Cai,Y.(2023).Using Process Data to Improve Classification Accuracy of Cognitive Diagnosis Model.Multivariate Behav Res,1-19.doi:10.1080/00273171.2022.2157788
Man,K.,& Harring,J.R.(2021).Assessing preknowledge cheating via innovative measures:A multiple-group analysis of jointly modeling item responses,response times,and visual fixation counts.Educational and Psychological Measurement,81(3),441-465.doi:10.1177/0013164420968630
Man,K.,Harring,J.R.,Ouyang,Y.,& Thomas,S.L.(2018).Response time based nonparametric kullback-leibler divergence measure for detecting aberrant test-taking behavior.International Journal of Testing,18(2),155-177.doi:10.1080/15305058.2018.1429446
Man,K.,Harring,J.R.,& Sinharay,S.(2019).Use of data mining methods to detect test fraud.Journal of Educational Measurement,56(2),251-279.
Man,K.,Harring,J.R.,& Zhan,P.(2022).Bridging models of biometric and psychometric assessment:A three-way joint modeling approach of item responses,response times,and gaze fixation counts.Applied Psychological Measurement,46(5),361-381.doi:10.1177/01466216221089344
Marianti,S.,Fox,J.-P.,Avetisyan,M.,Veldkamp,B.P.,& Tijmstra,J.(2014).Testing for aberrant behavior in response time modeling.Journal of Educational and Behavioral Statistics,39(6),426-451.doi:10.3102/1076998614559412
Meijer,R.R.,& Sijtsma,K.(2001).Methodology review:Evaluating person fit.Applied Psychological Measurement,25(2),107-135.doi:10.1177/01466210122031957
Meijer, R. R., & Sotaridona, L.(2006).Detection of advance item knowledge using response times in computer adaptive testing(LSAC research report series; No. CT 03-03). Law School Admission Council.
Meng,H.,& Ma,Y.(2023).Machine learning-based profiling in test cheating detection.Educational Measurement:Issues and Practice,42(1),59-75.doi:10.1111/emip.12541
Molenaar,D.,& Bolsinova,M.(2017).A heteroscedastic generalized linear model with a non-normal speed factor for responses and response times.Paper presented at the British Journal of Mathematical and Statistical Psychology.
Molenaar,D.,Bolsinova,M.,& Vermunt,J.K.(2018).A semi-parametric within-subject mixture approach to the analyses of responses and response times.British Journal of Mathematical and Statistical Psychology,71(2),205-228.doi:10.1111/bmsp.12117
Molenaar,D.,& de Boeck,P.(2018).Response mixture modeling:Accounting for heterogeneity in item characteristics across response times.Psychometrika,83(2),279-297.doi:10.1007/s11336-017-9602-9
Molenaar,D.,Tuerlinckx,F.,& van der Maas,H.L.J.(2015a).A bivariate generalized linear item response theory modeling framework to the analysis of responses and response times.Multivariate Behavioral Research,50(1),56-74.doi:10.1080/00273171.2014.962684
Molenaar,D.,Tuerlinckx,F.,& van der Maas,H.L.J.(2015b).A generalized linear factor model approach to the hierarchical framework for responses and response times.British Journal of Mathematical and Statistical Psychology,68(2),197-219.doi:10.1111/bmsp.12042
Nagy,G.,& Ulitzsch,E.(2021).A multilevel mixture IRT framework for modeling response times as predictors or indicators of response engagement in IRT models.Educational and Psychological Measurement,00131644211045351.doi:10.1177/00131644211045351
Pan,Y.,& Wollack,J.A.(2021).An unsupervised-learning-based approach to compromised items detection.Journal of Educational Measurement,58(3),413-433.doi:10.1111/jedm.12299
Pan,Y.,& Wollack,J.A.(2023).A machine learning approach for the simultaneous detection of preknowledge in examinees and items when both are unknown.Educational Measurement:Issues and Practice,42(1),76-98.doi:10.1111/emip.12543
Qian,H.,Staniewska,D.,Reckase,M.,& Woo,A.(2016).Using response time to detect item preknowledge in computer-based licensure examinations.Educational Measurement:Issues and Practice,35(1),38-47.doi:10.1111/emip.12102
Qiao,X.,& Jiao,H.(2022).Explanatory cognitive diagnostic modeling incorporating response times.Journal of Educational Measurement,58(4),564-585.doi:10.1111/jedm.12306
Ranger,J.(2013).A note on the hierarchical model for responses and response times in tests of van der Linden(2007).Psychometrika,78(3),538-544.doi:10.1007/s11336-013-9324-6
Roskam,E.E.(1987).Toward a psychometric theory of intelligence.Progress in Mathematical Psychology,151-171.
Scheiblechner,H.(1979).Specifically objective stochastic latency mechanisms.Journal of Mathematical Psychology,19(1),18-38.doi:10.1016/0022-2496(79)90003-8
Scheiblechner,H.(1985).Psychometric models for speed-test construction:The linear exponential model.Test Design,Developments in Psychology and Psychometrics,219-244.
Sinharay,S.(2017).Detecting fraudulent erasures at an aggregate level.Journal of Educational and Behavioral Statistics,43(3),286-315.doi:10.3102/1076998617739626
Sinharay,S.(2020).Detection of item preknowledge using response times.Appl Psychol Meas,44(5),376-392.doi:10.1177/0146621620909893
Sinharay,S.(2021).Latent-variable approaches utilizing both item scores and response times to detect test fraud.Open Education Studies,3(1),1-16.doi:10.1515/edu-2020-0137
Thissen,D.(1983).Timed testing:An approach using item response theory.New Horizons in Testing:Latent Trait Test Theory and Computerized Adaptive Testing,179-203.
van der Linden,W.J.(2006).A lognormal model for response times on test items.Journal of Educational and Behavioral Statistics,31(2),181-204.doi:10.3102/10769986031002181
van der Linden,W.J.(2007).A hierarchical framework for modeling speed and accuracy on test items.Psychometrika,72(3),287-308.doi:10.1007/s11336-006-1478-z
van der Linden,W.J.(2008).Using response times for item selection in adaptive testing.Journal of Educational and Behavioral Statistics,33(1),5-20.doi:10.3102/1076998607302626
van der Linden,W.J.(2009).A bivariate lognormal response-time model for the detection of collusion between test takers.Journal of Educational and Behavioral Statistics,34(3),378-394.doi:10.3102/1076998609332107
van der Linden,W.J.(2009).Conceptual issues in response-time modeling.Journal of Educational Measurement,46(3),247-272.doi:10.1111/j.1745-3984.2009.00080.x
van der Linden,W.J.(2009).Conceptual issues in response-time modeling.Journal of Educational Measurement,46(3),247-272.
van der Linden,W.J.,& Lewis,C.(2015).Bayesian checks on cheating on tests.Psychometrika,80(3),689-706.doi:10.1007/s11336-014-9409-x
van der Linden,W.J.,& Van Krimpen-Stoop,E.M.L.A.(2003).Using response times to detect aberrant responses in computerized adaptive testing.Psychometrika,68(2),251-265.doi:10.1007/BF02294800
van der Linden,W.J.,& Guo,F.(2008).Bayesian procedures for identifying aberrant response-time patterns in adaptive testing.Psychometrika,73(3),365-384.doi:10.1007/s11336-007-9046-8
Verhelst,N.D.,Verstralen,H.H.F.M.,& Jansen,M.G.H.(1997).A logistic model for time-limit tests.Handbook of Modern Item Response Theory,169-185.
Wang,C.,Xu,G.,Shang,Z.,& Kuncel,N.(2018).Detecting aberrant behavior and item preknowledge:A comparison of mixture modeling method and residual method.Journal of Educational and Behavioral Statistics,43(4),469-501.doi:10.3102/1076998618767123
Wollack, J.A., & Fremer, J.J.(Eds.).(2013).Handbook of test security(1st Ed.). Routledge. New York, NY: Routledge.
Zhan,P.(2022).Joint-cross-loading multimodal cognitive diagnostic modeling incorporating visual fixation counts.Acta Psychologica Sinica,54(11),1416-1432.doi:10.3724/SP.J.1041.2022.01416
Zhan,P.,Jiao,H.,Man,K.,Wang,W.C.,& He,K.(2021).Variable speed across dimensions of ability in the joint model for responses and response times.Front Psychol,12,469196.doi:10.3389/fpsyg.2021.469196
Zhan,P.,Jiao,H.,Wang,W.-C.,& Man,K.(2018).A multidimensional hierarchical framework for modeling speed and ability in computer-based multidimensional tests.arXiv preprint.arXiv:1807.04003.
Zhan,P.,Man,K.,Wind,S.A.,& Malone,J.(2022).Cognitive diagnosis modeling incorporating response times and fixation counts:Providing comprehensive feedback and accurate diagnosis.Journal of Educational and Behavioral Statistics,47(6),736-776.doi:10.3102/10769986221111085
Zhen,Y.,& Zhu,X.(2023).An ensemble learning approach based on tabNet and machine learning models for cheating detection in educational tests. Educational and Psychological Measurement.doi:10.1177/00131644231191298
Zhou,T.,& Jiao,H.(2023).Exploration of the Stacking Ensemble Machine Learning Algorithm for Cheating Detection in Large-Scale Assessment.Educational and Psychological Measurement,83(4),831-854.doi:10.1177/00131644221117193
Zopluoglu,C.(2019).Detecting examinees with item preknowledge in large-scale testing using extreme gradient boosting(XGBoost).Educ Psychol Meas,79(5),931-961.doi:10.1177/0013164419839439
Zopluoglu,C.,Kasli,M.,& Toton,S.L.(2021).The effect of item preknowledge on response time:Analysis of two datasets using the multiple-group lognormal response time model with a gating mechanism.Educational Measurement:Issues and Practice,40(3),42-51.doi:10.1111/emip.12428

备注/Memo

备注/Memo:
 通讯作者:徐庆树,E-mail:xuqingshu@hunnu.edu.cn。
更新日期/Last Update:  2023-10-20