Technology for conducting computer-based assessment in mathematics under extreme conditions of martial law

Abstract

The paper investigates the problem of organizing and conducting computer-based knowledge assessments in mathematics at Igor Sikorsky Kyiv Polytechnic Institute under martial law conditions. This period is characterized by threats of missile attacks, power outages, or internet disruptions, leading to reduced time for developing test tasks, disruption of the schedule for control measures, interruption of test-taking, and the inability to respond to student inquiries and administer testing online. In response to these challenges, the authors examine the choice of platform for testing, selection of experts, procedures for developing and reviewing test tasks, regulations for conducting testing, and statistical analysis of the quality of test tasks. The answers to these questions form the stages of the appropriate technology for conducting computer-based knowledge assessments under extreme conditions.

Special attention is given to preventing academic dishonesty, such as cheating and the use of additional resources and «consultants». To combat this, the use of «embedded answer» tasks is proposed, which partially allow for the verification of problem-solving steps, as well as the creation of an extensive test task database, enabling the generation of new test variants for each assessment. Wolfram Mathematica and Geogebra services are used to address these tasks. Additionally, the focus is on creating tasks with clear answers for students, minimizing ambiguity. The authors developed special programs to form an extensive task database. As an integral part of creating the task database, the developed technology includes statistical analysis of test task quality, based on methods of Classical Test Theory (CTT), Item Response Theory (IRT), and Multidimensional Item Response Theory (MIRT).

Based on extensive practical experience in real computer-based testing, practical recommendations for applying the technology, which can be useful for other disciplines besides mathematics, have been developed.