Proctoring: How to Ensure the Integrity of Online Assessment
.jpg "Proctoring: How to Ensure the Integrity of Online Assessment")
17% of HSE’s spring-summer session exams will be administered with proctoring software that ensures the integrity of online assessment. Read on to learn how proctoring software is used at HSE University and what its advantages are over traditional in-person monitoring in the classroom.
Five Years’ Experience
HSE University is one of the first Russian universities to use proctoring software for its online exams. It all started in 2016, when students taking HSE courses on the National Open Education Platform began to take exams. At this time, the Proctoring Centre was created at the eLearning Office, and Examus, one of Russia’s leaders in proctoring software, became a tech partner of the University.
Every year at HSE University, several thousand students take proctored exams, so the procedure for the university is not new. 10-12,000 exams are administered with Examus proctoring platform.
Last year alone, HSE University administered:
4,500 proctored exams
for students from partner universities as part of network academic programmes
2,200 proctored entrance exams
for international applicants and new doctoral programme enrollees
More than 2,000 proctored exams
for students of HSE’s online courses on the National Open Education Platform
The Examus Proctoring System is used by most of Russia’s leading universities who offer courses on the National Open Education Platform, as well as corporate universities. Today, it is one of the most reliable systems.
Last year, online proctored entrance exams were conducted for the first time for the applicants of the ‘Master of Data Science’ programme offered fully online in partnership with Coursera.
Synchronous and Asynchronous
There are two types of proctoring: synchronous proctoring and automatic asynchronous proctoring which is then verified afterwards.
In the first case, the exam is monitored in real time by an online or external proctor, an Examus employee, or a specially trained HSE staff member. The activity of the test taker is recorded in two ways: the student is recorded via their web camera, and the student’s desktop (their computer screen) is recorded by the system. Before the exam, the proctor verifies the student’s identity (by checking their passport), and during the exam, the proctor can contact the student via the system chat window. One proctor monitors the exams of up to six students at a time.
In the second case, the computer programme completes the student identity verification process and monitors the entire exam process by monitoring the student via the student’s webcam. The programme flags suspicious behavior (such as the appearance of other individuals in the frame or talking) by placing tags on the video. These flagged instances are then checked by a human proctor when they view the recording.
The decision on whether a student has violated internal rules during an exam (plagiarized or cheated) is made by the student’s instructor. If the student considers the instructor’s decision to be unfair, they can file an appeal, which will be reviewed by their programme academic supervisor and the appeal commission. The advantage of using proctoring software is that the commission will have a documented video of the exam.
During the Pandemic
This spring, proctoring technology was widely used for the HSE Lyceum entrance exams, which students took remotely. According to Lyceum Director Dmitry Fishbeyn, the examination process generally ran smoothly, though the online format proved much more time-consuming for all involved.
Russia’s current self-isolation rules do not allow for taking exams in person, which is why most Russian universities are administering a significant share of their exams online. HSE is no exception: though the majority of student exams for the third and fourth modules will begin on June 10, some programmes began their exams in May. For example, exams began at the ICEF a little earlier due to requirements of its double degree programmes.
17% of the spring-summer session final exams will be administered with proctoring software. On exams administered to smaller groups of students, proctors will observe the students synchronously. Exams that are taken by hundreds or even thousands of students (about 2,000 people can take a foreign language exam at one time, for example) will be proctored asynchronously. In some cases, at the discretion of programme academic supervisors, proctoring may also be used on oral exams. In these cases, students will be monitored while preparing their oral responses on Zoom or MS Teams.
The number of proctored online exams this session has increased tenfold compared to last year. By the end of June, almost 23,000 students will have taken online proctored exams.
Rules of Conduct
The rules for taking and administering online exams with proctoring software are available here. The rules indicate the technical requirements that a user’s computer must meet as well as the necessary internet connection quality. The HSE Proctoring Centre estimates that 7-10% of students will encounter technical difficulties due to a poor internet connection. For example, if a student is taking their exam from a remote area in the country and has to use a cellular network connection, and their family members are also using the connection at the same time, the programme many not be able to support the two required video streams.
To ensure that the proctoring software runs smoothly, students should also pay attention to other aspects that may hinder it. For example, students should make sure their work area is quiet and that it is well lit so that they are visible on camera. In order to check these potential issues as well as your equipment, a trial exam is held the day before.
Almost all of the rules for taking online proctored exams are consistent with the requirements for any onsite exam. The only difference lies in the technical requirements, which are indicated in advance, and these are consistent with the general technical requirements of any distance learning course. If students fulfill these requirements and read the instructions, they will experience no problems during their exams. In case of technical trouble, students will be able to retake the exam at a later date.
Answers to Questions
Teachers who were not familiar with proctoring software had questions, such as whether the software really does ensure the integrity of the examination process and prevent cheating, plagiarism, and other forms of improper behavior.
‘Proctoring is a high-tech procedure. It’s not just a video recording of students and their desktops. It is based on a smart algorithm that identifies and flags changes in student behavior, which the teacher may not notice. Therefore, observing an online exam using proctoring is better and more effective than observing a regular onsite exam in person,’ colleagues from the HSE Proctoring Centre say.
Students, on the other hand, voiced concerns about the software. They worried about technical malfunctions and the additional stress it could cause. HSE Vice Rector Sergey Roshchin addressed students’ concerns at a recent HSE Student Council meeting.
But if some time ago many students had no idea how online proctoring works, now the situation is much different. Uncertainty is behind us, detailed answers to frequently asked questions are available, and you can read instructions, as well as opinions and reviews from students who have gone through the process. The first students did trial testing on June 5.
Possibilities
The coronavirus pandemic and the University’s subsequent transition to distance learning showed the importance of having a proctoring procedure in place. But even after in-person instruction is resumed, it is clear that proctoring technology will continue to play an important role in education at HSE, and that this role will only increase with every year.
Alexey Chukarin, Senior Director for Digital Transformation
The HSE IT Office intends to embed proctoring tools in the SmartLMS educational platform that is being created. But we won’t stop there. It will be necessary to develop proctoring tools so that we can improve video analytics algorithms, take into account behavioral patterns, and automatize the proctor’s work as much as possible. Our immediate agenda includes summarizing the experience we have gained so far, as well as that of our domestic and international partners, so that we can jointly develop this important tool.
Sergey Roshchin
HSE Vice Rector
Alexey Chukarin
Senior Director for Digital Transformation
See also:
HSE University Launches Its Own Independent English Exam
The exam has been developed by the HSE School of Foreign Languages in compliance with all relevant international standards. On May 13, the Independent English Language Examination Centre opened in the HSE University building on Staraya Basmannaya Ulitsa, and the first students took the exam on May 16. In the future, the opportunity to take an independent assessment at the Centre is expected to be available not only to HSE students, but also to students from other universities, schoolteachers, and corporate clients.
'This was a Major Task for All University Services'
July marked the end of the first HSE academic term conducted entirely in remote format. Specialists of the eLearning Office and Digital Services told HSE University Life how they prepared for it and which problems they encountered.
‘The Lockdown Was a Good Thing for My Studies: I Had More Time to Prepare for Exams’
The summer final exam session at HSE University (as well theses defences) was conducted completely online. The HSE News Service talked to international students about what they thought of the new knowledge assessment technologies and how they would like to take exams in future.
‘Studying for Exams from the Comfort of My Own Home Is Easy’
How did the beginning of the exam session go for HSE University’s international students? What helps them when they are studying for their exams? Do they like taking exams online? HSE News Service talks with HSE students from different countries.
‘Proctoring Increases Risks for Those Who Want to Copy at Exams’
Albert Belkov, a third-year undergraduate student at HSE ICEF, has taken three proctored exams this spring and summer—in Optimization Theory, Macroeconomics, and Financial Mediation. He shared his experiences with the HSE News Service.
‘In the Reality of the 21st Century, an Online Form of Examination is a Necessity’
On June 10, the examination period began at HSE University, and some of the exams are being administered through the use of proctoring technology. This type of exam was trialed on some programmes in May. Below, undergraduate students and a study office employee who worked as a proctor share their experiences of proctored exams.
Mock Entrance Exams Now Available Online for HSE Applicants
Almost all applicants would like to get a sense of their chances of being accepted to HSE University, without having to wait for the results of their entrance exams and the application process. Now you have the opportunity to do so!
Posters and Fashion Shows: The New Final Exam
This is not the first year that certain HSE programmes are giving an unusual twist to the way they give exams and carry out thesis defences. Below are a few notable examples.