Open book assessments test a student’s ability to find and apply information and knowledge rather than recall it from memory.
Delivering open book assessments online allow students to use existing materials to answer essay questions, respond to a scenario or solve a problem within a set timeframe.
Students should have a minimum 48-hour period to complete and submit the exam. Additional flexibility may be required for disabled students.
The University has developed a set of principles for the assessment of students with disabilities:
Designed to test higher-order learning, open book online assessments should ask students to apply, analyse, synthesise, compare, contrast or evaluate information.
They should test whether they understand the “big picture” of the course and how course concepts work together. They test students’ ability to find and use information for problem-solving, and to deliver well-structured and well-presented arguments and solutions.
As a result, you should have higher expectations of the quality of answers and the extent of critical and analytical thinking, knowing students have course materials available to draw upon. However, answers may be shorter since students will spend more time retrieving information than they would do in a closed book assessment.
The University has several systems for enabling open book assessments. The most appropriate technology to use will depend on the format of the assessment.
The table below sets out the recommended technologies for the most common assessment formats. If your assessment format is not covered please contact the DES Support Helpdesk.
|Open-ended questions||Closed questions|
|Only involves standard characters, the answer can be written on computer/device (e.g. essay question)||Involves non-standard characters or diagrams (e.g.requires hand-written answer)||MCQs Numeric answers word answers||Programming|
|Flexible within 48-hour window||Turnitin (best for essay questions) Top Hat Pages (better for multiple short answer questions)||Gradescope Homework or Online Assignment||Top Hat Pages or Minerva Test||Gradescope Programming Assignment|
|Time-limited within 48-hour window (note that this should only be used where there is a specific PRSB requirement)||Gradescope Online Assignment or Top Hat Tests||No solution available||Gradescope Online Assignment, Minerva Test or Top Hat Tests||No solution available|
A detailed comparison of the functionality of each system is also available and can be downloaded at the end of this guide.
The following guidance has been developed with the Programmes and Assessment Team (Student Education Service). Please direct questions about this guidance to the exams team: firstname.lastname@example.org.
This will provide clarity and consistency for students and ensure that the assessment load for students on interdisciplinary programmes is properly managed.
In exceptional circumstances where there is a specific Professional, Statutory and Regulatory Bodies (PSRB) requirement, it may be appropriate to set a time-limited assessment in which students have a specific period (e.g. 3 hours) to complete their assessment once they start it.
In these cases, students should be allowed to start the assessment at any point during the 48-hour period to accommodate differing time zones and interdisciplinary deadlines. Disability adjustments must be made where appropriate. Schools taking this approach must contact the Faculty Assessment Manager.
Schools should ensure that there is a clear process in place to support timely responses to student queries, both on the content of the assessment and the logistics. It should be made clear to students at what times support will be available (including services and systems support). When planning this support, please consider students taking examinations in differing time zones.
When setting an online open assessment, it is important to provide students with clear instructions as to what is required of them. Students are likely to be unfamiliar with this form of assessment. For each exam, a rubric should be published which should set out clear expectations for how the work will be evaluated, such as:
Exam rubrics should be published within the Assessment area in the Minerva module. An Online Time-limited rubric template is available from your SES team.
If students to need to access specific texts for assessments, please ensure your reading list is up to date. Use the Minerva Reading List Tool to update your list. Indicate on your reading list where a text is critical for an assessment.
Please update your lists as soon as possible. There may be limits to the number of students who can access a text at any one time, so it is important to flag texts that you expect students to be using intensively over a short assessment period. If you have any queries about your reading list, please contact email@example.com.