Online open book assessment

Open book assessments test a student’s ability to find and apply information and knowledge rather than recall it from memory.

Delivering open book assessments online allow students to use existing materials to answer essay questions, respond to a scenario or solve a problem within a set timeframe.

Students should have a minimum 48-hour period to complete and submit the exam. Additional flexibility may be required for disabled students.

Accessibility and inclusivity

The University has developed a set of principles for the assessment of students with disabilities:

Aims of open book online assessments

Designed to test higher-order learning, open book online assessments should ask students to apply, analyse, synthesise, compare, contrast or evaluate information.

They should test whether they understand the “big picture” of the course and how course concepts work together. They test students’ ability to find and use information for problem-solving, and to deliver well-structured and well-presented arguments and solutions.

As a result, you should have higher expectations of the quality of answers and the extent of critical and analytical thinking, knowing students have course materials available to draw upon. However, answers may be shorter since students will spend more time retrieving information than they would do in a closed book assessment.

Selecting technologies

The University has several systems for enabling open book assessments. The most appropriate technology to use will depend on the format of the assessment.

The table below sets out the recommended technologies for the most common assessment formats. If your assessment format is not covered please contact the DES Support Helpdesk.

Open-ended questions Closed questions
Only involves standard characters, the answer can be written on computer/device (e.g. essay question) Involves non-standard characters or diagrams (e.g.requires hand-written answer) MCQs Numeric answers word answers Programming
Flexible within 48-hour window Turnitin (best for essay questions)        Top Hat Pages (better for multiple short answer questions) Gradescope Homework or Online Assignment Top Hat Pages or Minerva Test Gradescope Programming Assignment
Time-limited within 48-hour window (note that this should only be used where there is a specific PRSB requirement) Gradescope Online Assignment or Top Hat Tests No solution available Gradescope Online Assignment, Minerva Test or Top Hat Tests No solution available

 

A detailed comparison of the functionality of each system is also available and can be downloaded at the end of this guide.

Administering an online open book exam

The following guidance has been developed with the Programmes and Assessment Team (Student Education Service). Please direct questions about this guidance to the exams team: examinationsofficer@leeds.ac.uk.

  • Assessments should be released to students via the module area in Minerva at the planned start time for the assessment.
  • Students should have a minimum 48-hour period to complete the assessment and submit via the assessment tool. Additional flexibility may be required for disabled students.
  • The Online Time-limited assessment template front cover should be used where appropriate, these are in line with the standard exam paper templates and is good practice.

This will provide clarity and consistency for students and ensure that the assessment load for students on interdisciplinary programmes is properly managed.

PSRB exceptions

In exceptional circumstances where there is a specific Professional, Statutory and Regulatory Bodies (PSRB) requirement, it may be appropriate to set a time-limited assessment in which students have a specific period (e.g. 3 hours) to complete their assessment once they start it.

In these cases, students should be allowed to start the assessment at any point during the 48-hour period to accommodate differing time zones and interdisciplinary deadlines. Disability adjustments must be made where appropriate. Schools taking this approach must contact the Faculty Assessment Manager.

Student queries

Schools should ensure that there is a clear process in place to support timely responses to student queries, both on the content of the assessment and the logistics. It should be made clear to students at what times support will be available (including services and systems support). When planning this support, please consider students taking examinations in differing time zones.

Providing instructions for students

When setting an online open assessment, it is important to provide students with clear instructions as to what is required of them. Students are likely to be unfamiliar with this form of assessment. For each exam, a rubric should be published which should set out clear expectations for how the work will be evaluated, such as:

  • the level of detail required
  • the extent to which students are expected to consult additional resources
  • the level of referencing expected
  • a word limit, or an overall expected time to complete

Exam rubrics should be published within the Assessment area in the Minerva module. An Online Time-limited rubric template is available from your SES team.

Ensuring key texts are accessible

If students to need to access specific texts for assessments, please ensure your reading list is up to date.  Use the Minerva Reading List Tool to update your list. Indicate on your reading list where a text is critical for an assessment.

Please update your lists as soon as possible. There may be limits to the number of students who can access a text at any one time, so it is important to flag texts that you expect students to be using intensively over a short assessment period.  If you have any queries about your reading list, please contact readinglists@library.leeds.ac.uk.

Further guidance

The following documents provide some helpful guidance for staff on the design of online open book assessments:

Relevant Events

View all Events

Join this event suitable for academic staff and PGRs who teach, and SES staff who help set up assessments.

more

Join this event suitable for academic staff and PGRs who teach, and SES staff who help set up assessments.

more

Join this event suitable for academic staff and PGRs who teach, and SES staff who help set up assessments.

more

Join this event suitable for academic staff and PGRs who teach, and SES staff who help set up assessments.

more