UNIwise

View Original

WISEcon 2019: Beyond the Standard Written Exam

What constitutes a good exam? Hanne Leth Andersen, Vice-Chancellor at Roskilde University, has a clear opinion: The recipe for a good exam consists of alignment between the teaching methods, the learning objectives, and the types of assessment.

Hanne Leth Andersen, Vice-Chancellor at Roskilde University, presenting at WISEcon 2019

Accompanying every exam is an assessment process. Andersen identified four types of assessment: Diagnostic assessment which takes place at the beginning of the course; integrative assessment including feedback utilised to influence the students’ future learning; formative assessment with continuous assessment throughout the duration the course; and finally, summative assessment at the end of the course. Formative and especially summative assessment are the most easily applied and by far the most commonly used in higher education, however, diagnostic assessment can serve as a means to provide insight into the individual student’s abilities at the beginning of a course and integrative assessment, in turn, has the possibility to embrace more innovative exam forms.

All participants at WISEcon 2019 listening to the opening presentation by Vice-Chancellor Andersen

Generally, in assessment, various underlying conditions determine what kind of assessment fits best with the individual course’s content. For one, validity and reliability play an important role: There must be an alignment between the course objectives, the operational demands for the exams and the assessment guidelines to create assessment validity. Furthermore, the assessment practice must be precise and consistent to claim reliability. Secondly, the economy of the assessment practice must be taken into consideration, because the individual institutional resources, rules, and regulations strongly influence the choice of exam types and following the assessment practice. Thirdly the assessment form must somehow respond to the skills required by the student to possess in later work life, thereby creating a form of authenticity between education and work life.

Beyond the Standard Written Exam: WISEflow for Practice-Based Courses and Virtual Reality

“What standardised testing can’t measure is difference. It can’t measure innovation; it can’t measure thinking out of the box.” (Douglas Thomas, 2012).

Arts University of Bournemouth (AUB) did a presentation at WISEcon 2019 focusing on how they have implemented WISEflow as a university of arts. With an artistic mindset, AUB spoke to the quote of Douglas Thomas, proving how digital assessment platforms indeed can be an integrated part of testing and assessing innovation, creativity, or in other words thinking outside the box. With a palette of courses in the fields of media, performance, architecture, design, and art, AUB hosts exams where they assess various artefacts, digital or non-digital products, performances, and alike. But how does AUB do this in practice? They use three types of flows: FLOWhandin, FLOWassign, and FLOWattend. FLOWhandin is used for various creative artefacts and products that can be digitally submitted, for written exams, FLOWassign is utilised, and lastly is FLOWattend’s assessment module the collaborator in exams involving performances. This case of AUB is proof of how digital exams and assessment platforms are not incompatible with exams in art and thus emphasises that the assessment of innovation and creativity is possible within the scope of digital assessment platforms. AUB themselves said at their presentation, that by implementing and using a digital exam and assessment platform the work processes for their staff have been both simplified and optimised.

Alison Aspberry, Head of Quality and Standards at Arts University Bournemouth

Alex Bradbeer, Senior Systems Administrator in Digital Learning at Arts University Bournemouth

With a slightly different approach to thinking out of the box, Leo Park CEO at DUCOgen in South Korea, at WISEcon 2019 outlined how Virtual Reality equipment can be used in partnership with a digital exam and assessment platform. Leo showed how WISEflow could be used as a tool for answering questions put forward in the VR-Tasks by for instance showcasing still-pictures and video recordings from the VR-Universe in WISEflow with an attached multiple-choice or short text question. The use of VR-equipment in digital exams makes especially good sense when a simulation of a real-life situation is included in the exam. Some examples Leo provided were fixing technical problems at a ship included in an exam for mechanical engineers or a simulation of surgery for medical students. With a basis in interactive learning, Leo strives for creating memorable and highly relevant learning experiences in cooperation with digital examination and assessment.

Leo Park, CEO at DUCOgen in South Korea, showcasing how Virtual Reality equipment can be used in digital exams

These are only some of the interesting points from WISEcon 2019, and soon you can read additional blog posts regarding the conference for instance about data analytics, personalised study advice and cheating by the use of third-party programs and cheating in digital exams. If we have evoked your interest in how to move beyond the standard written exam our website contains many other interesting blogs about digital examination and assessment. For a non-committable conversation about your institution’s examination practices or a demonstration of our digital examination and assessment platform WISEflow, we encourage you to contact one of our UNIwise branches in Denmark, Norway, or the UK. You can find more contact information here.