X Close

Digital Education team blog

Home

Ideas and reflections from UCL's Digital Education team

Menu

Archive for the 'Digital Assessment' Category

Moodle Exam guard

By Eliot Hoving, on 19 April 2024

UCL Moodle has been updated with a new feature called Exam guard.

What is it?

Exam guard will prevent users from editing their course from 10 minutes before the start of a Moodle quiz until 10 minutes after the quiz has finished. Exam guard does this by looking at the “open the quiz”/ “close the quiz”  setting when a Moodle quiz is created. The course editing freeze will only apply where the Moodle quiz is open for less than 5 hours as it is designed to target Moodle quizzes being used for controlled condition exams.

A banner will appear at the top of your course when Exam guard is in effect.

Exam guard banner on a course page

Why is this required?

In the past, when users have attempted to edit and save changes to a Moodle course while a quiz is underway, it has caused serious performance issues while Moodle tries to refresh caches and implement the changes. This issue is particularly bad where a large cohort (300+) are taking the quiz, and has caused exams to be disrupted.

What do I need to do?

Exam guard will work automatically and should have no impact on the majority of workflows. Staff can still post to forums, and mark submissions in other assignments. They can also add user overrides for late minute ECs and SORA students to a quiz.

Staff will not be able to edit course settings or create or edit activities in their course while the exam is running.

Staff will no longer be able to manually release a Moodle quiz by making the quiz visible at the exam start time. This workflow is not recommended or required. A better approach is for staff to set the Moodle “open the quiz” setting to the exam start date and time when creating the quiz. Students will see the quiz item on Moodle but aren’t able to access the questions or begin the quiz before the open date and time so there is no risk your exam is released early.

Important Notice: Moodle groups

By Kerry, on 12 April 2024

Groups with “Hidden” or “Only see own membership” visibility are designed by Moodle to be secure so as not to disclose sensitive information.

It recently came to our attention that as a result they cannot be used when filtering assignments for markers.

If you do require groups that are filterable for markers, you will need to create new groups with group visibility set to “visible” or “only visible to members” and avoid naming them anything that could disclose they are for SORA or another specific group of students. This is because students within such a group can see who else is a member.

Any questions, please contact digi-ed@ucl.ac.uk

Initial release of Marks Transfer available on UCL Moodle!

By Kerry, on 18 March 2024

What is it?

A new UCL Moodle integration is now available to facilitate the transfer of marks from Moodle to Portico, aimed at improving the overall process. The marks transfer integration has been tested during two pilot phases and has received very positive feedback.

You can complete marks transfer for the following assessment scenarios:

  • One Moodle assessment activity is linked to one assessment component in Portico
  • One Moodle assessment activity is linked to multiple assessment components in Portico

Using the following Moodle assessment activity-types:

  • Moodle Assignment
  • Moodle Quiz
  • Turnitin Assignment (single submission)

In addition, the following conditions must be met:

  • A Portico enrolment block must be used to create a mapping with a Module Delivery to your Moodle course.​
  • An assessment component (or components) exists in Portico to map against.​
  • Assessment marks are numerical and 0-100.​
  • The assessment component(s) in Portico is compatible with SITS Marking Schemes and SITS Assessment Types.​
  • For exam assessments, the Portico assessment component is the exam room code EXAMMDLE. 

The flowchart below provides a visual overview of when you can use this initial release of Marks Transfer.

Flowchart indicating when you can use the initial release of Marks Tranfer.

How do I use it?

For guidance on how to use marks transfer, you can view our general overview, how to guide and FAQs.

There will also be demonstration and drop in support sessions: open to all to find out how to use the wizard / ask questions (note – you are welcome to “drop in” to these sessions with questions and do not need to stay for the whole duration). Please use the links below on the specified date / time to join the sessions (alternatively, if you would like to receive a calendar invitation to join one of these sessions, please email currentstudent@ucl.ac.uk specifying which session).

What should I do if I require support?

Please review our detailed FAQs, if you cannot find your answer there, please use one of the following contact points:

  • For any issues with using the marks transfer tool, please contact digi-ed@ucl.ac.uk
  • For any issues with Portico data eg. incorrect assessment or student information, contact lifecycle@ucl.ac.uk
  • Please provide any feedback about the Marks Transfer Wizard to your Faculty Champion.

What next?

Following this initial release, we will continue to develop the integration by adding further marking scenarios and functionality.

Current development priorities are:

  • Grade Book items and categories including external LTI resources
  • Handling of SoRAs, ECs and LSAs
  • Turnitin Multipart Assignments

This is a very exciting development for assessment administration at UCL. We hope you find the new Moodle Marks Transfer integration beneficial!

Many thanks,

Digital Learning Environments and the Student Records Team

Moodle-SITS Marks Transfer Pilot Update

By Kerry, on 9 February 2024

As some of you may be aware, a new Moodle integration is due to be released in the spring which has been designed and developed by the DLE Team to improve the process for transferring marks from Moodle to Portico. It is called the Moodle-SITS Marks Transfer Integration and we are currently trialing this with around 40 course administrators across the institution.

The pilot kicked off on 8 January and will run until 29 February 2024. The purpose of the pilot is to test the Moodle-SITS Marks Transfer Integration using the newly designed Marks Transfer Wizard and its marks transfer functionality that was developed following the Phase 1 Pilot, which took place with a very small group of course administrators at the end of last year. This wizard provides a more streamlined experience for end users by putting the core assessment component information at the centre of the tool which can then be mapped to a selection of Moodle assessments.

Pilot Phase 2 is the last pilot phase before an initial MVP (Minimal Viable Product) release into UCL Moodle Production in late March 2024. Currently, users can take advantage of the integration if the following criteria are met:

  1. They have used the Portico enrolment block to create a mapping with a Module Delivery on their Moodle course.
  2. Either of the following assessment scenarios is true:-
    1. Only one Moodle assessment activity is being linked to one assessment component in SITS.
    2. Only one Moodle assessment activity is being linked to multiple assessment components in SITS.
  3. An assessment component exists in SITS to map against.
  4. The Moodle assessment marks are numerical 0-100.
  5. The assessment component in SITS is compatible with SITS Marking Schemes and SITS Assessment Types.
  6. For exam assessments, the SITS assessment component is the exam room code EXAMMDLE.

The Marks Transfer Wizard currently supports the transfer of marks from one of the following summative assessment activities in Moodle:

  • Moodle Assignment
  • Moodle Quiz
  • Turnitin Assignment (NOT multipart)

We intend to collect feedback on the new Marks Transfer Wizard from pilot participants to improve the interface and workflow for a general UCL-wide release in late March 2024 and also to prioritise next step improvements and developments following the launch.

So far informal feedback has been very positive: users say the assessment wizard works well and will save them a lot of time. The pilot has also been useful for exploring where issues might arise with Portico records or Moodle course administration as well as for gathering frequently asked questions and advice on best practice which will feed into our guidance for wider rollout.

So what are the next steps? Well, we will continue to support our pilot participants until the end of February. In mid-February, the Marks Transfer Assessment Wizard will be updated with some interface improvements so participants will be able to feedback on these too. Towards the end of February, participants will be asked to complete a survey and some will take part in a focus group to help us evaluate the success of the MVP integration and to prioritise our plans for future developments. In addition, our Change Manager is working with us on a communications plan for wider release on UCL Moodle Production and is currently in the process of recruiting a network of champions to cascade guidance and best practice on Moodle-SITS Marks Transfer across UCL, as well as to help us to continue to gather feedback on the user experience. More information about this exciting new development will be available in the coming months!

The Assessment Matrix Resurrected

By Claudia Cox, on 31 October 2023

Credit: Tobias_ET, 2017.

The Digital Assessment Team are pleased to announce a new version of the Assessment Matrix tool, which replaces and expands on a comparison table of the main technologies used for assignments at UCL.

Overview of the Matrix

The Assessment Matrix tool is aimed at helping users in the process of designing assessments decide which platform is best suited for delivery. In addition to providing a quick, visual guide of what different platforms can offer online, users can also download an offline, interactive version of this resource and filter assessment options based on their submission, marking and feedback, and administrative needs.

View the Assessment Matrix.

The tool is expected to be relevant to both academics and administrative staff. It will serve as a valuable starting point for discussions that occur after assessments have been aligned with learning outcomes but before they have been fully developed and designed, and before the platform to be used has been finalised. The decision on which platform should be used will also need to consider faculty approach, tools used for formative assessment and other factors.

The new version contains information on the following platforms:

  • Moodle assignment
  • Turnitin Assigment (in Moodle)
  • Wiseflow – the UCL AssessmentUCL digital assessment platform [NEW]
  • Reflect – the UCL version of the WordPress blogging service [NEW]
  • MyPortfolio – the UCL version of the Mahara eportfolio platform
  • Crowdmark – an assessment tool currently used by the maths department [NEW]

The matrix covers assessment submission options (such as type of formats that can be submitted, if group work is possible and text editor options), marking (such as if double or blind marking are available, audio feedback options and inline annotation) and feedback and administrative settings (such reporting, export of content and integration with SITS).

A screenshot of the updated assessment matrix

Accessibility

Initial feedback on the Assessment Matrix highlighted the importance of testing resources to ensure they meet accessibility requirements. Originally this was intended to have a ‘traffic light’ design to indicate whether tools met users’ needs for assessment, however due to the limited cell colour range available on the Confluence wiki this would not have met WCAG 2.2.

Using staff recommended tools such as COBLIS and TPGi’s Colour Contrast Analyser are great ways to help ensure that any resources and materials are WCAG compliant and allowed us to find a colour scheme that works for a broader audience of users.

Feedback

Digital Assessment Team has been cautious about overloading the matrix to prevent overwhelming its users. However, they are eager to ensure that the matrix remains as user-friendly as possible. If you spot anything that needs updating or editing please contact the Digital Assessment Team (assessment-advisory@ucl.ac.uk).

If you wish to discuss your assessment approach in more detail refer to the education support contacts in your faculty and department.

Updating Our Academic Integrity Resources

By Marieke Guy and i.bowditch, on 10 October 2023

In the ever-evolving landscape of higher education, maintaining academic integrity is paramount. Educational institutions are tasked not only with upholding these standards but also with fostering a culture of academic honesty. At UCL the commitment to academic integrity has led to a revamp of existing resources, driven by a desire to offer the most effective support possible.

We recognise that when it comes to guiding students on academic integrity, a punitive approach falls short. Instead, we want to start with positive framing that taps into the broader motivations of students and positions them as valued contributors to an academic community of practice. The institution does not assume that students inherently understand these practices or that violations should always result in punishment. Rather we view the key causes of plagiarism as opportunities for learning and growth. For instance, Turnitin, a well-known plagiarism detection service, is seen as a tool to assist students in learning rather than merely as a plagiarism detector.

Review and Refresh

At the end of last year, the Digital Assessment Team carried out an audit of academic integrity resources at UCL, which uncovered the need for a refresh. This need became even more pronounced with the advent of Generative Artificial Intelligence (AI). We have now completed the review and refresh of our academic integrity resources for the academic year.

Turnitin Similarity Checker

One of the longstanding resources, the “Plagiarism and Academic Writing for Students” course, has served UCL for over a decade. This course primarily allows students to check their assignments for plagiarism by generating a similarity report through Turnitin. The assignments are not added to the institutional repository, and the course is reset regularly.

The course has now been streamlined to focus solely on explaining Turnitin’s purpose and guiding students on how to create and use the similarity report. An introduction from Ayanna Prevatt-Goldstein, Head of UCL Academic Communication Centre, has been added to give context on how use of Turnitin relates to good academic practice.T o provide a comprehensive experience, an additional section now offers links to other UCL resources related to academic integrity. These are:

  • Academic integrity hub – A student-facing hub area for all guidance on academic integrity including links to information on academic misconduct, academic misconduct panels and Frequently Asked Questions.
  • UCL Academic Communication Centre – The UCL Academic Communication Centre (ACC) supports UCL students to develop their academic language and literacies. We assist students of all language backgrounds, across faculties, at all levels of study, to communicate more effectively in their discipline.

Understanding Academic Integrity Course for Students

UCL has also recently released an updated version of the Understanding Academic Integrity course for students, now hosted on the primary UCL Moodle site: the course previously sat on the UCL Extend platform. This course aims to educate students about all aspects of academic integrity and covers:

  1. How much do I know about academic integrity?
  2. What is academic integrity?
  3. Acknowledging the work of others
  4. Using collaboration positively
  5. Contract cheating
  6. Artificial Intelligence and Academic Integrity
  7. Check your understanding of academic integrity and academic good practice

The revised course content has been built collaboratively with staff and students and incorporates insights from academic integrity and academic writing experts at UCL. It addresses emerging concerns like the use of Generative AI in academia and the course features various elements, including short videos, reflective activities, quizzes, and a final certification quiz.

Students can self-enrol for the course and on completion of all required activities and a success rate in the quiz will receive a certificate of completion, which can serve as evidence of their commitment to academic integrity and be shared with their tutors.

At the start of the course students are asked to post their responses on a mentimeter activity asking  ‘Why do you think students don’t always act with academic integrity?’ . These are the results so far (mid October 2023, 1011 participants, 2547 votes):


To ensure that academic integrity remains current, UCL has devised a plan for annual course refreshers. Annual refreshers are particularly important in the evolving context of Generative AI. Course content on GenAI and its relation to academic integrity will need to be revised in line with both technological and policy developments in this area.

Course video on Artificial Intelligence and Academic Integrity

Older versions of the course are archived to maintain access to logs if needed for academic misconduct panels. In cases where students may still access the previous Extend version, a notice redirects them to the new version on Moodle.

As UCL continues to evolve its approach to academic integrity, it exemplifies a commitment to not just maintaining standards but enhancing the support and resources available to students. This proactive approach ensures that UCL students are well-equipped to navigate the complexities of academic integrity while upholding the institution’s values of learning and growth.