X Close

Digital Education team blog

Home

Ideas and reflections from UCL's Digital Education team

Menu

HEA Senior Fellowship Case Study Series: 4 – Researching learner interaction and engagement with in-class response systems

By Matt Jenner, on 15 August 2014

As a four-part series I am openly publishing my case studies previously submitted for my Senior Fellowship of the Higher Education Academy. I submitted my application in February 2014. If you’re interested in this professional recognition programme, please visit their webpages and look through the Professional Standards Framework (PSF). UCL runs an institutional model for fellowships called ARENA, your institution may run one too – speak to people!

Case Study 4 – Researching learner interaction and engagement with in-class response systems

In 2012 I conducted research, in parallel with my job at UCL, focusing on increasing student interaction and staff engagement of an in-class question and response system colloquially known as ‘clickers’. Evidence suggests clickers provide interaction opportunities to stimulate and engage learners[1] and have a benign or positive effect in student performance[2]. Clickers are popular across many disciplines, in particular the physical sciences, but there is a particularly low interest in medical sciences.

I wanted to directly address this shortcoming so I enlisted two academics in the UCL Medical School. I assimilated the current method of teaching, and the materials used (K1). From here we adapted a learning activity to align with the new tool being applied (A1). I underpinned the use of the technology with existing literature and the evidence of realigning the ‘sage on the stage’ to the ‘guide on the side’ [3](K2), which evidence suggests is an effective method for learning and teaching (K3, V3). I provided pre-lecture technical support to reduce technical barriers and was on-hand in the lecture to support as/when needed (A2). Questions were designed into the lectures and the clickers provide immediate feedback (A3). Staff react to clicker data with an approach called ‘contingent teaching’[4] where they dynamically respond to the answers/feedback provided (A3).

I designed evaluation questions for each lecture based on Bloom’s Taxonomy[5] for learners-based evaluation of the teaching approach and learning outcomes (A4). Questions were derived from categorising Bloom into three sub-categories; remember or understand, apply or analyse the topic and evaluate or create new knowledge (K5). When questioned, 74% of students agreed or strongly agreed that the clickers and the related teaching approach encouraged interaction and helped to achieve metacognitive learning (K5). I integrated these data with post-lecture interviews for the lecturers. Using this analysis, we designed next steps for future use and identified gaps and areas for improvement (A5).

I conducted evidence-based research and followed best practice around clickers to ensure inclusion was academically merited (V3). Measuring (and increasing) engagement within the traditional lecture was aiming to promote participation for learners (V2). It was understood that clickers do not directly enhance learning but can lead to higher-order learning. I used my understanding of the wider field of evidence to define their most appropriate use within the lectures (V1, V3).

By implementing a technology which was new to staff and guiding them with appropriate techniques known to increase interaction and engagement, I provided an evidence-informed approach which could be used to transform didactic content delivery into something more engaging. My research adds to a disproportionately small body of knowledge for clickers in medical education and the study overall was positive. Staff involved still use the clickers, the impact I measured plus the evidence collected, can be further used to promote clickers within UCL, the Medical School and beyond. It earned me a Distinction in my MSc Learning Technologies and furthered my ambition to make a lasting, positive difference to higher education.

(493 words)

HEA Professional Standards Framework links referenced in this case study:

Areas of Activity

  • A1 Design and plan learning activities and/or programmes of study
  • A2 Teach and/or support learning
  • A3 Assess and give feedback to learners
  • A4 Develop effective learning environments and approaches to student support and guidance
  • A5 Engage in continuing professional development in subjects/disciplines and their pedagogy, incorporating research, scholarship and the evaluation of professional practices

Core Knowledge

  • K1 The subject material
  • K2 Appropriate methods for teaching, learning and assessing in the subject area and at the level of the academic programme
  • K3 How students learn, both generally and within their subject/disciplinary area(s)
  • K5 Methods for evaluating the effectiveness of teaching

Professional Values

  • V1 Respect individual learners and diverse learning communities
  • V2 Promote participation in higher education and equality of opportunity for learners
  • V3 Use evidence-informed approaches and the outcomes from research, scholarship and continuing professional development


[1] Bligh, D.A., (2000). What’s the use of Lectures? London/San Francisco; Jossey-Bass

[2] http://w.lifescied.org/content/6/1/9.short

[3] King, A. (1993). From Sage on the Stage to Guide on the Side. College Teaching, Vol. 41, No. 1, p30- 35. Taylor & Francis Ltd.

[4] Beatty I. D., Gerace W. J., Leonard W. J. and Dufresne R. J., (2006). Designing effective questions for classroom response teaching, American Journal of Physics. Vol. 74, p31-39.

[5] Bloom B.S., (1956). Taxonomy of Educational Objectives, Handbook I: The Cognitive Domain. New York: David McKay Co Inc.

HEA Senior Fellowship Case Study Series: 3 – Facilitating communities of practice at UCL and beyond

By Matt Jenner, on 14 August 2014

As a four-part series I am openly publishing my case studies previously submitted for my Senior Fellowship of the Higher Education Academy. I submitted my application in February 2014. If you’re interested in this professional recognition programme, please visit their webpages and look through the Professional Standards Framework (PSF). UCL runs an institutional model for fellowships called ARENA, your institution may run one too – speak to people!

Case study 3 – Facilitating communities of practice at UCL and beyond

At UCL I have facilitated and been involved in two active communities of practice. One external group called ‘Moodle User Group Greater London’ (MUGGL)[1] is for e-learning professionals with an interest in ‘Moodle’ – an online learning environment. More historically, I helped this community have an agenda for meetings with a colleague, Sarah Sherman in a neighbouring university consortia the ‘Bloomsbury Learning Environment’ [2]. The other, the ‘Distance Learning, CPD and Short Courses Network’[3], is an internal network I help steer for colleagues at UCL. These communities focus on “sharing best practices and creating new knowledge to advance a domain of professional practice”[4]. Drawing on my enthusiasm for e-learning and connecting people, the communities I facilitate take me beyond my desk and into the wider sector (A5, V3, V4).

People often disappear into enclaves, with daily priorities overarching valuable reflective opportunities. I work responsively to sustain and grow communities with common needs, values, locale and domain of discourse. All too often communities around information technology end up as one-way monologs beset by dry jargon. Instead I plan active pedagogically-focused sessions and encourage sharing and collaboration. This provides a vital source of information, future utility (V3) and cross-sector discovery (A4).

I regularly participate in wider CPD events and read literature in the areas of distance learning, MOOCs (Massive Online Open Courses) and e-learning to remain current in my understanding and share my experiences within networks and social media (V3). For the internal community, I organise and deliver centralised updates from professional services and the wider context of relevant developments so colleagues can gain purview of the changing landscape of higher education and e-learning (V4).

Both communities started three to four years ago as special interest groups created around particular foci. I have encouraged expansion of both networks, with events often attracting 50–150 people and a core membership of many times that figure. With this increasing range of members I must ensure to maintain respect for the needs of the group when planning three-four hours of their professional development time (V1). Communities are grown, not constructed, and sharing and learning cannot be “legislated into existence”[5]. I sideline my leadership in alignment with members’ interests to ensure events are planned with consultation and encouragement for active participation in each session. I make events accessible by adding remote attendance options and capturing them on video, to encourage participation and preserve inclusion for the diverse members of the community (V2).

I have received feedback stating I “did a great job organizing everyone and your presentation was beautiful”. Comments for MUGGL events have noted a “big crowd for the #muggl Moodle 2 meeting today” and “spent the morning at #muggl good presentations from @mattjenner […] we watch and learn!” Connecting people is an integral part, with one group visit commenting “how proud we are to work in such an engaging institution. Most participants left inspired”. In relation to expanding the community a senior member of staff spoke of a well-attended event that “the increase in numbers and interest across campus reflects the importance of this area”. Feedback is can be sporadic, but I take comments on board for future sessions and resolving any issues.

(515 words)

HEA Professional Standards Framework links referenced in this case study:

Areas of Activity

  • A4 Develop effective learning environments and approaches to student support and guidance
  • A5 Engage in continuing professional development in subjects/disciplines and their pedagogy, incorporating research, scholarship and the evaluation of professional practices

Professional Values

  • V1 Respect individual learners and diverse learning communities
  • V2 Promote participation in higher education and equality of opportunity for learners
  • V3 Use evidence-informed approaches and the outcomes from research, scholarship and continuing professional development
  • V4 Acknowledge the wider context in which higher education operates recognising the implications for professional practice


[1] https://sites.google.com/site/moodlelondon/

[2] http://www.bloomsbury.ac.uk/ble

[3] https://www.mailinglists.ucl.ac.uk/mailman/listinfo/distancelearning

[4] http://net.educause.edu/ir/library/pdf/nli0531.pdf

[5] Dubé, L., Bourhis, A. & Jacob, R. (2005). The impact of structuring characteristics on the launching of virtual communities of practice. Journal of Organizational Change Management, 18(2): 145-166.

HEA Senior Fellowship Case Study Series: 2 – Bringing lecture flipping to a new interdisciplinary programme

By Matt Jenner, on 13 August 2014

As a four-part series I am openly publishing my case studies previously submitted for my Senior Fellowship of the Higher Education Academy. I submitted my application in February 2014. If you’re interested in this professional recognition programme, please visit their webpages and look through the Professional Standards Framework (PSF). UCL runs an institutional model for fellowships called ARENA, your institution may run one too – speak to people!

Case Study 2 – Bringing lecture flipping to a new interdisciplinary programme

As an experienced member of staff I have a wide range of institutional e-learning responsibilities. In 2011 I was an integral part in designing, delivering and evaluating a new teaching style called the ‘flipped lecture’. It’s increasingly thought that lectures do not provide “students a rich and rewarding educational experience”[1]. The flipped model is where “students gain first-exposure learning prior to class and focus on the processing part of learning (synthesizing, analyzing, problem-solving, etc.) in class”[2]. The first academic to explicitly flip their lectures, and put the concept in the UCL spotlight, was Carl Gombrich, director of UCL’s flagship interdisciplinary degree the Bachelor of Arts and Sciences (BASc).

Carl wanted to put “people back at the centre of the learning”12 and I supported and advised him while we created an active learning, ‘flipped lecture’, environment (A2, A4). UCL’s institutional teaching and learning strategy envisaged the BASc providing “a model for a substantial proportion of UCL’s undergraduate teaching”[3]. Our plan was to create a teaching approach with innovative and sustainable qualities.

Carl is a capable teacher but he was less comfortable with the technological change required to achieve ‘flipped lectures’. I mentored him through the virtues, and downsides, of the available technological landscape. A barrier emerged within institutional systems which did not support his approach. While retaining alignment with the planned learning activities, (A1, K4) I researched available options and evaluated a new tool called Hot Question[4] based on research from Purdue University[5]. My research outcome delivered a solution which matched the requirements for the BASc and was designed to scale for the institution if flipping increased in popularity. It is now used across 81 courses at UCL (A4).

Feedback received from Carl has been “In many (most) cases it really does get students thinking about the content of the lectures” and “how sophisticated” some of the student’s questions are. A student on the course commented “once you have the additional time in lectures, you’re going to be able to take advantage of that”9. Another academic commented ‘flipping’ uncovers “the impact of the information we provide for students, and their understanding at a much finer temporal resolution than what was available previously”[6]. One issue that’s arisen is that “so many questions are submitted and so many are of a high standard that it is a bit bewildering to look through them all”.

I have shared the flipped approach within external communities[7] and Carl’s work has become an inspirational exemplar for staff to experiment with flipped lectures. The technological changes, and teaching approaches have been shared via blog posts[8] and case studies[9], they provide evidence for colleagues to learn from, discuss and adopt. Seeing this as a potential future component of teaching at UCL, it was my role to ensure we built a sustainable model not just for the BASc but for the wider UCL community. By ensuring the flipped lecture was well supported we have seen a growth in popularity across the university’s faculties of Engineering, Social and Medical Sciences.

(505 words)

HEA Professional Standards Framework links referenced in this case study:

Areas of Activity

  • A1 Design and plan learning activities and/or programmes of study
  • A2 Teach and/or support learning
  • A3 Assess and give feedback to learners
  • A4 Develop effective learning environments and approaches to student support and guidance
  • A5 Engage in continuing professional development in subjects/disciplines and their pedagogy, incorporating research, scholarship and the evaluation of professional practices

Core Knowledge

  • K4 The use and value of appropriate learning technologies


[1] http://www.brookes.ac.uk/services/ocsld/resources/20reasons.html

[3] http://www.ucl.ac.uk/teaching-learning/secure-downloads/ILTS.pdf

[4] https://moodle.org/plugins/view.php?plugin=mod_hotquestion

[5] https://www.purdue.edu/hotseat

[6] https://www.ucl.ac.uk/stream/media/swatch?v=5461b59f4751

[7] https://twitter.com/AndyKons/status/278446517537353728

[8] https://blogs.ucl.ac.uk/digital-education/tag/flipping/

[9] http://www.ucl.ac.uk/teaching-learning/news/carl-gombrich-flipping-the-lecture-theatre

HEA Senior Fellowship Case Study Series: 1 – Creating a public-facing e-learning environment

By Matt Jenner, on 12 August 2014

As a four-part series I am openly publishing my case studies previously submitted for my Senior Fellowship of the Higher Education Academy. I submitted my application in February 2014. If you’re interested in this professional recognition programme, please visit their webpages and look through the Professional Standards Framework (PSF). UCL runs an institutional model for fellowships called ARENA, your institution may run one too – speak to people!

Case Study 1 – Creating a public facing e-learning environment

With 10 years’ experience, I joined UCL’s central e-learning team in 2008. My role requires me to advise a diverse academic community traversing a diverse technological landscape. I build strong relationships with colleagues and contribute to technical developments and institutional strategies. My specialisation is distance education, an area experiencing accelerated growth across the sector due to demand for flexible learning, increasing technological grasp and the questionable future of Massive Online Open Courses.

My activity focuses around UCLeXtend – a new public-facing online learning environment offering free and premium courses. I advocate open education and am passionate about the opportunities universities have for social enterprise, global impact and widening participation. A core component of our institutional e-learning strategy is to “raise UCL’s profile as a global education leader”[1]; by opening the rich and varied corpus of UCL to a wider audience I am enabling this reality.

UCLeXtend is built on familiar and established e-learning software which eases the transition for staff (K4). Staff leave their comfort zones when developing distance learning so I mentor them throughout the process. Course development approaches are less familiar; so I encourage course teams to follow a customised course development framework based on an existing model named ADDIE (Analysis, Design, Development, Implementation and Evaluation)[2] (K5). I facilitate open discussion of ideas and assimilate their subject material from the outset, advising on suitable development approaches (K1).

I struggle with the demand for ‘rapid’ (i.e. quick and cheap) course development, some colleagues need convincing that high quality interactive and engaging learning is not guaranteed by nice fonts and shiny graphics. I adapted the ADDIE course development framework to focus on the needs and approaches of individuals’ learning, tailored for the appropriate market and teaching style (K2). I encourage good practice and make recommendations for course design and structure, especially factoring in learner’s who are going to “consider the potential educational benefits”[3] of each resource or activity (K3).

Creating courses open to the public exposes UCL, so to protect our brand and standards I developed and lead on integrating quality assurance processes. All courses are scrutinised via an academic and rigorous review process (K6). Initially this was too much like a ‘course approval’ system, creating unnecessary pressure on both sides. I therefore matured it into a critical friend review. One academic commented they were “really pleased by the positive reactions and by the very useful suggestions we got from the panel” and another noted it was “a very constructive meeting”.

In eight months UCLeXtend has nine live courses and over 2000 learners from 68 countries. Although the evaluation phase has yet to commence, one learner commented “how fantastic the better conversations tool for aphasia is […] and has so many benefits”. In the longer term, UCLeXtend will become positively disruptive to UCL. I have senior level support and interest across the university; my challenge now is to lead UCLeXtend into a sustainable model and integral to future institutional priorities. For me, the strong start was critical to success; my on-going leadership in this area will ensure the initial quality sets the baseline for future growth.

(516 words)

HEA Professional Standards Framework links referenced in this case study:

Core Knowledge

  • K1 The subject material
  • K2 Appropriate methods for teaching, learning and assessing in the subject area and at the level of the academic programme
  • K3 How students learn, both generally and within their subject/disciplinary area(s)
  • K4 The use and value of appropriate learning technologies
  • K5 Methods for evaluating the effectiveness of teaching
  • K6 The implications of quality assurance and quality enhancement for academic and professional practice with a particular focus on teaching

 


[1] http://www.ucl.ac.uk/teaching-learning/strategic_priorities/e-learning-strategy

[2] http://www.nwlink.com/~donclark/history_isd/addie.html

[3] http://oro.open.ac.uk/10072/1/Assessment_and_student_learning-HO.pdf