Digital Education team blog
  • We support Staff and Students using technology to enhance education at UCL.

    Here you'll find updates on institutional developments, projects we're involved in, updates on educational technology, events, case studies and personal experiences (or views!).

  • Subscribe to the Digital Education blog

  • Meta

  • Tags

  • A A A

    Reflections before UCL’s first Mooc

    By Matt Jenner, on 26 February 2016

    Why We Post: Anthropology of Social Media

    Why We Post: Anthropology of Social Media

    UCL’s first Mooc – Why We Post: The Anthropology of Social Media launches on Monday on FutureLearn. It’s not actually our first Mooc – it’s not even one Mooc, it’s 9! Eight other versions are simultaneously launching on UCLeXtend in the following languages: Chinese, English, Italian, Hindi, Portuguese, Spanish, Tamil and Turkish. If that’s not enough  we seem to have quite a few under the banner of UCL:

    (quite a few of these deserve title of ‘first’ – but who’s counting…)

    Extended Learning Landscape - UCL 2015

    Extended Learning Landscape – UCL 2015

    UCL is quite unique for some of these – we have multiple platforms which form a part of our Extended Learning Landscape. This maps out areas of activity such as CPD, short courses, Moocs, Public Engagement, Summer Schools (and many more) and tries to understand how we can utilise digital education / e-learning with these (and what happens when we do).

     

    Justification for Moocs

    We’ve not launched our first Mooc (apparently) but we also need to develop a mid term plan too – so we can do more. Can we justify the ones we’ve done so far? Well a strong evaluation will certainly help but we also need an answer to the most pertinent pending question:

    How much did all this cost and was it worth it? 

    It’s a really good question, one we started asking a while ago, and still the answer feels no better than educated guesswork. Internally we’re working on merging a Costing and Pricing tool (not published, sorry) and the IoE / UCL Knowledge Lab Course Resource Appraisal Modeller (CRAM) tool. The goal is to have a tool which takes the design of a Mooc and outputs a realistic cost. It’s pretty close already – but we need to feed in some localisations from our internal Costing and Pricing tool such as Estates cost, staff wages, Full Economic Costings, digital infrastructure, support etc. The real cost of all this is important. But the value? Well…

    Evaluation

    We’ve had a lot of ideas and thoughts about evaluation; what is the value of running Moocs for the university? It feels right to mention public engagement, the spirit of giving back and developing really good resources that people can enjoy. There’s the golden carrot being dangled of student recruitment but I can’t see that balancing any Profit/Loss sheets. I do not think it’s about pedagogical innovation, let’s get real here: most Moocs are still a bulk of organised expert videos and text. I don’t think this does a disservice to our Moocs, or those of others, I’d wager that people really like organised expert videos and text (YouTube and Wikipedia being stable Top 10 Global Websites hints at this). But there are other reasons – building Moocs is an new way to engage a lot of people with your topic of interest. Dilution of the common corpus of subjects is a good thing; they are open to anyone who can access them. The next logical step is subjects of fascination, niche, specialist, bespoke – all apply to the future of Moocs.

    For evaluation, some obvious things to measure are:

    • Time from people spend on developing the Mooc – we’ve got a breakdown document which tries to list each part of making / running a Mooc so we can estimate time spent.
    • Money spent on media production – this one tends to be easy
    • Registration, survey, quiz, platform usage and associated learner data
    • Feedback from course teams on their experience
    • Outcomes from running a Mooc (book chapters, conference talks, awards won, research instigated)
    • Teaching and learning augmentation (i.e. using the Mooc in a course/module/programme)
    • Developing digital learning objects which can be shared / re-used
    • Student recruitment from the Mooc
    • Pathways to impact – for research-informed Moocs (and we’re working on refining what this means)
    • How much we enjoyed the process – this does matter!

    Developing a Mooc – lessons learned

    Communication

    Designing a course for FutureLearn involves a lot of communication; both internally and to external Partners, mostly our partner manager at FutureLearn but there are others too. This is mostly a serious number of emails – 1503 (so far) to be exact. How? If I knew I’d be rich or loaded with oodles of time. It’s another new years resolution: Stop: Think: Do you really need to send / read / keep that email? Likely not! I tried to get us on Trello early, as to avoid this but I didn’t do so well and as the number of people involved grew adding all these people to a humungous Trello board just seemed, well, unlikely. Email; I shall understand you one day, but for now, I surrender.

    Making videos

    From a bystander’s viewpoint I think the course teams all enjoyed making their videos (see final evaluation point). The Why We Post team had years to make their videos in-situ from their research across the world. This is a great opportunity to capture real people in the own context; I don’t think video gets much better than this. They had permission from the outset to use the video for educational purposes (good call) and wove them right into the fabric of the course – and you can tell. Making Babies in the 21st Century has captured some of the best minds in the field of reproduction; Dan Reisel (lead educator) knows the people he wants, he’s well connected and has captured and collated experts in the field – a unique and challenging achievement. Tim Shakespeare, The Many Faces of Dementia, was keener to capture three core groups for his course: people with Dementia, their carers / family and the experts who are working to improve the lives for people with Dementia. This triangle of people makes it a rounded experience for any learner, you’ll connect with at least one of these groups. Genius.

    Also:

    • Audio matters the most – bad audio = not watching
    • Explain and show concepts – use the visual element of video to show what you mean, not a chin waggling around
    • Keep it short – it’s not an attention span issue, it’s an ideal course structuring exercise.
    • Show your face – people still want to see who’s talking at some point
    • Do not record what can be read – it’s slower to listen than it is to read, if your video cam be replaced with an article, you may want to.
    • Captions and transcripts are important – do as many as you can. Bonus: videos can then be translated.

    Using third party works

    Remains as tricky as it ever has been. Moocs are murky (commercial? educational? for-profit?) but you’ll need to ask permission for every single third-party piece of work you want to use. Best advice: try not to or be prepared to have no response! Images are the worst, it’s a challenge to find lots of great images that you’re allowed to use, and a course without images isn’t very visually compelling. Set aside some time for this.

    Designing social courses that can also be skim-read

    FutureLearn, in particular, is a socially-oriented learning platform – you’ll need to design a course around peer-to-peer discussion. Some is breaking thresholds – you’re trying to teach them something important, enabling rich discussion will help. You’re also trying to keep them engaged – so you can’t ask for a deep, thoughtful, intervention every 2 minutes. Find the balance between asking important questions – raising provocative points – and enjoying the fruits of the discussion with the reality of ‘respond if you want’ type discussion prompts.

    Connect course teams together

    While they might not hold one another’s hair when things get rough – the course teams will benefit from sharing their experiences with one another. We’ve held monthly meetings since the beginning, encouraging each team to attend and share their updates, challenges, show content, see examples from other courses and generally make it a more social experience. Some did share their dropboxes with one another – which I hadn’t expected but am enjoying the level of transparency. I am guilty of thinking at scale at the moment, so while I was guiding and pseudo ‘project-managing’ the courses, I was keen to promote independence and agency within the course teams. It’s their course, they’ll be the ones working into the night on it, I can’t have them relying on me and my dreaded inbox. The outcome is they build their own ideas and shape them in their own style; maybe we’re lucky but this is important. We do intervene at critical stages, recommending approaches and methods as appropriate.

    Plan, design and then build

    Few online learning environments make good drafting tools. We encouraged a three-stage development process:

    1. Proposals, expanded into Excel-based documents. Outlines each week, the headline for each step/component and critical elements like discussion starters.
    2. Design in documents – Word/Google Docs (whatever) – expand each week; what’s in each step. Great for editorial and refinement.
    3. Build in the platform.

    The reason for this is the outlines are usually quick to fix when there’s a glaring structural omission or error. The document-based design then means content can be written, refined and steps planned out in a loose, familiar tool. Finally the platform needs to be played with, understood and then the documents translated into real courses. It’s not a solid process and some courses had an ABC (Arena Blended Connected) Curriculum Design stage, just to be sure a storyboard of the course made sense.

    Overall

    • It’s hard work – for the course teams – you can just see they’ll underestimate the amount of time needed.
    • The value shows once you go live and people start registering, sharing early comments on the Week 0 discussion areas.
    • These courses look good and work well as examples for others, Mooc or credit-bearing blended/online courses
    • Courses don’t need to be big – 1/2 hours a week, 2-4 weeks is enough. I’d like to see more smaller Moocs
    • Integrating your Moocs into taught programmes, modules, CPD courses makes a lot of sense

    As a final observation before we go live with the first course: Why We Post: The Anthropology of Social Media, on Monday there was one thing that caught my eye early:

    Every course team leader for our Moocs is primarily a researcher and their Moocs are produced, largely, from their research activity. UCL is research intensive, so this isn’t too crazy, but we’re also running an institutional initiative the Connected Curriculum which is designed to fully integrate research and teaching. The Digital Education team is keen to see how we build e-learning into research from the outset. This leads us to a new project in UCL entitled: Pathways to Impact: Research Outputs as Digital Education (ROADE) where we’re exploring research dissemination and e-learning objects and courses origins and value. More soon on that one – but our Mooc activity has really initiated this activity.

    Coming soon – I hope – Reflections after UCL’s first Mooc 🙂 

     

    Being a Coursera student and just what is a MOOC anyway?

    By Matt Jenner, on 27 August 2012

    Massive online open courses, or MOOCs as they are colloquially know as, can best be described as a mixture of distance learning with the addition of thousands of students, new platforms, generally old teaching methods and a lot of media hype. Yet, they are heralded as a tsunami of change coming to education, the future of learning and a firecracker into institutions who fear they are not able to provide such approaches. Most importantly is that they are largely unproven, mainly due to entering rather new (yet trodden) territory. This post covers some of the history of MOOCs and of my recent experience being a student in one of these courses. It’s fair to say that this big distance learning on a big scale, and what it means for UCL, and education in a wider field, is not known by anyone, but it’s very exciting to watch it unfold, and to look for opportunities of alignment.

    What is a MOOC?

    An open course where fee-paying and free students mix (or it’s just free) which uses an online learning and teaching environment usually backed by a university or a group of individuals, usually led by top academics. Student numbers are generally not paying a fee and range in numbers between 100 and >150,000 at the moment.

    How does it work?

    Learning activities are generally asynchronous and follow a flexible structure ensures that promotes students contributions as a core to the learning activity. Usually not using systems such as Moodle but instead tools such as blogs and wikis or bespoke software. Teachers are present, but there has been upwards of 50,000 students per staff member (MITx – Circuits course) so student participation plays a significant part. Systems used reflect this, for example Q&A areas have voting mechanisms and collaborative approaches to answering queries.

    Who’s doing it?

    They are largely driven by Canadian and US Universities, perhaps due to their initial cost or promotion on western-facing media. Originating in Canada in 2008 and made ‘famous’ by Harvard, MIT, Yale and other elite US universities. Less were discovered from other continents but many exist under the more generic ‘open’ banners of education. Big names include: edX (the recently combined MITx and Harvardx), Coursera. Udacity and more.

    Why is it significant?

    A MOOC opens a course and invites anyone to enter, resulting in a new learning dynamic for collaborative and conversational opportunities for students to gather and discuss the course content. A new pedagogy has been associated entitled Connectivism (http://en.wikipedia.org/wiki/Connectivism) and edX, potentially the largest MOOC identified will use it as a massive educational research tool to benefit the institution’s in-house learning and teaching, among other things.

    The downsides?

    The non-traditional dynamic of a MOOC may make some students uneasy, particularly those who expect, or thrive, on a high level of interaction with the teacher. Students with no financial stake or educational background in the course may bring a different, potentially disruptive, approach. Teachers must rethink the at least some of the course’s elements to take advantage of a MOOC, giving particular consideration to the technical and structural demands and logistics of running such a course. Learners and academics may oppose this style of learning and teaching and demand more traditional approaches.

    Implications for teaching and learning

    MOOCs present a new opportunity for an independent, life-long learner. By removing the risk attached to a course, it may encourage participation from those who are less-likely to enrol in the traditional educational methods. “The most significant contribution is the MOOC’s potential to alter the relationship between learner and instructor and between academe and the wider community” – http://net.educause.edu/ir/library/pdf/ELI7078.pdf

    Being a MOOC Student Coursera homepage

    Six months ago I blogged about being an MITx student and now I am undertaking a wider programme of study through Corsera – a similar platform founded by two professors from Stanford; Daphne Koller and Andrew Ng. The course I am taking at the moment is Internet History, Technology and Security. We’re up to week five and it’s going well so far, I think.

    The main direct tuition I’ve received has been via recorded videos of either Dr. Chuck (Charles Severance) and other resources, mostly video based. They have a nifty feature whereby as the video progresses it stops to ask  a question – this is clearly indicated on the timeline for the video (see screenshots). After some feedback the video continues. This helps break up the didactics but it’s obvious (even to the founders) that this isn’t directly innovative but it’s a little step forward than just a video. In addition is the ability to control the playback of the video, increasing the speed to 1.75x or 2x of the original.

    Videos in Coursera - answering a question

    Interaction

    With so many students MOOCs can’t have teaching staff interact directly with the students for all conversations / questions. With this in mind, the discussion forum (much like MITx) employed a rating system where all questions can also be rated (and flagged). There are many students answering one another’s questions, and this is widely encouraged. Additionally there is a wiki, although this is used less. Surprisingly, for an online course, there’s a lot of face to face interaction where students form study groups and meet in cities across the globe. Lastly, with one teacher and over 10,000 students there’s little chance for much else, but Dr. Chuck is still offering contact hours by arranging meetings in coffee shops across America.

    Assessment

    So far we have had a quiz most weeks, where 10 MCQ questions can be answered – nothing special to report here. The peer-assessment worked rather well, with the submission of a short essay after week one each student had to use a grading rubric for at least five other students, and give written feedback. After leaving mine for seven students I eventually got my feedback, it was a mixed bunch of reviews of my work, from excellent to rubbish – so I averaged it overall. Needless to say this approach is understandable, but not necessarily meaningful for my learning, especially when considering the potential lack of investment from the students either fiscally or effort-wise.

    Personal contribution

    I’m not putting much into this MOOC, I know the subject fairly well and it’s more of a learning journey into distance learning / MOOCs than it is about Internet History, Technology and Security. I don’t think it’s a problem how much I put in, as the course is designed to fit with my life, not the other way around. As I am also studying for my masters, I instantly see a difference between this seven week course, and say, a 15-credit module. I’m sure a lot of people are learning a lot more than me from this course, and that is obviously wonderful. It’s early days for MOOCs and these courses are all forming the next steps of what they will evolve into. I am sure during this course the platform is developing, the teachers are learning and the data collected is showing what’s working, and who isn’t (ahem).

    The future?

    MOOCs are still emerging and somewhat undefinable at this stage. The usual trending phenomena warnings are present, as are the ‘unknown’ opportunities. As the buzz fades and MOOCs evolve the expectations and methods are likely to stabilise, thus making them more consistent and definable. Universities may be ‘too slow’ to realise the potential, or not get caught up in the buzz, potentially wasting significant resource. As the world becomes more connected, and education opens up, there is an echo of this being a permanent and positive change to higher education.

    Other choice resources

    There’s a whole load of commentary on MOOCs, here’s some of the best so far:

    Learning for Free? MOOCs by Mira Vogel, Goldsmiths. Presented at their Future Tense 2012 conference.

    The Campus Tsunami by David Brooks, New York Times

    What’s right and what’s wrong about Coursera-style MOOCs by Tony Bates, Research Associate, Contact North

    MOOC pedagogy: the challenges of developing for Coursera by Jeremy Knox, Sian Bayne, Hamish MacLeod, Jen Ross and Christine Sinclair, MSc in E-learning Programme Team, University of Edinburgh