00:00:00
Welcome back to Research Topics on Digital Education.
00:00:16
I'm Elisabeth Kensington, and I'm joined by Martin Nottingham.
00:00:20
Martin, do you remember when MOOCs first started making headlines?
00:00:20
Oh,
00:00:25
absolutely.
00:00:26
I mean, it feels like a lifetime ago,
00:00:28
but I still remember the buzz around edX launching in 2012.
00:00:32
Suddenly, you could take a real MIT or Harvard course online,
00:00:36
for free.
00:00:36
It was wild.
00:00:38
I actually signed up for one of those first edX courses-Intro to Computer
00:00:43
Science, I think.
00:00:44
I was just amazed that I could watch these university lectures from my
00:00:48
living room.
00:00:48
It felt like the future had arrived,
00:00:50
you know?
00:00:50
Yes, and edX really played a pivotal role in shaping what MOOCs
00:00:56
would become.
00:00:56
They started with a handful of courses,
00:01:00
but the scale grew so quickly.
00:01:02
Universities all over the world wanted to join in.
00:01:06
But, as exciting as it was, there were a lot of early lessons-like,
00:01:11
just putting a camera in a classroom and recording a lecture didn't always
00:01:16
work out as well as people hoped.
00:01:16
Right,
00:01:18
and I think that's something we touched on in our last episode too with
00:01:21
Elena and Jack-how just moving traditional education online doesn't
00:01:21
automatically
00:01:26
make it better.
00:01:27
There was a lot of trial and error in those early days.
00:01:30
But the promise of free, global access to university-level content?
00:01:34
That was a game changer.
00:01:34
Exactly.
00:01:37
And it set the stage for a lot of research into what actually works in
00:01:41
online education, especially when it comes to keeping students engaged
00:01:45
with video content.
00:01:45
So, let's talk about the study we're focusing on today.
00:01:49
It was published by Philip Guo,
00:01:51
Juho Kim, and Rob Rubin.
00:01:53
The title: How Video Production Affects Student Engagement: An Empirical
00:01:58
Study of MOOC VideosIt is not so recent,
00:02:01
it dates back to 2014 but it seems that the results obtained have not
00:02:05
yet been well received in education!
00:02:05
This was the largest-scale empirical
00:02:09
study of MOOC video engagement at the time...
00:02:12
6.
00:02:12
9 million video watching sessions across four edX courses.
00:02:17
That's a massive amount of data!
00:02:17
It's huge!
00:02:20
And what's really interesting is how this kind of big data lets us see
00:02:25
patterns that just aren't visible when you're only looking at a single
00:02:29
class or a few dozen students.
00:02:31
For example, you can actually measure how long students watch each video,
00:02:37
when they pause, if they try the follow-up problems,
00:02:40
and so on.
00:02:41
It gives a much clearer picture of what keeps people engaged-or when
00:02:46
they tune out.
00:02:46
Yeah, and I think that's something that's easy to overlook.
00:02:50
Like, before this, a lot of decisions about online courses were based
00:02:54
on gut feeling or what worked in a physical classroom.
00:02:57
But with this kind of data, you can actually see,
00:03:00
"Hey, students are dropping off after five minutes," or "They rewatch certain
00:03:00
parts of tutorials."
00:03:07
It's a whole new way to improve teaching.
00:03:07
Absolutely.
00:03:10
I remember working with a team to redesign a video curriculum,
00:03:14
and we used this kind of engagement data to decide which videos to split
00:03:19
up, which ones needed more visual cues,
00:03:22
and even which instructors needed to change their presentation style.
00:03:27
It was a real shift from intuition to evidence-based decisions.
00:03:27
And that's
00:03:33
the power of big data in education.
00:03:35
It takes the guesswork out and helps you make changes that actually matter
00:03:39
for learners.
00:03:39
So, what did the data actually show?
00:03:42
The biggest finding was that shorter videos-under six minutes-were way
00:03:48
more engaging.
00:03:49
No matter how long the video was,
00:03:52
students rarely watched more than six minutes at a time.
00:03:52
Yeah,
00:03:56
and that's kind of funny, right?
00:03:57
Because a lot of professors, myself included,
00:03:59
used to think, "Oh, I'll just record my hour-long lecture and put it online."
00:04:04
But the reality is, people just don't stick around that long.
00:04:08
The median engagement time was at most six minutes,
00:04:12
even for longer videos.
00:04:12
Exactly.
00:04:14
And it wasn't just about length.
00:04:16
Videos that mixed things up-like switching between the instructor's face,
00:04:21
slides, and code-kept students watching longer.
00:04:25
There was something about seeing the instructor,
00:04:28
even just for a few moments, that made the video feel more personal and
00:04:33
less monotonous.
00:04:33
And here's the part I find really interesting: the videos
00:04:37
filmed in a professor's office,
00:04:39
just talking to the camera, actually outperformed the ones shot in fancy
00:04:43
studios.
00:04:44
It's almost like the more informal,
00:04:46
conversational style made students feel like they were having a one-on-one
00:04:50
chat, not just watching a broadcast.
00:04:50
Yes,
00:04:54
and that's a bit counterintuitive.
00:04:56
You'd think higher production value would mean higher engagement,
00:05:00
but the data showed the opposite.
00:05:02
Sometimes, less is more-especially if it means the instructor is more
00:05:08
relaxed and direct with the audience.
00:05:08
So,
00:05:11
if you're making MOOC videos, don't stress about the perfect studio.
00:05:15
Focus on being clear, concise,
00:05:17
and a little bit personal.
00:05:18
That's what keeps people watching.
00:05:18
Another big takeaway was about presentation
00:05:23
style.
00:05:24
The so-called "Khan-style" tablet tutorials-where the instructor draws
00:05:29
and talks through the material-were much more engaging than just PowerPoint
00:05:34
slides or code screencasts.
00:05:34
Yeah,
00:05:37
and I think that's because there's something about seeing the material
00:05:40
come to life in real time.
00:05:41
It's more dynamic, and it feels like the instructor is working through
00:05:46
the problem with you, not just reading off a slide.
00:05:49
Plus, the study found that faster speech rates-up to 254 words per minute-actually
00:05:56
increased engagement.
00:05:57
So, being energetic and enthusiastic really matters.
00:05:57
Right.
00:06:02
And it's not about rushing, but about bringing energy.
00:06:05
In fact, one MOOC in the study switched to chunked,
00:06:09
more personal videos-short, focused,
00:06:12
and conversational-and saw a measurable jump in engagement.
00:06:16
Students were more likely to watch the whole video and attempt the follow-up
00:06:21
problems.
00:06:21
That's a great point.
00:06:23
And, you know, sometimes instructors worry about speaking too quickly
00:06:26
or making mistakes, but the data suggests that a natural,
00:06:30
enthusiastic delivery is more important than being perfectly polished.
00:06:34
Editing out long pauses and filler words helps too,
00:06:38
but you don't have to sound like a robot.
00:06:38
Exactly.
00:06:41
It's about being yourself, but with a bit more energy.
00:06:45
And planning ahead-thinking about how to break up the content and how
00:06:50
to present it visually-makes a huge difference.
00:06:50
So,
00:06:53
what does all this mean for people actually making online courses?
00:06:57
First, intentional pre-production planning is crucial.
00:07:01
Don't just hit record-think about how to segment your material into short,
00:07:05
focused chunks, ideally under six minutes each.
00:07:05
And don't underestimate
00:07:10
the importance of data literacy.
00:07:12
Being able to look at engagement data and adjust your approach is key.
00:07:16
I once worked with a professor who was really hesitant to change his
00:07:20
style.
00:07:21
He was used to formal lectures,
00:07:24
but after seeing the engagement numbers,
00:07:26
he agreed to try a more conversational,
00:07:28
informal video.
00:07:30
The difference was immediate-students watched longer,
00:07:34
and more of them attempted the follow-up exercises.
00:07:37
He was actually surprised by how much more comfortable he felt,
00:07:41
too.
00:07:41
That's a great story.
00:07:43
And I think it shows that sometimes,
00:07:45
just being willing to experiment and look at the data can lead to big
00:07:48
improvements.
00:07:49
You don't have to be a video expert-you just have to be open to feedback
00:07:53
and willing to try new things.
00:07:53
Exactly.
00:07:56
And as we saw in the last episode with the ECOBI model,
00:08:00
digital education is all about flexibility and continuous improvement.
00:08:05
The same goes for making engaging videos-plan,
00:08:09
measure, adapt, and don't be afraid to get a little personal with your
00:08:13
audience.
00:08:13
Well, that's all for today.
00:08:15
Thanks for joining us as we dug into what really makes MOOC videos engaging.
00:08:19
Elisabeth, always a pleasure.
00:08:19
Thank you,
00:08:22
Martin.
00:08:22
And thanks to everyone listening.
00:08:24
We'll be back soon with another research topic on digital education.
00:08:28
Until next time, goodbye!
00:08:28
Take care,
00:08:31
everyone.
00:08:31
See you next time.

![[02] Making Educational Videos Engaging](https://images.beamly.com/fetch/https%3A%2F%2Fauth.jellypod.ai%2Fstorage%2Fv1%2Fobject%2Fpublic%2FCoverImages%2Forg_01K7DBDW6Z6WY8F3DV1EPJM2Z4%2Fusers%2Fuser_01K7DBDW1MF050KSA7ZE8CDR69%2Ftxb_VHcLKOBN7KCowR1jw.jpg?w=365)



