ASU Interactive Video ExperimentArizona State University recently ran an experiment using HapYak Interactive Video to measure student engagement in a hybrid eLearning course comparing interactive, in-video questions to traditional quizzing methods. The results were overwhelming, showing increased student-reported engagement and satisfaction in every category. Read below for more details.


In the experiment, the students watched a number of videos – a common practice in many online courses. They compared traditional online quizzes, taken after the students had watched the entire video, with HapYak on-video (embedded) quizzes, in which the questions popped up periodically throughout the video.

Here’s their summary of the course and the test: “Sustainability Science for Teachers is a newly developed hybrid course at Arizona State University that was crafted by an interdisciplinary team of researchers, developers, designers, educators, and content experts. It incorporates the use of high level video content with engaging homework assignments to build students’ sustainability literacy capacity. The use of a video annotation software called HapYak was deployed in an alpha test during the 2013 summer.”

Below is a snapshot of their results.


We have summarized some of the results below. In every category measured, HapYak on-video quizzes are preferred.

To what extent did the quizzing method achieve the following?

Helped to maintain your interest.

Traditional quizHapYak on-video quiz

Quite a bit: 27.27%
Some: 43.18%
Very Little: 25.00%
Not at All: 4.55%
Quite a bit: 70.45%
Some: 27.27%
Very Little: 2.27%
Not at All: 0%

Helped to keep you on track while watching the video.

Traditional quizHapYak on-video quiz

Quite a bit: 52.27%
Some: 22.73%
Very Little: 22.73%
Not at All: 2.27%
Quite a bit: 77.27%
Some: 22.73%
Very Little: 0%
Not at All: 0%

Helped you monitor your own understanding.

Traditional quizHapYak on-video quiz

Quite a bit: 50.00%
Some: 38.64%
Very Little: 11.36%
Not at All: 0%
Quite a bit: 65.91%
Some: 34.09%
Very Little: 0%
Not at All: 0%

Helped you to focus on the information that was being presented.

Traditional quizHapYak on-video quiz

Quite a bit: 45.45%
Some: 36.36%
Very Little: 18.18%
Not at All: 0%
Quite a bit: 68.18%
Some: 31.82%
Very Little: 0%
Not at All: 0%


From our research we have found that our ASU students prefer the HapYak embedded quizzes. The assessment is formative and our students enjoyed that over the summative traditional quizzes we experimented with. The feedback was very positive from our students. Our students reported that the embedded quizzes help them to stay on task with the videos, helped them pay attention to the videos more closely, and it helped to focus their attention. -Leanna Archambault, Ph.D. & Annie Warren, Arizona State University

Here are a few student quotes that we loved hearing…

It forces me to play close attention to the video and keeps my interest. – ASU Student

The embedded questions force you to pay attention to the video because they make you more accountable in real time. They reduce skimming as well, making sure that students watch the entirety of the video. This format is helpful in keeping my attention and also in lowering the anxiety I feel in anticipation of a quiz. – ASU Student