TL:DR; Are there any best practices for testing online course material specifically? The bulk of my experience is e-commerce websites and WSIWYG tools
I’m in the position of needing to gather some feedback on an online course. The course is fairly long and a new format for our business. We estimate it’s at least a 12 hour commitment over several weeks between reading, answering assignment questions, and attending a live video conference.
Our first test was straight-forward: we offered course certificates for free if testers would give feedback on the course through some post-course surveys and attend 2 video calls.
This failed spectacularly. Few people logged in at all. Roughly 4/30 people made enough progress through the course to be eligible to get credit. Technically testers have another week to complete but I can tell already that most won’t. I am going to send a short survey to those who didn’t complete the course to hopefully find out what factors they feel stood in their way.
I am thinking the design of the test is to blame as it expects a lot of commitment from testers for a payout they only get if they complete the course. However, I don’t have a huge budget to pay testers and I don’t think paying a tester to complete the entire course is necessarily the way to go either.
Ideas I’ve had to fix it:
Break the course into smaller parts and test pieces of it, pay testers for time with free access to other (already tested) courses
Still have testers test the whole course, but pay testers for time with free access to other courses instead of free credit for the course they are completing now - that way it doesn’t matter if they finish or not they get paid
pay testers actual money and stop being a cheapskate (this will be a fight with the bosses but I’m somewhat used to fighting them for things)
recruit way more testers and expect 85% dropoff because people dropoff of online courses all the time
Anyways love to hear your thoughts about the whole thing.