Test Design in Online Courses

Test Design in Online Courses

Test design in any online class needs to expect that students will have their book and notes available to refer to.

  1. Questions need to be at a higher level on Bloom’s Taxonomy.
    1. Application questions are good to use. They require students to think about how the concepts they learned apply to a different context.
    2. All tests should include a written analysis question. The best way to authentically assess what a student knows is to evaluate how they articulate and apply the concept.
      • An alternative can be a recorded video or audio response with an explicitly stated, specified number of talking points or concepts the student must use or explain. The audio or video aspect could also authenticate the student’s identity.
    3. Factual questions can be used in an online assessment under certain conditions.
      • To authentically assess a student’s knowledge, fact-based tests should have a time limit and a large number of questions. Students will not have enough time to look up the answer to every question and will have a re-enforcing resource for the few questions then need help with.
  1. Canvas also has a Quiz activity log feature that will tell if the student left the quiz screen, but will not indicate what the student viewed on the other browser window.
    • Canvas will also shuffle questions answers, lock questions after they have been answered so students can not go back and change answers, show one question at a time, require an access code and select questions randomly from a question group or bank.
  1. Relay allows people to do summative and formative assessment. The tools in Relay allow faculty to automatically assess student understanding and student effort. They also allow faculty to provide personalized feedback to presentations through the Conversations feature.