Do you ever wonder where your students go once they log into an online course? John Whitmer (Blackboard analytics, blog link) and Kevin Reeve (instructor and director of Teaching and Learning Technologies at Utah State University, Canvas Analytics video link) did some hard work to seek answers to this question. Kevin presented his team’s preliminary results at Online Learning Consortium conference in Nov. 2016. Some of the findings were obvious, some not so.

My question is: what can we do with this information? How can we use this learning analytics to guide our course design practices as online instructors and online instructional designers?

Here is a summary of Kevin’s report and my ideas of course design based on learning analytics of students’ course visiting behavior patterns:

Student course visit behavior Observations from Canvas learning analytics: Course Design Ideas:
Students’ first visits to online courses may be exploratory.

activitiesannouncementdqtodoviewcalendar

Use announcements to connect with students before course start and during course session; Create navigation tutorial video to guide students; Design course homepage, Start Here module, and syllabus for easy navigation and communicate important information with clear instructions.
Some students visit “Grades” early on to view the weighting of grades and other details Have an accurate grade book available from day 1
Some students visit assignments first Put link to learning module, or related learning materials, learning outcomes, instructions etc. in each assignment.
Many visits to course do not start with homepage Design your course homepage to be attractive and put information that students care to read there; Direct student attention to course homepage if you intend to put important information on homepage, otherwise do not overly rely on homepage.
To do list is driving students entry points once course starts. Enter due dates for graded assignments so the assignments will appear on the calendar and to do list.
Syllabus is being missed by some students during the first few visits Make syllabus prominently visible and accessible.

In the same time, put important information from syllabus in multiple places such as course home page, Start Here module, and first assignment directions, in case students visit assignments directly.

If you have ideas for Canvas course design based on the above observations or your own observations of online students course visit behavior patterns, feel free to share with us

Happy Holidays!

Just came back from Open Oregon State‘s Open Education Day and can’t wait to share with you all what I have learned from the meeting: open pedagogy. The keynote speaker for Open Education Day, Rajiv Jhangiani from the University of British Columbia (@ThatPsycProf), introduced open pedagogy as an instructional strategy to promote reusable assignments and turn students from consumers of content to creators of content.

Examples: a book produced by instructor and students from Brigham Young University (2012)a wiki resources of web 2.0 tools created by students from College of Education at Purdue University (2012); a book produced by instructor and students from the Master of Science in Education: Information Technology program at Western Oregon University (2013):

project management for instructional designers book coverinsite project: web 2.0 tools for educationmassively open book

Examples of open pedagogy Jhangiani introduced:

LibrerTexts: Students-built knowledge base for Chemistrylibretexts: students built knowledge base in chemistry

When Wikipedia Is the Assignment, & WikiUniversitywikiversity

Teach and Learn Psychology for free at NOBA noba: teach and learn Pscychology for free

 

Annotate Open source text to teach literaturegutenburg project

free public domain images from rijks museumfree public domain images from rijks museum

The call is for instructors to design assignments that build problem solving skills, critical thinking skills and/or analytical writing skills in students and create assignments that live beyond the lifespan of a course and are useful to the general public, instead of creating assignments that only one instructor will view in order to give a grade.

Have fun design such creative assignments and feel free to share your life-long assignments with us.

feedback
image of man crying after receiving negative feedback

Why Peer Review?

According to a study by Leadership IQ, 26% of new hires fail because they can’t accept feedback (Murphy, 2015). Most students are trained to study for grades and have seldom been given enough training on how to receive feedback and how to make feedback work for them. By the time they enter workforce, they will have a hard time facing feedback from coworkers and supervisors. As instructional designers and instructors, we can help by training students in peer review skills. In doing so, we are preparing our students to be successful in their future career on the one hand; on the other hand, instructors will spend less time grading peer reviewed submissions because of the improved quality of work submitted. It’s a win-win solution. Nothing could get better than this in teaching, right?

How to Create Peer Review Assignments in Canvas?

There are two types of peer review assignments.

  1. Writing assignments with peer review process where peer review effort is not heavily graded. The focus is on improved writing.
  2. Writing assignments with peer review process where peer review efforts is heavily graded. The focus is on training students in peer reviewing.

If your students lack peer reviewing skills, instructors can provide tutorials on how to provide feedback constructively. And instructors can also set up practice assignments where peer review is graded, for at least one or two assignments so that students are given the proper training and practices they need. Here is a video tutorial on how to provide constructive feedback.

If your students have been trained in peer reviewing, I recommend the type of assignments where peer review is not heavily graded. Peer review can be extra credit points, or a small portion of the grade.

To set up peer review in Canvas for an assignment, Log into Canvas course as an instructor/designer, go to the assignment, click “Edit” button to edit the settings for the assignment.

It will greatly help students if you provide clear directions for how you expect students to conduct peer review.

BA 347 International Business
banner image of BA 347 International Business

 

For example, in BA 347 Research Writing Assignment, the instructor provided the following directions: Peer Review Feedback guidelines: As you conduct your peer review, remember to praise, criticize appropriately, and be specific with revision strategies.

  1. Identify and describe three strengths in this draft.
  2. Identify and describe three weaknesses in this draft.
  3. How does this draft meet the requirements of the assignment? If not, what is missing?
  4. What should be revised in this writing? Why?
  5. After reading, I was left wondering….”

To set up details for peer review, first we set up a due date for when the draft writing will be due and enter the date in the assignment “Due” area. Secondly, check “Required Peer Reviews” box to enable peer review, and how to assign peer review (manually or automatically), if automatically, enter a number for how many peer reviewers will be automatically assigned for each submission and enter a date for when the peer reviewers will be assigned in the “Assign Reviews” area. Lastly, enter a date in the “Available from … until” area for a “until” date as the date for when the peer review will be due. And explain to your students what these dates mean if this is the first time you assign peer review assignment in your course.

Peer Review Set up in Canvas
How to set up peer review assignment in Canvas. date 1: Individual draft due date; date 2: Peer Reviewers assigned date; date 3: Peer Review due date and assignment becomes unavailable after this time.

Image 1: Canvas Assignment Peer Review Option Set Up

Grading peer review

Once all of the peer reviews have been submitted, if instructors would like to access the actual comments, assess, or add comments of their own, they can do so by going to the speedgrader function. To grade the original submission, simply enter grade point in the Assessment “Grade _____ out of 10” area.

Grading Peer Review Assignment
an image of peer review assignment in Canvas with area for grading highlighted.

Image 2: Grading Assignment

To grade peer review effort, the instructor would need to set up a separate assignment and name it something like “Peer Review Grade”. Some instructors attach peer review rubric forms so students can attach the forms in the submission for Peer Review Grades. See a youtube video example and its web instructions.

 

References:

Murphy, M. (2015). Why New Hires Fail. Retrieved on November 17, 2015, from http://www.leadershipiq.com/blogs/leadershipiq/35354241-why-new-hires-fail-emotional-intelligence-vs-skills

Alisa Cooper’s post “Conducting Peer Review Assignments in Canvas” at http://freshmancomp.com/2013/02/19/conducting-peer-review-assignments-in-canvas/

Why Modular Course Design

The Course Development & Training team at Oregon State University Ecampus promotes modular course design in our online courses. Laura Crowder (2011) defines modular content as “a collection of learning resources developed as a single learning object”. The major benefits of modular course design include:

  • Saving time in the development and updating of course content
  • Modular components are easily repurposed across courses
  • Student learning is improved since the content is presented in smaller chunks

Modular Course Design in Online Education

Modular course design has been highly recommended by various pioneers in online education. Stephen Downes (Downes, 1998) stated in “The Future of Online Learning” that, “…Online courses will be modular. A course – especially from the designer level – will no longer be seen as a single unit, but rather, as a collection of component parts, each of which may be replaced or upgraded as the need arises.” Andrea Henne (Kelly, 2009) recommended that “modular course design benefits online instructors and students.” The Institute-wide Task Force on the Future of MIT Education Final Report (2014) suggests “an action plan that includes the goals to identify any new or existing MITx course that could be produced as modules; produce the “sticky” modules associated with these subjects; define a limited set of standalone (“smooth”) modules and produce these; put in place a well-organized repository of existing and new modules and define guidelines for building and credentialing customized courses.”

Modular Course Design at OSU Ecampus

With Ecampus’s move to Canvas, modular course design is even easier to implement. Our online courses are generally formatted into 11 weeks as 11 modules. We used a modular course design template for creating each week’s learning content, which includes:

  • weekly overviews
  • learning objectives
  • pre-quiz
  • assigned readings
  • lectures
  • resources
  • appropriate activities such as graded and non-graded assignments
  • discussions
  • assessments
  • post-quiz
  • wrap-up

Our template is very similar to Henne’s template (Kelly, 2009), which consists of learning objectives, see table 1 for comparison of the two templates.

ModularDesigncomparisonTable

Table 1. Comparison of Global Public Health – H 333’s course design template and Henne’s course design template.

This weekly modular template, however, should not limit us from organizing learning content into even smaller units within a weekly module. Here is an example of two modular learning content units within one week in Global Public Health – H 333. The highlighted boxes show two modular content units within Week 1.

ModularDesignScreenShot

Image 1. Screenshot of Global Public Health – H 333 online course Week 1 Learning module

Therefore, if you have a course that has heavy content within each week, feel free to break them into smaller learning modules instead of putting them together as a long big piece.

Enjoy designing and teaching online in Canvas.

References:
Crowder, L. (2011). How to develop modular content in 4 easy steps. retrieved from http://www.learninghouse.com/blog/publishing/how-to-develop-modular-content-in-4-easy-steps on July 28, 2015.

Downes, S. (1998). The Future of Online Learning. Online Journal of Distance Learning Administration, Volume I, Number 3, Fall 1998. State University of West Georgia, Distance Education Center.

Kelly, Rob. (2009). A Modular Course Design Benefits Online Instructor and Students. Faculty Focus. September 2009. Retrieved on July 24th, 2015 from http://www.facultyfocus.com/articles/online-education/a-modular-course-design-benefits-online-instructor-and-students/

Institute-wide Task Force on the Future of MIT Education: Final Report, July 28, 2013, pp. 49–50.