feedback Archives - Ecampus Course Development and Training

I pledge that I have acted honorably in completing this assessment.

There are two sides to the story of security of online assessments. On the one side, cheating does exist in online assessments. Examity’s president Michael London summarized five common ways students cheat on online exams:

The old-school try of notes;
The screenshot;
The water break;
The cover-up; and
The big listen through devices such as Bluetooth headset (London, 2017).

Newton (2015) even reported the disturbing fact that “cheating in online classes is now big business”. On the other side, academic dishonesty is a problem of long history, both on college campuses and in online courses. The rate of students who admit to cheating at least once in their college careers has held steady at somewhere around 75 percent since the first major survey on cheating in higher education in 1963 (Lang, 2013). Around 2000, Many faculty and students believed it was easier to cheat in online classes (Kennedy, 2000), and about a third of academic leaders perceived online outcomes to be inferior to traditional classes (Allen & Seaman, 2011). However, according to Watson and Sottile (2010) and other comparative studies (Pilgrim & Scanlon, 2018), there is no conclusive evidence that online students are more likely to cheat than face-to-face students. “Online learning is, itself, not necessarily a contributing factor to an increase in academic misconduct (Pilgrim & Scanlon, 2018)”.

Since there are so many ways for students to cheat in online assessments, how can we make online assessments more effective in evaluating students’ learning? Online proctoring is a solution that is easy for instructors but adds a burden of cost to students. Common online proctoring service providers include ProctorU, Examity, Proctorio, Honorlock, to name just a few (Bentley, 2017).

Fortunately, there are other ways to assess online learning without overly concerned with academic dishonesty. Vicky Phillips (n.d.) suggested that authentic assessment makes it extremely difficult to fake or copy one’s homework. The University of Maryland University College has consciously moving away from proctored exams and use scenario-based projects as assessments instead (Lieberman, 2018). James Lang (2013) suggested smaller class sizes will allow instructor to have more instructor-to-students interaction one-on-one and limit cheating to the minimum therefore; Pilgrim and Scanlon (2018) suggest changing assessments to reduce the likelihood of cheating (such as demonstrating problem solving in person or via video, using plagiarism detection software programs like TurnItIn, etc.) , promote and establish a culture of academic integrity (such as honor’s code, integrity pledge), and supporting academic integrity through appropriate policies and processes. Kohnheim-Kalkstein (2006) reports that the use of a classroom honor code has been shown to reduce cheating. Kohnheim-Kalkstein, Stellmack, and Shilkey (2008) report that use of classroom honor code improves rapport between faculty and students, and increases feelings of trust and respect among students. Gurung, Wilhelm and Fitz (2012) suggest that an honor pledge should include formal language, state the specific consequences for cheating, and require a signature. For the honor pledge to be most effective, Shu, Mazar, Gino, Ariely, and Bazerman (2012) suggests including the honor pledge on the first page of an online assessment or online assignment, before students take the assessment or work on the assignment.

Rochester Institute of Technology (2014) ’s Teaching Elements: Assessing Online Students offer a variety of ways to assess students, including discussions, low-stake quizzes, writing assignments (such as muddiest point paper), and individual activities (such as staged assignments for students to receive ongoing feedback), and many other activities.

In summary, there are plenty of ways to design effective formative or summative assessments online that encourage academic honesty, if instructors and course designers are willing to spend the time to try out suggested strategies from literature.

References

Bentley, Kevin. (2017). What to consider when selecting an online exam proctoring service. Inside HigherEd. (June 21, 2017). Retrieved from https://www.insidehighered.com/digital-learning/views/2017/06/21/selecting-online-exam-proctoring-service on February 22, 2019.

Gurung, R. A. R., Wilhelm, T. M., & Filz, T. (2012). Optimizing honor codes for online exam administration. Ethics & Behavior, 22, 158–162.

Konheim-Kalkstein, Y. L. (2006). Use of a classroom honor code in higher education. Journal of Credibility Assessment and Witness Psychology, 7, 169–179.

Konheim-Kalkstein,Y. L., Stellmack, M. A., & Shilkey, M. L. (2008). Comparison of honor code and non-honor code classrooms at a non-honor code university. Journal of College & Character, 9, 1–13.

J.M. Lang. (2013). How college classes encourage cheating. Boston Globe. Retrieved from https://www.bostonglobe.com/ideas/2013/08/03/how-college-classes-encourage-cheating/3Q34x5ysYcplWNA3yO2eLK/story.html on February 21, 2019.

Lieberman, Mark. (2018). Exam proctoring for online students hasn’t yet transformed. Inside Higher Ed (October 10, 2018). Retrieved from https://www.insidehighered.com/digital-learning/article/2018/10/10/online-students-experience-wide-range-proctoring-situations-tech, on February 22, 2019.

Michael London. (2017). 5 Ways to Cheat on Online Exams. Inside Higher Ed (09/20/2017). Retrieved from https://www.insidehighered.com/digital-learning/views/2017/09/20/creative-ways-students-try-cheat-online-exams on February 21, 2019.

Derek Newton. (2015). Cheating in Online Classes is now big business. The Atlantic. Retrieved from https://www.theatlantic.com/education/archive/2015/11/cheating-through-online-courses/413770/ on February 21, 2019.

Vicky Phillips. (n.d.). Big Fat Online Education Myths – students cheat like weasels in Online Classes. GetEducated. Retrieved from https://www.geteducated.com/elearning-education-blog/big-fat-online-education-myths-students-cheat-like-weasels-in-online-classes/ on February 21, 2019.

Chris Pilgrim and Christopher Scanlon. (2018). Don’t assume online students are more likely to cheat. The evidence is murky. Retrieved from https://phys.org/news/2018-07-dont-assume-online-students-evidence.html on February 21, 2019.

Rochester Institute of Technology. (2014). Teaching Elements: Assessing Online Students. Retrieved from https://www.rit.edu/academicaffairs/tls/sites/rit.edu.academicaffairs.tls/files/docs/TE_Online%20Assessmt.pdf on February 21, 2019.

Shu, L. L., Mazar, N., Gino, F., Ariely, D., & Bazerman, M. H. (2012). Signing at the beginning makes ethics salient and decreases dishonest self-reports in comparison to signing at the end. PNAS, 109, 15197–15200.

George Watson. And James Sottile. (2010). Cheating in digital age: Do students cheat more in online courses? Online Journal of Distance Learning Administration 13(1). Retrieved from https://www.westga.edu/~distance/ojdla/spring131/watson131.html on February 21, 2019

First, let’s start by considering the characteristics of effective feedback in general. What comes to mind?

sound waves

Perhaps you hear in your head (in the authentically authoritative voice of a past professor) the words timely, frequent, regular, balanced, specific. Perhaps you recall the feedback sandwich–corrective feedback sandwiched between positive feedback. Perhaps you consider rubrics or ample formative feedback to be critical components of effective feedback. You wouldn’t be wrong.

As educators, we understand the main characteristics of effective feedback. But despite this fact, students are often disappointed by the feedback they receive and faculty find the feedback process time consuming, often wondering if the time commitment is worth it. As an instructional designer, I hear from faculty who struggle to get students to pay attention to feedback and make appropriate changes based on feedback. I hear from faculty who struggle to find the time to provide quality feedback, especially in large classes. The struggle is real. I know this because I hear about it all the time.

I’m glad I hear about these concerns. I always want faculty to share their thoughts about what’s working and what’s not working in their classes. About a year or two ago, I also started hearing rave reviews from faculty who decided to try audio feedback in their online courses. They loved it and reported that their students loved it. Naturally, I wanted to know if these reports were outliers or if there’s evidence supporting audio feedback as an effective pedagogical practice.

I started by looking for research on how audio feedback influences student performance, but what I found was research on how students and faculty perceive and experience audio feedback.

What I learned was that, overall, students tend to prefer audio feedback. Faculty perceptions, however, are mixed, especially in terms of the potential for audio feedback to save them time.

While the research was limited and the studies often had contradictory results, there was one consistent takeaway from multiple studies: audio feedback supports social presence, student-faculty connections, and engagement.

While research supports the value of social presence online, audio feedback is not always considered for this purpose. Yet, audio feedback is an excellent opportunity to focus on teaching presence by connecting one-to-one with students.

If you haven’t tried audio feedback in your classes, and you want to, here are some tips to get you started:

Use the Canvas audio tool in Speedgrader. See the “add media comment” section of the Canvas guide to leaving feedback comments. Since this tool is integrated with Canvas, you won’t have to worry about upload and download times for you or your students.
Start slow. You don’t have to jump into the deep end and provide audio comments on all of your students’ assignments. Choose one or two to get started.
Ask your students what they think. Any time you try something new, it’s a good idea to hear from your students. Creating a short survey in your course to solicit student feedback is an excellent way to get informal feedback.
Be flexible. If you have a student with a hearing impairment or another barrier that makes audio feedback a less than optimal option for them, be prepared to provide them with written feedback or another alternative.

Are you ready to try something new? Have you tried using audio feedback in your course? Tell us how it went!

References:

Image by mtmmonline on Pixabay.

Note: This post was based on a presentation given at the STAR Symposium in February 2019. For more information and a full list of references, see the presentation slide deck.

“…expertise is learned from prolonged experience with good feedback on mistakes.” – Daniel Kahneman

Students are eager to receive meaningful feedback quickly. With hopes of improving their class performance, timely and substantive feedback is essential to helping students get on track before it is too late. Yet, knowing this doesn’t change why feedback and grading sometimes gets put off, despite our best intentions – it can appear daunting and time consuming.

8 ideas on how to take the sting out of providing feedback:

Self-checks

Not all feedback requires your intervention or even a grade. Can you set-up an activity where students can check their understanding and get immediate feedback? A simple solution is to create a short practice activity (e.g. multiple choice quiz, drag and drop interactive) which provides immediate results. The prompt feedback supports students to move on to more challenging work with confidence. In some systems, including Canvas, you can provide comments for wrong answers that clues them into where they could find the right answer.

Screencasts

As a student, I really enjoyed a course where the faculty member used screencasts to give feedback. I never had to schedule time during her office hours to feel like we were sitting down and having a conversation about my work. Her tone was approachable, I could rewatch the feedback to make sure I understood it, and it was so personal. It was also a nice break from reading text.

When I later heard her share at a faculty training event that she used this method because it was faster than providing text feedback, I was shocked – that had never occurred to me as a student! She has found that by using screencasts she doesn’t have to labor over editing her words to make sure what she is trying to convey doesn’t get interpreted the wrong way. She saves a lot of time by making them intentionally brief and informal, all while providing students an experience that feels relatable and relaxed.

You can check out this Faculty Focus article on Using Screencasts for Formative and Summative Assessment to learn more.

Campus Partners

Could you require students to see a campus partner, like a writing center, to review a first draft of an assignment? Of course, you will want to discuss your idea with these offices before designing your assignments. If they are willing, they can help you by catching a lot of simple errors in students’ work, so you can focus more of your grading on the content in a later iteration. Also, feedback from multiple people broadens the scope of perspectives a student receives, which deepens their learning.

Here at OSU, you might contact the Ecampus Student Success Counselors, OSU Library, Math Learning Center, Online Writing Lab, or other offices to chat about options for partnership.

Self-assessments

You might be surprised how honest students will be about their own work if they are given the opportunity to grade themselves. Providing a rubric and asking students to respond to each criteria can be a helpful way to encourage students to take a moment to step back, reflect on what they have done, and provide suggestions to themselves on how they could improve.

Group feedback

Providing group feedback quickly allows the ‘go getters’ to get started with at least some advice from you while you are finishing giving more specific grades and comments. While you want to use group feedback sparingly, because students need personalized feedback that relates to their specific work, it can help you to prevent a lot of individual email questions. If you are able to offer group feedback that notes class-wide trends more quickly than individual feedback, it shows that you are reviewing the work and paying attention to how students are doing.

Text expanders

Do you often find yourself writing the same types of comments for students over and over? Text expanders allow you to write a small string of text and it expands into a larger piece of text. Some ideas:

APA => Please review the APA in-text citation guidelines at Purdue OWL.
Rubric => See the rubric requirements regarding this section.
Great => This is great work – way to go!
Research => What research are you using as a basis for your claim? What evidence can you provide for this claim?
Replies => This discussion forum required two replies. Please make sure to post at least two replies in subsequent discussion forums to receive full credit.

If you are unsure where to start, check-out this instructor video You Type Too Much! Use a Text Expander To Save Time from Cengage Learning (duration 01:59).

Social pressure

Consider leveraging social pressure through assignments that are public, like e-portfolios or blogs. It’s amazing how much our work improves when we think it will be viewed by others. If students are presenting their work in a public forum, they may take more ownership over the quality, which reduces how much effort is required by you to grade. You will want to check with your instructional designer on how to do this while still adhering to FERPA.

Chocolate

I hate looking at finances, so when it is time to go over my budget, I put on relaxing music and treat myself to a favorite chocolate. If grading is painful, creating a positive ritual around it can make it easier to engage. Are there ways you can make your environment more inviting and focused?

If you are interested in exploring any of these ideas in more detail, contact your instructional designer to discuss what could work for your course and your teaching style. Remember, meaningful feedback will help your students focus on the learning, rather than just the grade.

By: Amy Munger

Whether you are a new or seasoned online instructor, understanding how to establish and maintain instructor presence is a commonly shared challenge. What is known about online learners is they want to know their instructors are engaged and regularly interacting in the course. Students also express how important it is to know that their instructors care about them.

There is a natural distance inherent in online classrooms which necessitates purposeful actions and intentional structures to prevent isolation and to foster connection. There is great news… this distance can be overcome! Moreover, research has indicated that instructor presence has a relationship with perceived student satisfaction and success. Being there for your students can make a difference!

Being present goes a step further beyond students perceiving that their instructors are there. By definition, instructor presence is “the design, facilitation, and direction of cognitive and social process for the purpose of realizing personally meaningful and educationally worthwhile learning outcomes.” This may sound like a significant undertaking, but rest assured that you can craft your presence over time and that you have ample support from the Ecampus team. We can help bring your ideas to life!

Keep in mind that curating instructor presence will be an evolution. Learning environments and experiences are dynamic. In addition, the composition of students will change each term, so learner needs and wants will continually shift. Strategies used within a specific context may not work for another, and that is okay.

Let’s get started!

Try starting out small by exploring different ideas. Don’t be afraid to change directions if one approach doesn’t work. With all that said, what are some strategies for establishing and maintaining presence which can be leveraged today?

Establishing presence

Welcome announcements
Instructor introduction video
About your instructor page
Course overview video
Virtual office hours or individualized virtual sessions to connect with students
Personalized language to humanize the learning experience

Maintaining presence

Non-graded community building spaces to connect around complex learning activities
Announcements to send regular updates, reminders, and check-ins
- Tip! Announcements can also be leveraged to share and highlight valuable connections, expand upon those insights, and provide relevant resources for learners to explore.
Monitor learner progress
- Regular and timely feedback which is clear and actionable
- Outreach to learners who are struggling or engagement is lacking
Present content in diverse ways
- Module overview videos
- Audio recordings (e.g. podcast)
- Screencast demonstrations
Engage in course discussions
Solicit student feedback
- Tip! Consider adding a short anonymous survey in the middle of the course.

As ideas begin to percolate, please do share those with your Instructional Designer so that together you can explore different strategies and tools that will work best for you.

References

Budhai, S., & Williams, M. (2016). Teaching Presence in Online Courses: Practical Applications, Co-Facilitation, and Technology Integration. The Journal of Effective Teaching,16(3), 76-84.
Ekmekci, O. (2013). Being There: Establishing Instructor Presence in an Online Learning Environment. Higher Education Studies, 3(1), 29-38.
Jaggers, S., Edgecombe, N., & West-Stacey, G. (2013, April). Creating an Effective Online Instructor Presence. Retrieved from https://ccrc.tc.columbia.edu/media/k2/attachments/effective-online-instructor-presence.pdf
Ladyshewsky, R. K. (2013). Instructor Presence in Online Courses and Student Satisfaction. International Journal for the Scholarship of Teaching and Learning, 7(1). doi:10.20429/ijsotl.2013.070113
Sandercock, I. (2014, October 14). The Importance of Instructor Presence in Online Courses. Retrieved from https://teachonline.asu.edu/2014/10/important-instructor-presence-online-course/
Smith, T. (2014, September 30). Managing Instructor Presence Online. Retrieved from http://teachonline.asu.edu/2012/08/managing-instructor-presence-online/#more-1069

Bill Gates, founder of Microsoft

In online education courses, providing effective feedback is essential. It’s can be easy to provide students with a number or letter grade on their assignments, but it is the additional feedback where the opportunity for student growth occurs. While there are many forms of effective feedback, there are 5 elements that can help you provide more meaningful and effective feedback regardless of the method of delivery.

Give Timely Feedback
- Timely feedback to students sends the message that you are engaged in the course and the student’s work. Having just finished an assignment, the student is also going to be more open to the feedback you provide because their work is still fresh in their mind. They have the opportunity to immediately incorporate your feedback into the next assignment, improving their overall performance going forward. Students in a master’s degree program were more likely to ignore feedback comments on their written work that were not provided promptly. (Draft & Lengel, 1986) Including a statement in the syllabus about your expected time of feedback on assignments, and sticking to it, helps students understand your timeline and will reduce questions to you later on.
Start with a positive message
- Creating a feedback sandwich (compliment, suggestions for correction, compliment) for your student pairs together both specific positive feedback and any elements the students should work on. The positive feedback encourages the student and prepares them with a positive outlook when hearing about areas that need improvement. Finishing again with positive feedback such as “I look forward to seeing your next assignment” tells the student that even though they have corrections to make, their work is still valued and that they can improve on future assignments.
Use Rubrics
- One of the best tools that can be used are rubrics. A detailed rubric sets clear expectations of the student for that particular assignment. While completing their assignment they can constantly check their work against what you expect to see in their finished work. Another benefit to creating the rubric is that you can use it to analyze their papers with that same criteria. Some instructors have found that by using a rubric, it helps to be more consistent and fair with grading. No matter if it is the first paper, the last paper, or if you might be having a good or bad day, the rubric helps.
Give personal feedback and help the students make the connection between the content and their lives
- Connection is key. Providing personal feedback to your students while helping them see the connection between the content and their lives will show that you have taken time to personally respond to them instead of using “canned responses.” Students who don’t feel as if the content in the class will ever relate to their lives now, or in their careers later on, will often lose interest in assignments in general as well as feedback because they don’t see the connection. Getting to know your students at the beginning of the term assists in giving good personal feedback while helping them see the connection between the content and their life.
Consider using alternative formats of feedback
- Students are used to getting feedback in written form and while that format can be very effective, using an alternative way to provide feedback can be equally or more effective. They enjoy the personal connections that can be created through audio and/or video feedback. Students appreciate receiving specific feedback relating to the grade, rubric, and overall assessment. In fact, some students say that: “..video encouraged more supportive and conversational communication.” (Borup, West, Thomas, 2015) Give it a try!

By employing these strategies, your students will be appreciative of the feedback you provide and you might just get some fantastic feedback yourself. In one case, an instructor shared a great comment from one of their students comparing past courses to the instructor’s:

“…I never received personal feedback [in some other courses]. Your course however has been wonderful. Thank you for putting so much time into each of your comments on my writing. I can tell you really made personal feedback a priority. You don’t know how nice it was to really know that my professor is reading my work.” The student goes further to say; “Thank you for taking your teaching seriously and caring about your students. It shows.”

Getting personal and effective feedback like this should inspire you to begin or continue that great feedback!

References:

Borup, J., West, R.E., Thomas, R. (2015) The impact of text versus video communication on instructor feedback in blended courses Education Tech Research Dev 63:161-184 doi: 10.1004/s11426-015-9367-8

Draft, R.L. & Lengel, R.H. (1986. Organizational information requirements, media richness and structural design. Management Science, 32(5), 554-571

Providing feedback to students is a critical component in any course and perhaps even more important in an online course where the instructor and students are not in the same physical space. Although written feedback is the primary method used when providing feedback to students, some instructors are turning to the use of audio feedback and finding that it is both easy to do and effective. Research has shown that audio feedback can allow for more nuanced messages to the student. It has also been shown to involve the student more deeply in a class and make them feel that the instructor really cares. One study even found an association between the use of audio feedback and better retention of course content.

There are several online tools that allow you to create and share audio clips easily. One that I’ve used recently is Chirbit. You only need a microphone and you can record clips up to five minutes in length. There is no limit to the number of audio posts that you can share on Chirbit. Once you create an audio clip you can mark it as private and then share the link that is provided with your student. Chirbit has a number of other capabilities for sharing clips that you can explore even further, including the ability to attach transcripts or QR codes directly to audio clips.

Consider choosing one assignment next term that you could experiment with by providing audio feedback to students. Some instructors have reported that giving audio feedback is actually more efficient for them than giving written feedback. It is definitely another way to extend your presence in the online classroom.

Have lots of papers to grade? Lots of student assignments that need your expert, detailed feedback? Instructors and students alike know the value of formative assessments, but instructors know how much time quality, detailed feedback takes to supply. Shortkeys is a helpful program that can help instructors provide detailed feedback and save time in grading by reducing the need to re-type the same passages repeatedly.

Shortkeys is a macro program, which is a program that allows you to set up replacement text for a small number of user-defined keystrokes. If there is anything you type multiple times, this program is for you. There is a limited-use free version, called Shortkeys Lite. The full program costs around $25.

Benefits of using this program:

Significantly reduces grading time – a clear benefit for instructors
Much more efficient than copying and pasting from Word files
Reduces errors due to typos
Significantly improves the depth of feedback instructors can provide, given time limitations – a clear benefit for students
Useful for URLs, HTML code, phone numbers, email addresses, library card numbers, page references in textbooks, or any other information you find yourself having to look up more than once

How it works:
The user programs each “shortkey” code and types out the replacement text. Once the shortkey is saved, it is ready to be re-used. For instance, for a shortkey that is programmed to explain a comma splice and how to fix one, a user could set the shortkey as “##cs.” As soon as the user types that code, a full explanation about comma splices is placed in the document: This is a type of run-on sentence called a comma splice, which is two complete sentences linked with nothing but a comma. Two complete sentences need more than a comma to separate them. To correct this, change the comma to a semi-colon, add a conjunction, or simply make two separate sentences.

Possible applications:

To explain common grammatical and punctuation errors
To provide examples to students, such as example thesis statements
To refer students to outside resources
To demonstrate proper citation styles for various types of sources
To include “here’s what I was looking for & here’s how your assignment measured up” notes for student assignments
To record summaries and announcements that you re-use in my courses from term to term
To remind students of course policies, such as late policies
To record HTML code you use frequently in Blackboard

Where to get it:

To order the software or to download a free trial version, visit www.shortkeys.com.

Ecampus Course Development and Training

Providing inspiration for your online class

Tag Archives: feedback

Academic Honesty in Online Assessment

Audio feedback: What does the research say?

References:

Take the sting out of grading

8 ideas on how to take the sting out of providing feedback:

Self-checks

Screencasts

Campus Partners

Self-assessments

Group feedback

Text expanders

Social pressure

Chocolate

Curating Instructor Presence in Online Education

Establishing presence

Maintaining presence

References

Wanted: Effective Instructor Feedback

References:

Can You Hear Me Now?

Shortkeys

Contact Info