Are grades failing us?

Welcome to the Points Marketplace

TaskValueTimeConclusion
Complete the Assessment Worksheet+ 10 pts- 3 hours▲
Read Grading for Equity + 20 pts- 2 days▼
Late work- 10% /day+ X days▲
Find a sample rubric+ 5 pts EC- 5 min▲

At the end of the semester, each student receives a single letter grade that summarizes how well they learned the content of our course.  But, how much of that grade is really a measure of what they learned? How much of a student’s final grade is based on:

How complicated is their life? 

Students with many responsibilities (such as unpredictable work schedules or family members who face emergencies) may lose points on late work because they need to choose between helping their child and helping themselves.

One of the concerns faculty have with removing late penalties is that students will abuse this allowance. This was not my experience when I went from very harsh late penalties to none at all. Most students still completed the assignments on time. The main difference I saw was that students who would likely have dropped due to missing early assignments stayed in the class and learned the content.  

How much extra time do they have?  

When we give students extra points for activities that are time intensive (such as watching a movie and connecting it to course content), we may be grading students on how much free time they have. Faculty often use extra credit as a “slush fund” to make up for points deducted due to things like late work. If we remove those penalties, students can focus on the learning rather than “making up points”.

Do they know the “hidden curriculum” of academia? 

When we make assumptions about what a “good” essay looks like or the test-taking skills students bring, we may be measuring which high school students attended rather than their knowledge of our content. 

red "Top Secret" stamp

When we have harsh late policies but bend them for students who request an extension, we are actually measuring a student’s willingness to tell us about their challenges, their feelings of being worthy of special treatment, and their cultural background.  It’s much more fair to let all students know up front that late work is acceptable. That is a move towards a more equitable learning environment.

A concern I often hear about removing late penalties is that this makes the class less fair to students who complete the work on time. Treating all students equally can seem like the fairest approach but, in actuality, we are creating a playing field that benefits students who come to our class from backgrounds most similar to our own. Clearly outlining the flexibility in our course policies helps us build a course that responds to individual student needs.  This lets us and the students focus on the course content rather than navigating course logistics. 

Let’s revisit the points marketplace

In the table above, a student may choose to lose points for a late assignment over losing hours at work.  After all, they can make up these points with extra credit but can’t make up the lost wages.  And, a student with limited time may skip the reading. This reading takes the most time and results in the fewest points/hour.  Unfortunately, this is also the single most useful item on the list. I highly encourage you to read Grading for Equity (for zero points)! It brings a fascinating perspective that completely changed the way I look at grading.

Disinvestment from the points marketplace

Instead, what if we focus our grading directly on what we want students to learn and remove all the confounding variables that add inaccuracies to our measures. 

For example: I want to measure a student’s understanding of the respiratory system. I could ask students to write an essay - but this measures writing skill AND their understanding of the respiratory system. The writing skills are a confounding variable because they mask the true measure of a student’s understanding of the respiratory system. Similarly, using a timed multiple choice test adds the confounding variables of how fast students recall information and their ability to parse multiple choice test questions. 

An alternative approach to this assignment is to tell students exactly what you intend to measure and let them choose how best to demonstrate this knowledge.  For example:

Trace the movement of a molecule of oxygen from outside the body until it reaches a red blood cell.  This may be easiest to answer using a numbered list, but you are welcomed to approach this however works best for you.

The assignments in my biology class give students options in how they demonstrate their knowledge.  Students choose to describe this process using a wide variety of strategies: an essay, labeled diagram, flowchart, video, and many more. I’ve been amazed at all the creative and engaging strategies students find for explaining concepts.  Grading becomes fun!  (yes, really…) The key to giving students options in how they demonstrate their knowledge is to be clear about what I am assessing and grading.  Good rubrics (like the one below) are essential.

CriterionExemplaryAccomplishedDeveloping
Structures are described correctly321
Flow of oxygen molecule is accurate described using the listed structures321
Diffusion, oxygen, and carbon dioxide are accurately identified321

Compare this rubric with the table at the very beginning of this article.  What are students asked to focus on? Which gives us more accurate information about what a student is learning? I invite you to share your thoughts and equitable grading approaches in a comment below!

Time for a Change: Authentic Assessment in STEM

""
Photo by Elena Mozhvilo on Unsplash

Leaving Exams in 2019

During the summer of 2020, as the pandemic made it obvious we weren’t going back to “normal life” any time soon, my curriculum needed to reflect the massive changes that were happening in our society. Using the traditional STEM assessment style of short answer or multiple choice exams would not function well within this online learning environment. I could continue to give traditional exams, but would they actually be a valid measure of student knowledge? And, more broadly, would these exams serve my students in helping them to develop skills necessary to be successful beyond my class? 

Additionally, if I were to continue to use traditional assessments I would need to employ an online proctoring tool. This tool would help me maintain academic integrity, to an extent. However, these proctoring tools have significant implications for student equity. Knowing this, I could not, in good conscience, use one. 

In 2019, I made the decision to leave my exams and not use an online proctoring tool. But this left me in a tough spot. How would I measure a student's knowledge without using exams? 

Switching Assessment Styles

As an undergraduate STEM student and a STEM instructor, exams are the only type of assessment I have ever known. As I made this change, I began to realize that it would be  important to switch to assessments that enabled my students to demonstrate their knowledge and develop new skills that could be used in other classes, as well as in life beyond higher education. With access to an abundance of human knowledge at our fingertips via the internet, the ability to research, synthesize, and communicate ideas is of more value to my students’ future than memorizing all the steps of photosynthesis for an exam. With this shift, I was able to move from assessing rote memorization to critical thinking skills – isn’t that what we all should be striving to do? I was also able to connect abstract concepts to current events or students’ daily lives, making them more meaningful and memorable. 

Through this process, I developed a set of projects that draw on the principles of authentic assessments to assess student learning. I provide the basic structure of what needs to be included in the project so I can assess my students’ comprehension of the concepts, but the format of the project is generally open-ended, and multimedia projects are encouraged. 

One example is a role-play scenario where students step into the role of interns for a state government committee on health and human safety. Their goal is to brief the state representative for whom they work about the rise of antibiotic resistant bacteria. This project was inspired by the Performance Assessment Resource Bank. In the brief, students must include the following:

Within this one project, I was able to assess students’ comprehension of several learning goals: their ability to distinguish between prokaryotic and eukaryotic cells, as well as natural selection and evolution. This project also required students to demonstrate their ability to apply their knowledge of the evolutionary process to evaluate large-scale solutions to combat this issue. The form of the final product was entirely up to the students. One student, who was studying digital marketing, built a website. Another held a mock webinar. Some typed their project into a traditional research essay. Even though their final projects took many forms, grading and assessing their work was not as challenging as I expected because I provided a clearly defined rubric. 

Here is a 3-minute video explanation I provide for my students about this project:

Reactions to a New Assessment Style in a STEM Course

During the week leading up to the start of the semester as students were exploring our syllabus and Canvas course, I had several inquiries about exams. Students asked,  “When are the exams?” and  “Will we need to use [proctoring service] to take exams in this class?” After fielding several variations of these questions, I explicitly explained to my students my philosophy for adopting this new assessment strategy and why we would not have any exams. The idea of being able to show their knowledge outside of an exam in a science class was, at first, mysterious to students. However, they quickly acclimated to this new style of assessment as I promptly answered their questions.

Student feedback about this new assessment strategy was very positive. In an anonymous course evaluation, 97% of students rated the class as “always or almost always having assessments that are related to course material.” In another metric, 100% of students rated the class as “always or almost always having activities and projects which are useful for learning and understanding.” Students reported the projects as “fun and interesting” and said they “helped [to]… understand this subject better.” One student stated these projects helped them “gain a better understanding of the topic when applying it to real life,” which was my intent when making this shift.

In making this change to my assessments, I was met with some skepticism and backlash from colleagues, which resulted in me being reluctant to speak out about equity and assessments in online learning. When I did speak out, I received push back from colleagues saying “Students will have to get used to exams,” as well as, “There’s just no other way to assess learning in my class” except through exams. I even had a colleague claim I was calling anyone who used proctoring tools and exams “racist.” I see now that this reaction is tied to a larger, systemic issue about power and privilege in White dominant culture but I also know it made me hesitate to discuss the topic of assessments and proctoring tools again. 

In Fall of 2020 I was due to be evaluated, and as a part-time faculty member I was incredibly nervous that this different assessment style would be seen as inferior, and thus my employment status and income would be impacted as a result. Luckily, despite the backlash I had received, I had many other colleagues, including my evaluators, who were curious and encouraged by these efforts to adopt different assessment styles. Out of this discussion about assessment and proctoring tools that was met with backlash, I was able to open a conversation about rethinking how we assess learning in STEM. Yes, this is currently an uncommon way to approach assessment for many STEM classes, and can be a challenging pivot to make. But, if we’re truly dedicated to closing opportunity gaps then we must make STEM courses more equitable for diverse learners. 

References:

Van Meter, F. (2020, Sept 11). “Online Proctoring - Impact on Student Equity.” Online Network of Educators.

Authentic Assessment PocketPD Guide. (2020, June 17). Online Network of Educators 

Brookhart, S. M. (2018). Appropriate criteria: Key to effective rubrics. Frontiers in Education, (3)10. doi:https://www.frontiersin.org/article/10.3389/feduc.2018.00022 . 

The Learning Never Stops: Preparing to Teach in an Emergency

Umbrellas

The Learning Never Stops: Preparing to Teach in an Emergency

Emergency power shut-offs.   Fire evacuations.   Pandemic quarantines.

The list of emergencies that could require you to temporarily move your course online seems to be growing every day. CVC-OEI provides a robust set of instructional resources for Canvas and online course design that can aid faculty, administrators, and instructional support staff with the transition of on-campus courses into the distance education modality.

Don't wait for disaster to strike - check out these resources and prepare now.

CVC-OEI Emergency Preparedness Resources: Planning for uninterrupted instruction and student support in the event on-campus courses need to temporarily move online.

Course Design Rubric: The CVC-OEI Course Design Rubric can be used as a checklist for instructors who are moving instruction from the classroom to the Canvas common course management system. The Rubric guides instructors on setting up a course with clear navigation, regular effective contact, effective assessments, and accessibility compliance.

Canvas Support Portal: This one-stop resource includes links to the CCC Canvas Home Base, a Canvas Community where users can access text and video user guides and post questions to the Canvas Community. 

Byte Sized Canvas Videos: These short, desktop video tutorials provide pedagogical and technological tips on the use of Canvas.

Student to Student Interactions This Pocket PD Guide shows instructors how to meet the student-student interaction requirement that is now part of the Title 5 Education Code for California Community College Distance Education courses (Instructor Contact, Section 55204).

Adoptable Courses: Colleges needing to quickly prepare faculty to teach online in the case of an emergency can download courses from CVC-OEI/@ONE and adapt them to use locally. Fourteen “CVC-OEI Adoptable” courses can be found in Canvas Commons, including Introduction to Online Teaching & Learning,  Introduction to Course Design, and Introduction to Designing for Accessibility.


 

When We Empower Students to Become Experts

Join Chelsea on a tour of this assignment in the 4-minute video above.

How might you blend research, group work, video creation, and friends and family into an empowering and equitable learning experience for your students? In the 4-minute video below, Chelsea Cohen from Laney College, will show you!

Chelsea’s students, who are English for Speakers of Other Languages (ESOL) learners, engage in a multi-stepped project, beautifully scaffolded into managing meaningful chunks. Each step of the way, students collaborate and increase their knowledge of a particular topic. Chelsea will demonstrate how extending discussions beyond the classroom or Canvas and into a students’ circle of family and friends can foster more diverse dialogue that situates a student as an expert. Can learning get more meaningful than this?

3 Steps to Becoming an Expert

  1. In groups, create a video using Adobe Spark based on your research paper.
  2. Share and discuss your video with friends and family (Extension: share the videos with your Twitter communities).
  3. Reflect upon the experience with your classmates in our class discussion. Summarize the ideas that came up with your friends and families and how it felt for you to facilitate the conversation.  

Accessibility tips! If you have a student in your class that uses a screen reader to navigate the web, you will need to provide an alternative to Adobe Spark Video. Also, if you have a student with a hearing impairment, have at least a few students caption their videos before sharing them with the class. To caption an Adobe Spark Video, download it from Spark, upload it into YouTube, and edit the auto-captions.

We suggest surveying your students in week one to let them know about your multimedia project plans and ask if they will need any accommodations. They'll appreciate your efforts to support them!

Learning from Students Who Use #EdTech

""

In November, a group of five college students representing the California Community Colleges and California State University systems participated in a virtual panel at the annual Directors of Educational Technology in California Higher Education (DET/CHE) conference. Projected on a screen in front of hundreds of educators, students shared their candid reflections and experiences with technology in teaching and learning.

I had the honor of moderating the panel with support from J.P. Bayard, Director for System-Wide Learning Technologies and Program Services at the CSU Chancellor's Office. As always, listening to student experiences inspired me and reconnected me with the reasons I do what I do. As technology plays a more expansive role in teaching and learning, we must make efforts to center what we do around the real experiences of the humans at the other end of the screen. I also find myself reflecting on the courage it took these students to volunteer to participate and be candid about their experiences. And that is also something all of us can learn from.

I hope you listen to the 30-minute recording and let the students' messages inform your practices as you start the new term ahead. Leave us a comment below and share a takeaway -- we'd love to hear from you!

https://youtu.be/tjEf6SDtvqk
30-Minute Archive of a student panel from the 2018 DET/CHE Conference.

Quick Links

Don't have 30 minutes to listen? Here are the 5 questions the students were asked and a video quick link to their responses.

List of Panelists

View student bios here.

How to Handle That Pesky Little Dash in the Canvas Gradebook

Ever been confused by all the options and symbols in the Canvas Gradebook? Well, you’re not alone! In this episode, we’ll zero in on the little dash that shows up in ungraded assignments. Knowing how to deal with it properly will mean you’re headache-free when it’s time to turn in your grades at semester’s end.

Empower Me! An Online Student’s Perspective

Empowering students is a critical part of education and there is room for improvement in the United States. Students need self-worth, motivation, determination, and persistence to thrive in a course, and often times those traits come out of student empowerment. Giving students the opportunity to shape their education, develop their lessons, and apply it to their own path is essential because it encourages critical thinking, and gives lessons that can be applied outside of the textbook and the classroom, and eventually applied to their career. Being a passionate student about this topic, I have much to share and a few suggestions too.

In 2017, I graduated from College of the Canyons (COC), a California Community College, with associates degrees in Mathematics, Computer Science, and Physics. After that, I transferred to Cal Polytechnic, San Luis Obispo where I am now majoring in Computer Science and minoring in Entrepreneurship. I have been taking online courses since I was in high school and I was also employed at COC as a member of their Open Educational Resources (OER) program. From these experiences, I have gained a great deal of insight about how to engage and empower students in the online environment.

When students feel valued in a class, they will see it as a meaningful experience. But where do you start with this lofty goal? Start by reflecting on a few questions about your class.

If you struggle to answer these questions, ask your students. They love to give input and opinions, and just want to feel important to the class. Asking students for input is a great way to empower them!

9 Tips for Empowering Your Online Students

Here are some additional suggestions.

Have your online students:

  1. Create their own prompt for an assignment
    • Provide a rubric you will use for grading, and give students the freedom to craft an assignment around the rubric after you have approved the plan.
  2. Create their own test questions
    • This is a great way to see if  students understand the material and get an idea of what they think is important in the class.
  3. Give input on the course at  the beginning and the end.
    • Asking for student feedback immediately is a great way to establish a trust and convey that you are here to support your learners. Some suggestions for week one include: What do you expect from this class? What do you hope to learn? .
  4. Teach some of the lessons in the class (using Canvas Groups )
    • One of the best classes I took had groups of four students teach the class every day for the last half of the quarter. This was great because each group had to know their material well to teach it.
  5. Find resources for the class
    • Students can find great resources, and having additional relevant resources is always a good idea, especially for students who struggle.
  6. Run a socratic seminar  
    • When students facilitate discussions about topics  they are more engaged. Act as the guide of the conversation and requires each student to speak at least once.
  7. Seek out scholarships, competitions, grants, and more.
    • For every topic in school, there is always a way to get students more involved. Encouraging them to apply for an opportunity and let them know you believe in them! . If they are successful, they will have something to  show off for a lifetime.
  8. Help write materials for future courses
    • When students know their assignments are not ‘throw away’, they are usually more willing to invest time in the topic and deliver something that will last. Plus, they may be able to deliver it in a way future students will  understand a bit better
  9. Connect with their community
    • Local companies are always looking for help. Connecting students with local businesses gives students a chance to understand a career and be considered for a potential employment opportunity.

How do you empowering your online students? Leave a comment below so we can keep this list going!

Join Natalie for her keynote presentation at Can•Innovate, Friday, October 276th - a free, online conference!

The One Thing You’ve Been Missing to Keep Students Focused on Your Content

Many students are brand new to Canvas or, even if they’ve been using it awhile, just don’t know it very well. You can decrease their floundering and frustration (and make your life easier) by giving students some basic guidance as part of your course design. In this episode, we look at four simple things you can do to keep students from getting sidelined by inexperience with Canvas.


BONUS: I created a "Canvas Tips for Students" cheatsheet you can share with your students. It's currently in a barebones, accessible Word format--I suggest you download and customize it for your class and then add it to a page in your course.

Visually-Oriented Discussions with Consistent Instructions

Discussions are an important part of fostering student-student interactions in an online course. After completing the OEI Online Course Review process, Shannon Van Zant, who teaches History at Columbia College, recognized the importance of designing her discussions with clear, consistent instructions. Having the same instructions available to students each week scaffolds their learning and supports them to become confident and independent learners. Shannon, also incorporates images into the prompts of her discussion topics. By integrating images into the textual content of her discussion, she more fully engages the way people learn.

In the 7-minute video below, Shannon shares her experiences with the OEI Online Course Review process and takes us on a tour of her online visual discussions.

2:47: Skip to view the tour of Shannon's Course

Tips to Help Students Make the Most of Feedback

Tips to Help Students Make the Most of Feedback

Have you ever had the sinking suspicion that the feedback you have painstakingly provided for students is—gasp—not being read? Does the next essay you read make the same mistakes? Considering how many hours we dedicate to providing meaningful feedback, this can feel a little frustrating!

This semester I have been on a quest to ensure that my students are not only carefully reading my feedback, but applying it.  Here are some strategies that I incorporate before, while, and after grading:

Before Grading

Illuminate Expectations

Along with each assignment, I provide a detailed rubric spelling out performance at each level so that students can see what is expected of them. I refer to this rubric repeatedly as we work on the assignment.

View a Sample Rubric! I invite you to view one of my rubrics, shared in the form of a public Canvas assignment. The rubric is located on the assignment page under the heading "Essay Evaluation and Feedback."

Actively Anticipate Student Work

I explain early and often that I will be spending lots of time with the incoming set of essays or projects and providing detailed feedback. I want my students to write knowing that they have an attentive and responsive audience. I find that if students know their work will be carefully reviewed, they are motivated to invest more time into it, which tends to lead to higher quality submissions.

While Grading

Make it stick!

I provide different types of feedback, both within a semester and even within an assignment: annotations, rubric comments, and audio/video feedback, for example. Why? Different methods appeal to different students, and I want my feedback to stick. I have also found that when one type of feedback reinforces another, the message has a better chance of breaking through. So, if I see several examples of “creative” source citation, I will use the annotation tools in Canvas to mark the examples, and then I’ll follow this up with a video comment that shows and explains the correct citation format.

Layer Praise with Suggestions

I balance kudos with suggestions for improvement so that students are encouraged to keep reading/viewing the feedback and then motivated to act on it.

After Grading

Video Guide for Finding Feedback

Before releasing the first graded assignment with feedback, I share a video explaining how to access and use my feedback.  While the assignment is “muted” and they are waiting to see how they did, they are a captive and motivated audience!  This video shows students how to find their feedback, what they can expect to see, and how to make the most of it:

3 Tips to Fuel Feedback

Here are three more ways to help students make the most of the feedback they have received:

  1. Encourage students to respond to feedback by replying to you with their own annotations, comments, or video. This helps students move from passively reading to actively engaging with the feedback.
  2. Offer extra credit to students who develop a work plan to address noted issues or seek tutoring to address a recommendation.
  3. Instruct students to review your feedback when they prepare for their next assignment. For example, you might ask students to identify three goals for the next paper via a journal entry, reflective quiz, or survey. Or a required step in assignment submission might be using the comments area to explain how the new submission addresses feedback from the last one.

Students have a lot of information competing for their attention, and I have found that these strategies help my feedback rise above the noise . . . and hopefully start a conversation.

How to Write Great Rubrics & Why You'll Love Them!

Let’s start with the $6-million-dollar question: with so many other teaching tasks calling for your attention, why take the time to write a great rubric? (Because, while anyone can dash off a mediocre, not-very-useful rubric, it does take time to write a good one.)

Here’s why. A well-constructed rubric is a powerful communication tool that will result in a clear, measurable preparation process for students and a time efficient, consistent grading process for you. That means less time grading, fewer questions or complaints, and improved student performance in meeting your assignment standards and learning objectives.

What’s not to love?!

Canvas’s rubric tool makes using rubrics simple, easy and (dare I say it?) fun. There are three parts to the Canvas rubric grid:

  1. Criteria: These are the big-picture categories for grading. In a Discussion, for example, your criteria might be “Initial Post” and “Replies to Classmates.”
  2. Ratings: These are the explicit descriptions of the levels of performance that might be achieved within the specific criteria category.
  3. Points: This is your rating scale.

Criteria are best determined by considering which learning outcomes are being assessed. What, exactly, do you want to grade for this assignment? Use these guiding questions to help identify your criteria:

Ratings, or descriptors, detail the measurable evidence that the student has achieved your criteria—or not. “Knowing” and “understanding” aren’t easily measured. Instead, describe the evidence students can provide that shows they’ve accomplished what you’d hoped they would. Think of this as the feedback portion of your rubric. What are the highest expectations you have for student performance on this assignment? What is the worst execution of this assignment you can imagine?

Points are pretty self-explanatory. It’s a good idea to weight criteria appropriately. For example, is “few grammatical/spelling errors” really worth the same as “clarity and originality of thought”? Points should reflect the effort being asked of the student.

3 Tips for Effective Rubrics

Examples

Here are a few example rubrics from several institutions. Some are better than others, but you’ll get a sense of the structure, variety and languaging.

Rubrics are an assessment tool, a means to improve learning and a communication tool all wrapped up in one neat little package. When done well, they can be an asset to both you and your students!

Additional Resources:

Designing for Quality Discussions with Participation Guidelines

 

When designing your online course, it important to incorporate clear, consistent guidelines for participation activities. These guidelines might include:

In the short video below, Tracy Schaelen walks you through an example of how to provide guidelines and criteria for online discussions.