Are grades failing us?

Welcome to the Points Marketplace

TaskValueTimeConclusion
Complete the Assessment Worksheet+ 10 pts- 3 hours
Read Grading for Equity + 20 pts- 2 days
Late work- 10% /day+ X days
Find a sample rubric+ 5 pts EC- 5 min

At the end of the semester, each student receives a single letter grade that summarizes how well they learned the content of our course.  But, how much of that grade is really a measure of what they learned? How much of a student’s final grade is based on:

How complicated is their life? 

Students with many responsibilities (such as unpredictable work schedules or family members who face emergencies) may lose points on late work because they need to choose between helping their child and helping themselves.

One of the concerns faculty have with removing late penalties is that students will abuse this allowance. This was not my experience when I went from very harsh late penalties to none at all. Most students still completed the assignments on time. The main difference I saw was that students who would likely have dropped due to missing early assignments stayed in the class and learned the content.  

How much extra time do they have?  

When we give students extra points for activities that are time intensive (such as watching a movie and connecting it to course content), we may be grading students on how much free time they have. Faculty often use extra credit as a “slush fund” to make up for points deducted due to things like late work. If we remove those penalties, students can focus on the learning rather than “making up points”.

Do they know the “hidden curriculum” of academia? 

When we make assumptions about what a “good” essay looks like or the test-taking skills students bring, we may be measuring which high school students attended rather than their knowledge of our content. 

red "Top Secret" stamp

When we have harsh late policies but bend them for students who request an extension, we are actually measuring a student’s willingness to tell us about their challenges, their feelings of being worthy of special treatment, and their cultural background.  It’s much more fair to let all students know up front that late work is acceptable. That is a move towards a more equitable learning environment.

A concern I often hear about removing late penalties is that this makes the class less fair to students who complete the work on time. Treating all students equally can seem like the fairest approach but, in actuality, we are creating a playing field that benefits students who come to our class from backgrounds most similar to our own. Clearly outlining the flexibility in our course policies helps us build a course that responds to individual student needs.  This lets us and the students focus on the course content rather than navigating course logistics. 

Let’s revisit the points marketplace

In the table above, a student may choose to lose points for a late assignment over losing hours at work.  After all, they can make up these points with extra credit but can’t make up the lost wages.  And, a student with limited time may skip the reading. This reading takes the most time and results in the fewest points/hour.  Unfortunately, this is also the single most useful item on the list. I highly encourage you to read Grading for Equity (for zero points)! It brings a fascinating perspective that completely changed the way I look at grading.

Disinvestment from the points marketplace

Instead, what if we focus our grading directly on what we want students to learn and remove all the confounding variables that add inaccuracies to our measures. 

For example: I want to measure a student’s understanding of the respiratory system. I could ask students to write an essay - but this measures writing skill AND their understanding of the respiratory system. The writing skills are a confounding variable because they mask the true measure of a student’s understanding of the respiratory system. Similarly, using a timed multiple choice test adds the confounding variables of how fast students recall information and their ability to parse multiple choice test questions. 

An alternative approach to this assignment is to tell students exactly what you intend to measure and let them choose how best to demonstrate this knowledge.  For example:

Trace the movement of a molecule of oxygen from outside the body until it reaches a red blood cell.  This may be easiest to answer using a numbered list, but you are welcomed to approach this however works best for you.

The assignments in my biology class give students options in how they demonstrate their knowledge.  Students choose to describe this process using a wide variety of strategies: an essay, labeled diagram, flowchart, video, and many more. I’ve been amazed at all the creative and engaging strategies students find for explaining concepts.  Grading becomes fun!  (yes, really…) The key to giving students options in how they demonstrate their knowledge is to be clear about what I am assessing and grading.  Good rubrics (like the one below) are essential.

CriterionExemplaryAccomplishedDeveloping
Structures are described correctly321
Flow of oxygen molecule is accurate described using the listed structures321
Diffusion, oxygen, and carbon dioxide are accurately identified321

Compare this rubric with the table at the very beginning of this article.  What are students asked to focus on? Which gives us more accurate information about what a student is learning? I invite you to share your thoughts and equitable grading approaches in a comment below!

Time for a Change: Authentic Assessment in STEM

""
Photo by Elena Mozhvilo on Unsplash

Leaving Exams in 2019

During the summer of 2020, as the pandemic made it obvious we weren’t going back to “normal life” any time soon, my curriculum needed to reflect the massive changes that were happening in our society. Using the traditional STEM assessment style of short answer or multiple choice exams would not function well within this online learning environment. I could continue to give traditional exams, but would they actually be a valid measure of student knowledge? And, more broadly, would these exams serve my students in helping them to develop skills necessary to be successful beyond my class? 

Additionally, if I were to continue to use traditional assessments I would need to employ an online proctoring tool. This tool would help me maintain academic integrity, to an extent. However, these proctoring tools have significant implications for student equity. Knowing this, I could not, in good conscience, use one. 

In 2019, I made the decision to leave my exams and not use an online proctoring tool. But this left me in a tough spot. How would I measure a student's knowledge without using exams? 

Switching Assessment Styles

As an undergraduate STEM student and a STEM instructor, exams are the only type of assessment I have ever known. As I made this change, I began to realize that it would be  important to switch to assessments that enabled my students to demonstrate their knowledge and develop new skills that could be used in other classes, as well as in life beyond higher education. With access to an abundance of human knowledge at our fingertips via the internet, the ability to research, synthesize, and communicate ideas is of more value to my students’ future than memorizing all the steps of photosynthesis for an exam. With this shift, I was able to move from assessing rote memorization to critical thinking skills – isn’t that what we all should be striving to do? I was also able to connect abstract concepts to current events or students’ daily lives, making them more meaningful and memorable. 

Through this process, I developed a set of projects that draw on the principles of authentic assessments to assess student learning. I provide the basic structure of what needs to be included in the project so I can assess my students’ comprehension of the concepts, but the format of the project is generally open-ended, and multimedia projects are encouraged. 

One example is a role-play scenario where students step into the role of interns for a state government committee on health and human safety. Their goal is to brief the state representative for whom they work about the rise of antibiotic resistant bacteria. This project was inspired by the Performance Assessment Resource Bank. In the brief, students must include the following:

Within this one project, I was able to assess students’ comprehension of several learning goals: their ability to distinguish between prokaryotic and eukaryotic cells, as well as natural selection and evolution. This project also required students to demonstrate their ability to apply their knowledge of the evolutionary process to evaluate large-scale solutions to combat this issue. The form of the final product was entirely up to the students. One student, who was studying digital marketing, built a website. Another held a mock webinar. Some typed their project into a traditional research essay. Even though their final projects took many forms, grading and assessing their work was not as challenging as I expected because I provided a clearly defined rubric

Here is a 3-minute video explanation I provide for my students about this project:

Reactions to a New Assessment Style in a STEM Course

During the week leading up to the start of the semester as students were exploring our syllabus and Canvas course, I had several inquiries about exams. Students asked,  “When are the exams?” and  “Will we need to use [proctoring service] to take exams in this class?” After fielding several variations of these questions, I explicitly explained to my students my philosophy for adopting this new assessment strategy and why we would not have any exams. The idea of being able to show their knowledge outside of an exam in a science class was, at first, mysterious to students. However, they quickly acclimated to this new style of assessment as I promptly answered their questions.

Student feedback about this new assessment strategy was very positive. In an anonymous course evaluation, 97% of students rated the class as “always or almost always having assessments that are related to course material.” In another metric, 100% of students rated the class as “always or almost always having activities and projects which are useful for learning and understanding.” Students reported the projects as “fun and interesting” and said they “helped [to]… understand this subject better.” One student stated these projects helped them “gain a better understanding of the topic when applying it to real life,” which was my intent when making this shift.

In making this change to my assessments, I was met with some skepticism and backlash from colleagues, which resulted in me being reluctant to speak out about equity and assessments in online learning. When I did speak out, I received push back from colleagues saying “Students will have to get used to exams,” as well as, “There’s just no other way to assess learning in my class” except through exams. I even had a colleague claim I was calling anyone who used proctoring tools and exams “racist.” I see now that this reaction is tied to a larger, systemic issue about power and privilege in White dominant culture but I also know it made me hesitate to discuss the topic of assessments and proctoring tools again. 

In Fall of 2020 I was due to be evaluated, and as a part-time faculty member I was incredibly nervous that this different assessment style would be seen as inferior, and thus my employment status and income would be impacted as a result. Luckily, despite the backlash I had received, I had many other colleagues, including my evaluators, who were curious and encouraged by these efforts to adopt different assessment styles. Out of this discussion about assessment and proctoring tools that was met with backlash, I was able to open a conversation about rethinking how we assess learning in STEM. Yes, this is currently an uncommon way to approach assessment for many STEM classes, and can be a challenging pivot to make. But, if we’re truly dedicated to closing opportunity gaps then we must make STEM courses more equitable for diverse learners. 

References:

Van Meter, F. (2020, Sept 11). “Online Proctoring - Impact on Student Equity.Online Network of Educators.

Authentic Assessment PocketPD Guide. (2020, June 17). Online Network of Educators 

Brookhart, S. M. (2018). Appropriate criteria: Key to effective rubrics. Frontiers in Education, (3)10. doi:https://www.frontiersin.org/article/10.3389/feduc.2018.00022 . 

Learning from Students Who Use #EdTech

""

In November, a group of five college students representing the California Community Colleges and California State University systems participated in a virtual panel at the annual Directors of Educational Technology in California Higher Education (DET/CHE) conference. Projected on a screen in front of hundreds of educators, students shared their candid reflections and experiences with technology in teaching and learning.

I had the honor of moderating the panel with support from J.P. Bayard, Director for System-Wide Learning Technologies and Program Services at the CSU Chancellor's Office. As always, listening to student experiences inspired me and reconnected me with the reasons I do what I do. As technology plays a more expansive role in teaching and learning, we must make efforts to center what we do around the real experiences of the humans at the other end of the screen. I also find myself reflecting on the courage it took these students to volunteer to participate and be candid about their experiences. And that is also something all of us can learn from.

I hope you listen to the 30-minute recording and let the students' messages inform your practices as you start the new term ahead. Leave us a comment below and share a takeaway -- we'd love to hear from you!

https://youtu.be/tjEf6SDtvqk
30-Minute Archive of a student panel from the 2018 DET/CHE Conference.

Quick Links

Don't have 30 minutes to listen? Here are the 5 questions the students were asked and a video quick link to their responses.

List of Panelists

View student bios here.