13 Key Factors for Assessment Design
Dr. Seanna Takacs; Junsong Zhang; Helen Lee; Lynn Truong; and David Smulders
Assessment design can be daunting. Sometimes we hear from students that they doubt the relevance and usefulness of their work, or they simply have a hard time completing all the assignments required for the course. In these cases, learners may experience barriers that they don’t even recognize as barriers, internalizing them or blaming the course, the instructor, or themselves. Learners can find that they are not relying upon their strengths or are not given the chance to show their best work. At other times, we, as instructors, underestimate the power of meaningful feedback or overlook the time and effort we need to craft that feedback. These problems can create a vicious circle where you and your students are both feeling stuck and frustrated.
If you have experienced any of these challenges, it may mean that you have opportunities to re-examine your assessment design through a UDL {Universal Design for Learning} lens. You can approach these challenges by investigating and empathizing with the student experience, soliciting feedback from students, creating safe conversational spaces to identify the problems, and adopting appropriate strategies to engage your students and support expert learning. Don’t forget that supporting yourself is also important as you empathize and investigate assessment challenges. When in doubt, find a supportive colleague or group who likewise are interested in trying new things so you can move your assessment decision-making forward!
Before you start (re)designing your assignments and assessments, here are the five key factors for your consideration:
- Learning outcomes and objectives
- High-stake and low-stake assessments
- Workload for you and your students
- Feedback and rubrics
- Delivery mode
Learning Outcomes and Objectives
The best place to start creating an overall assessment strategy is to carefully examine your learning outcomes and objectives. From a UDL perspective, students need to know why they are being assessed and what might be the skills or abilities they are working on through the assessments so they can prioritize their goals and adjust learning strategies accordingly. As an instructor, explaining how your assessments are tied to learning outcomes and objectives can be critical to engage your students and support goal setting.
While sometimes learning outcomes and learning objectives are used interchangeably, it is important to understand that they are different.
- A learning outcome describes the overall purpose or goal from participation in an educational activity. The learning outcome is a reflection of the desired state.
- Learning objectives are used to organize specific topics or individual learning activities to achieve the overall learning outcome.
Here are some examples from UCLA Health Course Planning Tip (2016):
Learning Outcomes | Learning Objectives |
---|---|
Demonstrate knowledge of evidence-based treatment for hypertensive patients by passing post-test with score of ≥ 80%. | List 5 side effects of anti-hypertensive agents.
|
Correctly identify required actions to manage patients in hypertensive crisis by analyzing a case study. | Discuss risks associated with untreated hypertension. |
Utilize an evidence-based protocol. | State normal range for blood pressure. |
In practice, you may use course-level learning outcomes to guide the design of the overall assessment plan and use learning objectives to create the specific assessments for each module or topic. Ultimately, your assessment plan should be aligned with the learning outcomes and objectives, and reflect the specific knowledge, skills, or abilities identified in the course outcomes. Even before you offer choices or consider engagement, examine whether you have a sound rationale whereby course activities, content, and assessments are in line.
Keep in mind that simply listing the type of assessments in your syllabus is not sufficient to engage students. It is crucial to communicate with students the relevance of these assessments and how they might benefit from doing them. To take it a step further, consider offering choice of assessments, with that choice being grounded in the meaningfulness of assessments. What would enrich the learning experience? What would help students feel they have consolidated knowledge or feel a solid sense of their skill set?
Low-Stake and High-Stake Assessments
Low-stake assessments are also referred to as formative assessments, which usually have low or no point value in a learner’s grade. These assessments may include journal posts, discussions, and knowledge checks. Research shows that formative assessments motivate students to learn and make them aware of the areas they need to work on, thus contributing to the process and outcome of learning (Weurlander et al, 2012).
High-stake assessments are also referred as summative assessments, which means that they are often used to decide the final score or grade on a learner’s academic record. They are used to evaluate student learning by comparing with certain standards or a benchmark. These assessments could include a mid-term or final exam, modular quizzes, standardized tests, a final project, or a final paper.
A good assessment plan should balance low-stake and high-stake assessments. While high-stake assessment is necessary in many educational contexts, we encourage frequent and varied formative assessments in which choice of modality, topic, or pacing can help cultivate expert learners from a UDL perspective.
Workload for You and Your Students
Through course evaluation, we sometimes hear from students that there is too much reading, too many assignments, or too many tests or exams in a course. As an instructor, sometimes we are also concerned that the workload can suddenly become overwhelming during mid-terms or toward the end of the term. Worse, we sometimes hear that assessments make no sense or don’t seem to be connected with the course content in any meaningful way. When this happens, it can be important to acknowledge that these feelings around workload can have a lot to do with how we design our assessment plans.
The first step to address this issue is to start thinking how long it will take for a student to complete each activity in your course, and what are the maximum hours we expect them to spend on the course. Be sure to check in with students frequently on workload and meaningfulness of assessments. How long is the work typically taking? What pieces of the content are meaningful, challenging, or easy? Do students want more challenges and what kind of challenge are they seeking? A straightforward way to assessing workload is to create a table that lists the time needed for all activities such as reading articles, composing a discussion post, and prepping for exams. Work on this table together with students to map out workload, expectation, and to leave space for collaboration and designing multiple routes to assessment. We highly recommend introducing students to the Workload Estimator designed by Wake Forest University and creating a workload plan together.
While you are working with students on workload calculations and checking in on the meaningfulness of assessments, be sure to consider your own workload. Often, instructors balk at the idea of UDL because it seems like even more work when instructors often feel overloaded already.
Feedback and Rubrics
A key to successful assessment is giving students a clear understanding of what the expectations are for their work and providing meaningful feedback that facilitate the learning process. Other than verbal and written feedback, rubrics can serve as a baseline of what is expected in learning and can be an efficient tool to provide timely, detailed, and consistent feedback.
Rubrics can generally be divided into holistic rubrics and analytical rubrics.
- Holistic rubrics usually list one general criterion and is used to assess students’ overall achievement.
- Analytic rubrics include multiple criteria and allows you to assess students’ achievements based on the criteria predefined in the table.
You may refer to rubric examples here.
Rubrics can be useful for all kinds of assignments such as written assignments, oral presentations, teamwork, peer review, and self-assessment. If you are new to rubrics, you may start by creating one or two rubrics per term, or ask your colleagues if they have rubrics that you can use or modify.
You may also consider creating rubrics WITH your students. If students are offered choices around assessment, it makes sense to offer choices around rubric style. What are the key points? What will constitute a good presentation, or effective group work? When students co-create the rubric, they are, in essence, setting up a meaningful goal for themselves. Student input into rubrics means that instead of guessing what the instructor wants, or hoping for an A, students will have developed the goal that they can work towards and can turn their attention to effective learning instead of guessing, fearing, or hoping that they are on the right track.
Licenses and Attributions
CC licensed content, Shared previously
This chapter, Key Factors for Assessment Design, by Dr. Seanna Takacs, Junsong Zhang, Helen Lee, Lynn Truong, and David Smulders is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License, It was adapted from A Comprehensive Guide to Applying Universal Design for Learning The adaptations made include updating grammar/spelling conventions, highlighting key information, replacing a broken link, and removing the section on Delivery Mode.