Learning Outcomes for the Masses (But Especially the Humanities) Workshop Notes

Introduction

My first few attempts at teaching university courses in Religious Studies did not take the learning outcomes [LOs] too seriously.[1] They were window dressings, a convention of the syllabus genre that had very little purpose. Today, LOs significantly shape the courses I create, indeed, they are a foundation. This is my conversion story and a template for crating your course LOs.


Thinking Backwards

Of course, those familiar with “backwards design” (from the Understanding by Design framework) know the entire process of designing a new class begins with drafting LOs. LOs are the skills, habits, and patterns of thinking that students will cultivate in your course. It is worth noting that LOs have minimal overlap with “content.” In other words, these define what the students will do with the content.

This is very different from the practices I absorbed as a graduate student. In fact, for folks like me who started designing courses by selecting readings first this approach may seem, well, “backwards.” The name “backwards design” reflects this.

It also represents the opposite direction from the perspective of the student in the course. If the student’s learning experience builds upwards from readings and lectures, the instructors pathway for course design should start with LOs and scaffold to meet those goals.

Backwards Design.png

Why Think Backwards? A Conversion Story

Thinking “backwards” allows us to focus on what matters, to not lose the forest for the trees. Our courses should – or at least can – enhance how students think, not merely augment the facts they know.

When we just focus on our lecture material or the content of readings, it is easy to forget these larger aspirations. We should not only be concerned with our students learning facts, but what they can do with those facts.[2] This may seem inescapable for some disciples, but bewildering for others. For example, no math instructor would simply expect students to memorize formula, they’d expect students to know how to apply those formula in increasingly more complex scenarios.

To use myself as the sacrificial counter example, what do I want students in my Religious Studies course to do? I used to think that once I figured out the readings, what the students did was obvious: write a paper! But a writing assignment should be viewed as an assessment of meeting the LOs, not an outcome in itself (refer to chart above).

Like many novice instructors, even when I had these grand aspirations the stress of putting together a new syllabus often pulled me back to the “basics” – the basics of deciding reading material and crafting lecture notes. As I was recently telling several new instructors, I did not appreciate the power of LOs because I was struggling day-to-day. I had long given up on the big picture. In my experience, even after the first time I designed a course starting from the LOs, I was unconvinced by their ultimate value.

After I built up some confidence teaching – specifically getting my “reps” in teaching freshman writing, an explicitly skill-based course – and learning I could survive day-to-day, I became dissatisfied with my assessments in my other Religious Studies courses. Uninspired quizzes, midterms, finals, and papers were the rigmarole. I soon started to think the problem was how I was conceiving of my courses’ role in the lives of my students. Did I just want them to memorize facts and become trivia masters?

By continually placing my focus on texts I consequently funneled my assessment onto low-level tasks of comprehension and memorization. Inspired to try and have my students train in higher-level orders of thinking, most specifically in analysis and evaluation, I first changed my daily reading assignments. Instead of having students summarize the main argument, I asked them about their opinions (gasp!). Specifically I asked them which passages struck them as interesting and why, which passages were confusing and why, which passages were they critical of and why. In other words, I started to think “backwards.” My students were now directly practicing – sometimes imperfectly[3] – the skills I wanted them to develop.

Class conversation immediately perked up. This was a small revelation. My thinking process then filtered up into the types of essay prompts I devised. Now, all of my assessments are derived from my LOs. My lectures are – and I only mean this in a relative sense – irrelevant (shun me if you must). Don’t get me wrong, I love planning a good lecture, but I now fully envision lectures in service of LOs.

In my retelling, the crux of my conversion story falls upon trying to re-conceive my assessment strategies. Now, when I think about readings, I also have to consider their capacity to help me reach the objectives I have set for my students. Sometimes, this forces me to “create” a lot more (like podcasts), but in return I also ask students to “create” a lot more – I consider this a win-win.


So…What Does a LO Look Like?

There are many many many introductions to crafting Learning Outcomes online, here are my crib notes:

Well-written Learning Outcomes will:

  1. Tell the student what they will do (not what the teacher will do).
  2. Use “thinking” action verbs that help measure the level of learning (see Bloom’s taxonomy for ideas)
  3. Refer to specific content (and/or clearly telescope to particular assessments, i.e. are measurable)
  4. Are concise and clear

Generally, a LO will often take the form: Actor/student + Bloom’s taxonomy verb + topic/content/related activity/assignment.

Also, it is advisable to erase the following verbs and phrases from LOs: learn, know, understand, appreciate, be aware of, and be familiar with.

I’ll admit, these are often the terms we instructors think with when we causally reflect on our classes. But these actions cannot be measured in an activity, assignment, or exam.


Notes

[1] I don’t want to get too far into the weeds, but there is a distinction between “learning outcomes” and “learning objectives.” In my run down, objectives refer to the content of the course or goals of an activity (think: list X, discuss Y, state Z), while outcomes reflect what the student will do to achieve that objective (think: analyze, evaluate, create). The latter, being more directly student-oriented, are often included in course syllabuses. In practice, however, these terms are often interchangeable. Specific differences in objective and outcomes are discussed here.

[2] There are clear disciplinary differences here. From my many consultations with instructors and teaching assistants from across disciplines, skills are more at the forefront of STEM (think: how can I apply this formula to this problem). Unfortunately, folks in the humanities (students and instructors) too-often think memorization of content is the apex of learning.

[3] This point is often overlooked. For the most part, students have been trained to summarize – this is the easiest thing to test on standardized tests. Thinking with the text is a new skill, please do not think students will all be masters at this skill immediately, it needs to be modeled, practiced, failed, and retried.


Pedagogy Workshops

Expectation, Assessment, and Alignment: Drafting Learning Outcomes

Introduction

This is where the rubber meets the road, when push comes to shove, and, er, where dreams come to die?! I apologize for my string of worn aphorisms, but so far, my series of posts have remained firmly in the realm of the conceptual. Now we must start turning practical. I’ve outlined some of the reasons why I prefer to focus on skills (or “critical thinking”) than on content (that will be refined soon), why it’s important to explicitly instill a sense of vitality in the humanities for undergraduates, and summarized several pedagogical approaches to teaching a religious studies course.

These general orientations will provide some of the direction for my learning objectives (see below) and will form the basis for my expectations for the course. A potential difficulty arises when we start considering what expectations students have when they walk in the first day. After reading about Gearon’s religious studies paradigms, I think it important to keep in mind that students may have different expectations; this forms one level of alignment. To refer back to Gearon’s paradigms, students may be operating from a theological, psychological, or even philosophical perspective while the instructor may assume a historical or sociological one –  it is the duty of the instructor to make it clear what is expected throughout the course.

In addition, as studies in instructional design have shown, the type of assessment will determine if the course objective are realized.[1] If the assessment tasks draw upon lower forms of cognitive activity than the course objectives (for example, assigning multiple choice tests when assessment or creation are the objectives), there will be a learning equilibrium achieved at a lower level. Proper instructional alignment needs to be conceived and deployed.[2]

I should add that alignment plays a role in several other contextual factors, including alignment with the university mission, alignment with broad departmental goals, and alignment with other courses. Ideally, a series of courses should build upon one another, deepening networks of meaning and skill cultivation.

I made a draft of my learning outcomes (LOs) below. They borrow the language and general structure of Bloom’s taxonomy, ranging from knowledge and comprehension to synthesis and evaluation. In addition, I consider classroom discussion and debate to be skills that need explicit cultivation (and thus proper teaching/learning activities or TLAs).

  • Identify and describe principle beliefs, practices, themes, or contested issues in Japanese religions, including Shinto and Buddhism (and their relationship), and other religious traditions
  • Identify and apply historical critical methods to explain the political, social, or cultural foundations for religious practices and beliefs in Japan
  • Analyze visual and material objects related to religions in Japan (based on the above skillsets)
  • Formulate a critical evaluation of the relative eminence and/or transcendence of Japanese religions
  • Communicate – and even debate – with your peers through in-class, out-of-class, and online discussion and through written assignments

I am pleased with this draft of LOs because I feel they clearly connect to potential assignments and projects (TLAs)[ideally, each outcome should only have one measurable verb, but my draft has more]. This was not accidental. I spent considerable time considering the projects I wanted my students to complete before crafting these outcomes; in other words I aligned them.

The skills of identifying and describing basic religious ideas will be developed through lecture materials, including audio-visual media where possible, and readings. I envision students identifying their own terms, figures, and concepts and constructing a bank of vocabulary for their use on low-stakes exams (a modicum of self-determination). Provisionally, I imagine students working in small “study groups” (a sublte homage to Ryuchi Abe’s analysis of Nara Buddhism) outside of class to identify central terms for that week’s readings (they can meet in person or coordiante through email or texting).[3] One group will be assigned to meet with me to discuss and analyze their choices and place them on a class-accessible website. I imagine both a temporal (Tiki Toki) and spatial (Google maps) component to this work.

Because I am primarily operating through a historical paradigm (although I hope to do class activities that are philosophically based), I will train my students in basic historical criticism so as to understand religion as a human phenomenon (and domain of the humanities). The first day of class will introduce this framework, and likely draw from the distinctions made by Bruce Lincoln.

One particular expression of this historical practice is to analyze and assess visual and material objects related to religion. One reason I incorporate this aspect is to take religion from the domain of belief and place it firmly within human cultural practices. This is also tied to the next outcome which will focus on the eminent, practical, and mundane aspects of religion. Provisionally, I am thinking of having students select items from e-Kokuho (e国宝) website which lists various National Treasures and Important Cultural Properties of National Museums and have them write a cultural biography or object narrative of an item, possibly as a foundational element for their final project.

I am also hoping to incorporate a term-long writing project where students explore the more mundane aspects of religion and have them assess the “worldly benefits” (genze riyaku) often associated with Japanese religions (and consider if all religions are primarily concerns with the eminent or transcendent).

Finally, I hope to design in-class activities (one, two, three?) where cross-talk occurs and philosophical stances are taken, elaborated, and debated.

I did not put it explicitly in the LOs, but I also plan to teach students how to effectively read in our class (reading for facts, reading to analyze method/argumentation, reading to connect ideas; as well as realizing the different genres of textbooks and scholarly works) and effectively take notes (double entry journal). I will return to this in a later post.


Notes:

*This is part of a series where I discuss my evolving thought process on designing a new university course in Religious Studies. In practice, this process will result in a syllabus on Japanese Religions. These posts will remain informal and mostly reflective.

[1] Many of the ideas discussed throughout were derived from Biggs 1996. A great discussion can also be found at the Scholarly Teacher blog, here.

[2] Biggs 1996: 350.

[3] Because I take a constructivist perspective, I hope to encourage multiple socially constructed ways of learning, including peer-controlled activities, in addition to teacher and individual controlled activities, See Biggs 1996: 354-5.

References:

  • Biggs, John. 1996. “Enhancing Teaching through Constructive Alignment.” Higher Education, Vol. 32, pp. 347-364.

More Pondering Pedagogy: Course Design Posts