Archive for the 'What is Education?' Category

Engagement vs. Grades

I am still surfing on the wave of energy I picked up from attending the Educause Learning Initiative 2010 Annual Meetings last week. As Gardner Campbell has said, faculty development is not a frill, but rather the oxygen academics need to breath. (Someone retold this quote in a session I attended though Gardner himself was elsewhere, and of course, I’d heard Gardner say it before.)  I still have much to process before I blog on the conference itself, but the energizing made me pick up something the other day that I need to just put out there.

At my institution’s State of the University address two weeks ago (another subject I need to blog about), we learned that the new watchword is productivity, as measured in particular by retention and graduation rates. I understand metrics, but I wonder if these two illuminate or obscure  problems.

As a macro economist, I am very sensitive to what we call “aggregation error.” When you look at the big picture, say by computing an average, you always lose information. Aggregation error asks: Does the average accurately characterize the group? Imagine a group consisting of half poor people and half rich people. The average suggests the group is middle income, which is completely misleading. That’s aggregation error.  If the government asked ‘Do we have a poverty problem?’ the answer based on the average income would be ‘no’.  And it would be wrong.

One key to student success in higher education appears to be engagement, and student engagement has become a big issue–look at the growing importance of the NSSE, etc.  I want to teach students who are engaged in the topic we’re studying. I would rather teach someone who cares about their learning, than one who gets good grades without caring. Perhaps I have a personal bias here. I never thought much about grades in college. I cared about learning and I worked hard and let the grades fall where they may. I was not an A student, but I learned more than many of my friends who were. (One example: I tutored friends who ended up with better grades than I, but didn’t necessarily understand more.)

Inside Higher Education recently reported on a fascinating study about the relation between grades and engagement.  It’s commonly understood that grades, engagement, and most importantly learning are positively correlated.  The study confirms that grades improve with a student’s engagement, but finds also that the result isn’t necessarily ‘high’ grades.  Engagement causes progress, better grades (and thus better “student outcomes”), but not necessarily ‘high’ grades.   Engagement is a good proxy for learning, but grades are only a weak proxy, a point I’ve stressed before.  The study points out that earning high grades doesn’t necessarily mean one is engaged.  As a consequence, using grades to measure engagement is a type of aggregation error.

While organizations necessarily look at aggregate data as metrics, we must not forget that students are individuals, and the institution needs to treat them (and provide support for them) as such.  One size doesn’t fit all.

The most important job of a university teacher is designing the learning environment

Writeable WallWhat does a teacher at the university level do?  This is a question I’ve pondered for some time, as I’ve been following changes in higher education, for example, the growth in the for-profit sector, and the growth in on-line learning.  There seems to be a growing trend for instructors to be assigned to teach courses they didn’t design; rather, the instructors are simply plugged into a course, given a syllabus and told which text to use.  They may not even create the exams.  This trend, which I find disturbing,  is part of the process of commodifying teaching.  The role of the instructor seems to be limited to presenting content, and often but not always, doing the grading.  While I can see some advantages to this trend (for example, cost efficiencies, tighter rein on what is taught which is important for prerequisite courses) I wonder what it does to learning.  My fear is that it reinforces the transactional notion of education as a collection of facts to be transferred to the student.  This transfer is then stamped with the certification of a grade, credits earned, a degree, etc.  But is it education?

When I was a new teacher, I saw my role as the provider of course content (through lectures), and the examiner to see how much content was assimilated by each student.  I was supposed to be the content expert, even when I taught courses for the first time, or on subjects I had never studied!  In graduate school when I was asked to teach a course whose subject I had no experience with, I was told:  “You’ve studied microeconomics.  This is just applied micro.”  And I did it.  In my first year as a full time faculty member, I was assigned to teach two courses on subjects I had never studied.  That’s just part of what happens at a small liberal arts college, but it’s not ideal.

I now have a broader conception of (good) teaching.   244384064_503e0a152a_mThe most important job of the teacher  is designing the learning environment for a course.  Learning occurs when students interact with and make meaning of the course materials, as they interact with the instructor and other students.  How, and to what extent, that interaction will occur is an integral part of the learning environment design process.  When a student interacts with the course materials, he or she is confronted with new ideas and new ways of thinking.   The instructor provides expert guidance about how to understand the new ideas and ways of thinking.  Other students can similarly catalyze the learning process for their peers by asking questions the student didn’t think of (or verbalizing questions they were reluctant to ask), and by presenting new insights or by providing a more accessible explanation than the instructor did.   A course lacking quality instructor interaction is merely self-study; there’s nothing wrong with that, but it’s not a university course and the learning process will be hampered.

Suppose you were plugged in to teach a course that you didn’t design.  Suppose you believe that students learn best by writing about the subject, that writing requires students to think more deeply about the subject than simply reading the text does.  Suppose that since writing is an integral part of your teaching, your practice is to give essay exams.  Now suppose that the course you are assigned to teach emphasizes content coverage over content mastery.  The administration wouldn’t articulate it that way, but that would be the reality for the average student.  They simply say that you as instructor need to cover the content.  And the content would be assessed by giving a common, departmentally designed multiple-choice exam.  Would the teaching be different from if you had designed the course?  Would the learning be different?  I suspect that students who are brighter, or who learn more quickly would earn better grades in the course you didn’t design.  But would the course be teaching students or merely sorting them?  I’m trying (really!) to keep my biases out of this parable, but I do believe that ownership of the course design matters, that it has an impact on learning. 

When an instructor designs a course, he or she is making decisions explicitly or implicitly about a number of dimensions which define the learning environment. Design palate These dimensions include:

  • To what extent will the instructor tell, coach or model for students?
  • How much of course ‘content’ will be pure content (i.e. facts or findings in the discipline) vs. knowledge creation or research?
  • Discovery: Are students expected to discover insights or will insights be provided to them by the instructor or text?
  • Meaning Making: Are students expected to make meaning or will they be told meaning?
  • Authenticity:  How much of the course work is mere school work vs. real?  (The difference is the extent to which people outside the course care about the results.)
  • Degree of Interaction: What degree of interaction is expected between students and faculty, between students and other students?
  • What is the source of the course materials: Professor vs. Text (secondary sources) vs. Readings/Literature (primary sources) vs. Student Creation? Also, who selects the course materials?  (e.g. Professor chooses the text (or Dept chooses the text) or students find their own information.)
  • How will class time be used?  Lecture from the text or instructor’s knowledge vs. Discussion vs. Demonstration/Laboratory/Learning by Doing vs. Student presentation of content (not for the sake of learning presentation skills but to instruct others.)
  • To what extent will out of class work be structured or unstructured?

Were any of these dimensions things you haven’t explicitly considered before?  What other dimensions can you suggest?

The answers to all of these questions about course design should be based on the course objectives (nominal and actual).  Course objectives might include:

  • Exposure to a subject/ability to be successful through the end of the course (i.e. to learn/remember enough to achieve a certain grade on a final exam, but without any real expectation of retaining or transferring to other contexts).   Few teachers would articulate their goals this way, but many teach and assess this way, especially in general education courses.
  • Introduction to particular skills such as writing, speaking, computing, music performance, artistic performance.
  • Practice in and ability to demonstrate disciplinary analysis (e.g. thinking like an economist, analyzing a problem like an economist would) 

After designing the learning environment, the next 67280931_1568a693ab_m most important job of the teacher is to be a learning guide, that is, to facilitate each student’s learning process as an individual journey.  This requires building (or at least being open to) a professional relationship with each student.  The final responsibility for this journey is with the student, but he or she needs to believe that that teacher is willing, even eager to guide them.  The teacher is, after all, on their own intellectual journey albeit further along than one’s students.  Am I suggesting that the teacher meet regularly, face-to-face with each student?  No.  Rather, the teacher needs to make students believe that he or she welcomes and values the opportunity to discuss course material with them.  Sometimes this interaction occurs face-to-face before or after class or during office hours.  Sometimes it may be a phone conversation, or an email exchange or an IM chat.  Most often, though, it occurs in class sessions when the teacher lectures or leads discussion, and when he or she responds to student questions.  The critical factors are showing one’s own interest in and enthusiasm for the subject, and showing respect for what students have to say, even when it may reveal misunderstanding.  Fundamentally, a good teacher is one who makes students believe that his or her goal is to help them get from where they are intellectually to as far as they can go over the course of the term.

How many students see university education this way?  I suspect that students see ‘school’ as an aggregate thing.  A degree is a series of courses.  A course is a series of lectures (say), which a student is supposed to tune into, and learn at least some of it.  The student sees themselves as part of a whole (the class), or buying into a whole (the ‘standard curriculum for the course’ or perhaps the teacher’s knowledge of the subject), rather than engaging in their own unique journey in which they create their own understanding of he material.  School is like a ski lift.  Hop on, ride a while, hop off.  Students connect for as much as they can or want to, and they learn accordingly.  Their success is defined by their relationship to the whole (did they ride  the ski far enough up the mountain?), not their progress in their own learning (making their own way by hiking up the mountain).

Do faculty perceive their responsibility as teaching students or teaching courses?  Are we taking steps to move closer to or further away from the idea of a personal educational journey when we commodify university courses?  As long as a course lasts a full term, I think it’s the latter.  If we could decompose courses as they currently exist into smaller modular pieces that could be combined in different ways, maybe then commodification of the modules would make sense.

Anyone planning to attend this year’s Education Learning Initiative annual meetings can hear more about these ideas at the session I’ll be presenting.  I hope to see you there!

More on the balance between liberal arts teaching and scholarship

Terry Dolson and I have been conversing about the balance between scholarship and liberal arts teaching.  This is a response to Terry’s last response, in which she says:

I believe that if faculty could see clearly that the WAY they teach may have even more impact on the majority of their  students than the CONTENT they teach, then they would feel compelled to explore new techniques.

What’s missing from both our earlier posts is the nuance that the roles a faculty member plays in scholarship and in teaching in the liberal arts are different, but equally important, equally legitimate. If one thinks that scholarship is one’s real work, but that teaching is like service, merely something that one is required to do, I think one misses the point of liberal arts teaching and is likely to fail at it.

It’s a question of audience and respect.  Successful scholarship requires “recognition in one’s field.”  Recognition  in this context is more than the accolade you receive from others.  It’s the response to the respect that you show in your work.  It’s the response to your making others think in ways they haven’t before, or in your taking them to intellectual places they haven’t been before.

Successful liberal arts teaching is the same.  You must show your audience respect for where they are in their intellectual journey, by treating what you do (as well as what they do) seriously.  The respect you receive is the response to making your students think in ways they haven’t before or in your taking them to intellectual places they haven’t been before.  But it’s also doing it explicitly in the context of liberal arts.  This is where many introductory courses fail.  They are designed only as introductions to the major, as gatekeeping courses for the select few who will be inducted into the priesthood of believers (i.e. the major).  It may be that only some students can be majors in a field, but all students should be able to understand the context and contributions of a discipline in the liberal arts.  Or to phrase it differently, anyone can teach students who have an affinity for the field, but it takes a serious teacher to be effective at teaching those students who do not, at making those students see the relevance and import of fields outside the major.   It takes a serious teacher to help all students see that courses outside their major are just as important and worthy of respect as courses in the major.  That is the liberal arts ideal.

What should higher education be?

First, we will set up a single goal to represent educational success, which will take four years to achieve no matter what is being taught. We will attach an economic reward to it that seldom has anything to do with what has been learned. We will urge large numbers of people who do not possess adequate ability to try to achieve the goal, wait until they have spent a lot of time and money, and then deny it to them. We will stigmatize everyone who doesn’t meet the goal. We will call the goal a “BA.”

So begins a thought-provoking op-ed piece in today’s Wall Street Journal. Is this an argument for or against liberal education?

Insights on Fanny & Freddie

This post interests me on several levels: the connected nature of media today; contemporary economic issues, specifically the difficulties being faced by Fanny Mae & Freddie Mac due to the mortgage market meltdown; and the issue of the market system & the social good.

I subscribe via rss to a number of news feeds, including the editorials of the Wall Street Journal. Due to the magic of my feed reader, each morning, with very little effort I can get up to date on the news of the last 24 hours from a variety of perspectives. This is very useful for a teacher of the social sciences. This morning I discovered an article in the Notable & Quotable column of the Journal, which gives a brief snippet of something clever. The article today turned out to be a blog post by Lawrence Summers, former U.S. Secretary of the Treasury, and former President of Harvard University. The post was one of the clearest and most thoughtful interpretations I have seen of the current problems of Fanny Mae and Freddy Mac, the government sponsored mortgage market players. After reading the post, I followed it back to the source, and discovered another nugget: a new blog called Creative Capitalism: A Conversation, which describes itself as:

a web experiment designed to produce a book — a collection of essays and commentary on capitalism, philanthropy and global development — to be edited by us and published by Simon and Schuster in the fall of 2008. The book takes as its starting point a speech Bill Gates delivered this January at the World Economic Forum in Davos. In it, he said that many of the world’s problems are too big for philanthropy–even on the scale of the Gates Foundation. And he said that the free-market capitalist system itself would have to solve them.

This is the public blog of a private website where a group of invited economists have spent the past couple of weeks criticizing and debating those claims.

How cool is this? One might even call this a form of scholarly activity. ;-)

The premise of Gates’ speech was that the power of the market system can and should be applied to solving the substantive problems associated with economic development, from educating women to erradicating disease to developing effective financial systems. Can the market system, which is predicated on personal gain, be effectively used for the social good? Check out this blog to find out.

What is a student’s job?

Shannon has another stunning post that I really want to see students respond to. But I don’t just want the usual suspects. That’s why I’m going to send a challenge to my first year advising group and see if they’ll rise to the challenge.

Is College Supposed to Be Education or Training?

This is a question I’ve blogged about before, here, here and here for example. I know we say college is supposed to be education (or Real School), but more often than one might like if you look at what actually happens in the classroom, it looks a lot like training to me.

Lanny Arvan touched on this critical question in his post I alluded to the other day. He observed that extrinsic motivation essentially forces students to do some minimum level of work, kind of ‘working to the teacher’—the flip side of ‘teaching to the test’ [my words, not his]. But extrinsic motivation provides little incentive to do more. After all, if there’s no credit given, what’s the point?

One problem with online quizzing is that it tends to assess lower level learning: facts and findings, rather than analytical or reflective thinking. I’m half-considering telling my intro students: “If you want a C+ in the course, do all the online quizzes, but if you want a B or better answer my study questions.”

Lanny notes:

[W]e really should be about the education of our students; training is not our primary goal. When I was about 10 and in fifth or sixth grade, two or three other students and I got to work apart from the rest of the class with a programmed book for learning grammar – first presentation of the rule, then a question on that, and then response – ring, rang rung; …………bring, brought, brought. A course based purely on quizzing conveys this notion of learning, a notion associated with training, … Education, in contrast, has as part a notion of self-directed inquiry reshaping the learner’s world view. Where is the self-direction in the quizzing?

Alan Contraras, in his recent Inside Higher Education article also addresses this question, though he comes at it from a different direction, criticizing the increasingly in vogue notion that students should complete their undergraduate studies as quickly as possible.

The second argument [others use to support this notion] is more insidious and represents a fundamentally false notion of what higher education is, or should be. That is the idea that students need to be speedy in getting into and out of college because college is job training and people should get into the workforce and start being productive. Therefore college is not a place for dalliance, casual exploration, personal discovery or, heaven forbid, changing one’s mind partway through and starting off in another direction.

Contraras further observes:

In “Our Universities,” John Jay Chapman wrote of the perils of making higher education overmechanical in its processes. He noted that colleges risk a “punching of tickets at entrances and exits” in a system “invented by persons who should have been employed in drawing up railroad timetables.” This sense that there is a timetable for learning is one of the unfortunate aspects of the way colleges fit into contemporary society.

Chapman, one of the best observers of education and the workings of politics that the U.S. has ever produced, noted that the channeling of educational energies toward the needs of business had resulted in an infection of the curriculum as well as the timetable.

What can we do to make the case for college as education rather than merely job preparation, to prospective students and also to policy makers and the public at large?

Is Technological Proficiency a Skill, or Something Bigger?

This summer I’ve been involved in our school’s efforts to revise our general education requirements. In the course of our discussions we raised the question of what constitutes technological proficiency appropriate to a liberal education in the early 21st century. The discussion seemed to focus on the idea of a list of skills (more on this later).

But the question that occurs to me is this: Is technological proficiency merely a set of skills or something bigger, a mode of creativity or a medium of thought or analysis? If you think this is a stretch, replace the term ‘technological proficiency’ with the term ‘writing’. We now think of writing as not merely a tool for presenting one’s thinking, but also and perhaps even more importantly as a tool for generating that thinking. Writing is not just product, but process as well.

Some years ago UMW developed a standard for technological proficiency based on a list of a half dozen specific skills: basic facility with email, word processing software, a spreadsheet, etc. This standard became problematic because the specific items on the list seemed to become quickly obsolete in the sense that increasingly all or virtually all incoming students had these skills already. These skills seem problematic to me for another reason. The items were chosen in part, I suspect, because they were easily measurable, like touch-typing as a skill or writing in complete, grammatically correct sentences. This is a very low, almost trivial standard, which then serves to marginalize technological proficiency as a serious goal of higher education.

The Gen Ed Task Group this summer ended up recommending a two-tiered approach: creating a Technology Proficiency center to help students who lack the basic skills described above, and then mandating that departments teach whatever specialized tools are relevant in their disciplines. By going beyond the basics this approach is a step in the right direction, but I think it begs the question rather than answering it.

Instead I wonder if, as I suggested above, technological proficiency should be viewed as a tool of analysis or thought as well as a means of expression, just like writing. How do we insure students become proficient in writing, from the perspective of our general education curriculum? By requiring them to take four courses, each of which includes some formal writing instruction as well as X pages of written work. But writing proficiency is, of course, bigger than that. We certainly teach that larger dimension in some courses, but we don’t ‘count it’ as part of general education because it’s difficult to define, much less measure.

There are other analogs besides writing, such as language proficiency, quantitative literacy and critical thinking. True literacy in a foreign language means more than the ability to read and write a foreign language. It means the ability to think and create in it as well. Similarly, quantitative literacy means the ability to work with quantitative or abstract tools to solve problems, not merely given math problems, but unstructured real world problems. We also claim to teach critical thinking but we don’t have a curriculum requirement in it per se.

If I am correct in this argument, then technology proficiency is a true across-the-curriculum competency like writing, speaking and quantitative reasoning. Why should we treat it as a step-child?

Can you become a competent athlete by only hearing someone tell you about the sport?

Learning only occurs at the intersection between a text and a reader, or between a lecture and an audience. In a comment on an earlier post, Shannon notes,

[T]ext is sometimes seen as a time waster if it requires a close study, “why didn’t the author just make it simpler to understand?”. Students want key concepts pulled out for them so they can pass the test, why should they bother pulling it when a prof can do it much more easily?

This is something about students’ perceptions that I didn’t fully understand, so I’m really thankful that Shannon brought it to our attention.

Students need to understand that learning isn’t something that happens to you. It’s something you have to engage with to occur. Can you become a competent athlete by merely hearing about how to do the sport, or is it necessary to practice? Can you excel at a sport without practicing it?

Learning happens only as a function of the engagement between the student and the stimulus. The stimulus could be a text, a lecture, a video, a piece of art or music or other visual image. If there’s no engagement, there will be no learning. Think: the student who sleeps thru the lecture. If there’s little engagement, there will be little learning. Think: the lecture which fails to capture the student’s attention, as in the video snippet which Gardner showed at the FSEM Faculty Development workshop last week. Just as you have to chew a scholarly text or process your lecture notes, to really learn something you have to study it closely.

If students aren’t getting this message, and it seems that they’re not, what can instructors do to change this? Could it be as simple as stating it clearly in class, for example, in a first year seminar? Would students believe it? Can anyone suggest other ideas?

From Student-Teacher to Apprentice-Master?

A couple of students, Joe and Shannon, attended this year’s Faculty Academy, and generally hung out with the DTLT ‘Team’ and our outside speakers.

Yesterday I heard that Joe was taking a course this summer with Angela, one of the faculty members of the team. It reminded me of something I’ve noticed over time. For about ten years, I have taken a group of students to present their research at a regional economics conference. That experience seems to change the dynamics of the subsequent student-teacher relationship.

The change begins when students commit to attending the conference. To be eligible, they submit a research paper. However ‘complete’ their research papers, we always revise them during the Spring semester prior to the conference. This work is done neither for grade nor credit, simply because it’s what is necessary to make the paper conference-ready. It seems to me that during this process, I become more a mentor than a (traditional) teacher. The relationship seems more collegial than hierarchical.

The conference is a tremendous experience in which we get to know each other far deeper than is typical with students and teachers. Part of this is spending several intense days together. But I think an important part is when students see the teacher acting as a professional in his or her field, and when the students are accepted as similar albeit journeyman professionals.

What is particularly interesting is to see the extent to which the changed relationship persists when we return from the conference Some of the students are in my courses–or they take one next semester. In those classes, the students seem less concerned by grades and more interested in learning. They seem to relate to me as a helpful expert, less as the person responsible for their grade.

Has anyone else had this experience with students? If so, how might we build this into our courses more generally?




Spam prevention powered by Akismet