2012 ELI Post Mortem – Where do we go from here?

There is a lot in this post, but rather than waiting until I have the time to think it through, I’m going to put it up.  I’m sure that’s better than never posting it at all.

Despite the many participants in higher education who do not see that change is necessary, I believe that the forces above us (tuition & budgetary) and the forces below us (alternative models of higher education) will put traditional universities in a vise, and what survives will be radically different from the status quo.  I don’t see any way we will be allowed to continue our enterprise as we have for so many years.    What are the changes facing us?  I obviously can’t be sure, but I think they will be a combination of how we design the learning environments in which we teach, and how (and to a lesser extent, what) we expect our students to learn.

Adrian Sannier identifies several signs that higher education may be approaching a tipping point:

  • Disruptive Innovation of the type described by Christensen & Eyring, and by Rosen – This comes in two varieties:  For-profit universities and Online learning (whether offered by for-profit or more traditional universities).  It should be clear that the only way we are going to educate the increasing numbers of students demanding higher education this century is with some combination of the two.  Both are making great strides at improving the quality of the education they provide and traditional universities ignore them at their peril.  There are even some important things that For-profit schools are doing better than traditional institutions.  If you don’t know what those things are, you need to pay better attention.
  • e-Readers, whether kindles, nooks, iPads or other tablets – According to Sannier, Apple sold more iPads in 2011 than all PCs sold across the industry.  iPads are increasingly the tools of choice for faculty and students.  They offer the prospect of substantially cheaper texts and other resources.  The texts can be interactive, searchable, and always up to date.  Perhaps most importantly, publishers are signing on to provide content of this type.  One speaker at the conference announced a plan to offer high school textbooks for under $20 each.
  • Free Open Courseware and Open Courses – What’s better than an inexpensive text?  The answer is a free one. Most of you are familiar with open courseware:  Course syllabi, content, and assignments offered online from MIT, Carnegie-Mellon, and other universities for anyone who wishes.  What may be better than taking a course at Stanford University?  The answer is a free course offered by faculty at Stanford.  That is a reality today.  And coming soon are free “certificate courses” to be offered by MIT and other prestigious universities   What does your school have to compete either on price or quality with these?  Still think that your institution is sitting on a strong foundation?  (If so, consider the image above.)

Much of what follows is speculative, but I think it offers some possibilities for the future.  First, as Milliron stated, learning needs to be in the center of everything we do as teachers!  (I think it’s safe to say that at present teaching is at the center of what we do as teachers.  But to quote a wise former colleague, “It’s not what we do (in our courses) that matters—it’s what our students get from it.”

We need to get away from the notion that individual faculty “own” courses.  Faculty should think of themselves as stewards of the courses they teach for their department.  This is especially true of required courses in their programs, where what students learn is a prerequisite to downstream courses.  Faculty have a responsibility to teach not just what they want, but what is expected by the program they serve.  When we think of our courses as “ours,” that doesn’t always occur.  This is one thing the For-profit schools do better than traditional schools in higher education.

Faculty need to transform from being practitioners of the art of education to being practitioners of the science of education.  As part of that, teaching needs to be recast from an individual to a team-sport.  When I began my career, almost no PhDs I knew received any significant training in teaching or course design.  From what I’ve heard since then, not that much has changed.  In the last few decades, there has been significant research on learning and cognition, which is known to instructional designers but only rarely to faculty members.  It seems clear that we could improve the quality of the courses we offer by bringing readily available expertise into the planning process.   We need to reimagine course design as a collaboration between content experts (the faculty), instructional designers, instructional technologists, librarians, etc.  While the faculty member should still be in charge, he or she can never have the expertise of the others in the collaboration, and doing without that expertise means a weaker course, no matter how excellent the teacher.  This would require a radical change in the way course design occurs.  How many faculty at traditional schools obtain significant help from other specialists when they design or revise their courses.  At present, the answer is very few.  This team approach needs to become the norm.

Chuck Dzuiban argued in his session at the ELI that faculty will respond if they can be convinced that these changes will lead to greater student learning.  He suggested further that the best approach is to enlist faculty to convince other faculty.  I’d like to believe that Chuck is right, but I think we need more than that.  Faculty need to be convinced that business as usual will no longer be adequate, that our livelihood depends on our taking a serious look at how we are teaching and what our students are learning.  I do not believe we are there yet.  There are too many incentives within our disciplines and within academia that work against it.

We also need to radically rethink the learning environments we create for our students.  What should students be learningWhat are the critical literacies for 21st Century learners?  I can see several new types of critical literacies.  None of them are completely new; all draw from existing notions of literacy.  Learning to learn will be even more important in the 21st Century than it was in the last.  What will be critical is not knowing the answer, but knowing how to find the answer, knowing who to ask in one’s Personal Learning Network; in short, knowing how to research an answer using “distributed cognition.”

Increasingly, making meaning out of complexity is a necessary skill (or perhaps literacy is a better term).  More often than not, complexity requires interdisciplinary thinking.  But interdisciplinary thinking is countercultural in the existing siloed world of disciplinary departments.

How should our students be learning?  One clue was provided at the ELI:  We need a new set of pedagogies centered on experiences instead of predigested content.  The experiences teach students the skills they need to learn in the context of the content, but the objective is not learning facts.  There may have been a time when educated individuals knew all there was to know, but that time is long past.  (e.g. Look how large the typical introductory text book is.)  This experience-based approach to learning is different than the distinction between skills and content.  I have blogged on this topic before.  What is the most important thing students learn from study abroad?  I suspect it’s not academic skills or content.  What is the most important thing students learn from a senior research project?  I think it goes beyond standard research skills and knowledge of the subject.  Either way, I suspect that liberal education is particularly well suited to an experienced-based approach to learning.

Many students find online or digital games tremendously engaging.   They rarely find school work the same way.   Increasingly, researchers are exploring ways games can be used for teaching and learning.  There is great potential in virtual learning environments, like the ones being studied by Chris Dede, in which students control their exploration of an augmented reality or a virtual world.  This may be the most promising way for understanding “complex causality” – problems than can’t be solved analytically, that require simulation to figure out.

Whatever you think of these speculative ideas, the fundamental questions remain those I posed previously:

How will student learning be different in a world of digital resources and digital communications?” and “How can teaching be different in that world?

 

Photo Credit: http://www.flickr.com/photos/joedsilva/4698703312/sizes/m/in/photostream/

Posted in Teaching and Learning | 1 Comment

Learning Analytics at the 2012 ELI Meetings

One of the themes of this year’s ELI conference was Learning Analytics, a movement which comes at least in part from the practices of For-profit universities.  A good introduction to the topic is ELI’s 7 Things You Should Know about First Generation Learning Analytics.

Learning Analytics starts with the premise that student engagement in a course is highly correlated with student learning.  Learning analytics seeks to apply powerful software to large datasets using background characteristics that students bring to higher education as well as data from students’ participation in course work (as measured by the institution’s learning management system) and measures of the students’ academic outcomes.  The idea is to predict when students are on a path likely to lead to failure and to communicate that information to the individual students, faculty advisers, etc.  A good example of Learning Analytics is the Signals Project at Purdue University, led by John Campbell.  Signals periodically sends students a “traffic light” indicating that they are doing well academically (a green light), that they might need to reconsider their study practices (a yellow light), or that they need to make a change to avoid failure (a red light).  This is data mining to the nth degree, and to some, it raises the specter of “big brother.” Learning Analytics may be gross (in more ways than one), but we shouldn’t forget that at this point, it is only in its infancy.

For me, the most interesting part of the Learning Analytics panel was Randy Bass from Georgetown, who noted:  “The current enthusiasm for Learning Analytics is a presenting symptom of higher education’s failure to respond to research on teaching and learning over the last 40 years.”

Bass pointed out that the Scholarship of Teaching & Learning might be viewed as the “Slow Analytics Movement,” in contrast to the current Learning Analytics.  He then posed an important question:  In recent years, we have discovered the educational value of the so-called “High Impact (Learning) Practices.”  Why then are the results of High Impact Practices (as well as the NSSE) invisible to Learning Analytics?  How can we measure experiential learning or the effects of seminars and other practices which do not have economies of scale?  Important questions!

This conversation made me wonder if a system like Purdue’s could actually make students less reflective and metacognitive about their learning analogous to how I’ve found software like Pearson’s MyEconLab or Cengage’s Aplia makes students “stupid” when they don’t bother to do reading or homework until the software tells them to.  I hope not, but I wonder.  Additionally, the system only works if faculty fully use the LMS.  In other words, if readings and assignments are not on the LMS, student activities in those areas won’t be captured and the system will give false readings.  I also wonder when students will start to try to “game the system” to get credit for clicks when they’re not actually doing the work.  Lots to think about.

Photocredits:

  • http://farm1.staticflickr.com/69/229822320_403849c7b4_d.jpg
  • http://farm5.staticflickr.com/4019/4272283260_7a6d3958e6_d.jpg
Posted in Teaching and Learning | 1 Comment

On the 2012 Educause Learning Initative Annual Conference

In February (yes, I realize it’s now June), I attended the 2012 ELI Annual Conference.  It was a great event—very thought provoking in a number of ways.  The underlying theme of the conference was the changes facing higher education with a particular emphasis on Learning Analytics.

I was favorably impressed by a number of speakers I had not anticipated liking, primarily because of their affiliations.  (See my note below!) That shows my prejudice, and I’m glad it didn’t prevent me from attending those sessions.  My particular favorites at the conference were:

I highly recommend these presentations, which you can view on the accompanying links.   [ Note:  Both Adrian Sannier and my friend Jim Groom were named among the 12 Tech Innovators in a recent Chronicle article.  If you are suspicious of Sannier based on the Chronicle article, consider how the same article portrayed Jim.]

The vast majority of my colleagues in higher education see no reason to change the way we operate, or more precisely the way we teach our students.  Most of us generally care about our teaching.  But the fact is, very few of us know how well our students are learning.  I certainly don’t.  I know what feels good to me, but that’s not the same as what students learn.  I know what I’m comfortable with.  I’ve been lauded as a good teacher throughout my career, but I don’t really know.  Very soon, this sort of “evidence” is not going to be acceptable.

Adrian Sannier, in the opening keynote, observed,

These are “the days of miracle and wonder” … except at school.

Think about how our lives have changed in the last few decades, and how our work environment has changed.  It’s hard to imagine what it was like before computer networks, cell phones, etc.  But the way faculty teach their classes is largely the same as it was 10, 50, or even 100 years ago.

Sannier continued,

Education is more like a church than commerce.  It’s more like an abbey than it is like a factory.  I get that.  You get that.  But increasingly the people we work for don’t get that.

Anyone who has paid attention to higher education has seen that public higher ed faces declining confidence that what we offer justifies the cost to taxpayers.  The result is declining support from the state.   Additionally, except at the very top schools, there is a latent revolt on the part of parents who are questioning perennial tuition increases whether at public or private universities.

Our system of education is training people for jobs that largely no longer exist, when it should be training people for jobs that haven’t yet been invented.  The way many faculty teach is, quite simply, archaic and better ways exist if faculty could be persuaded to adopt them.  But there are significant institutional incentives against that.

Here are a few sobering facts.  Who are our students?  They are not who they used to be.  In past generations, we could teach poorly and count on bright students to figure it out for themselves.  Or more charitably, we could teach to the best students only, because all our students were the best.  We can’t do that anymore.

The students in our classes today are different from those of past generations.  The diversity of our current students is nothing short of breathtaking.  My point is not to complain about our current students, a popular pastime among faculty, but rather to raise attention.  In his session at the ELI, Mark Milliron pointed out:

  • The majority of our students are not recent high school graduates aged 18 – 22, that is “traditional” college students;
  • The majority are older, often working full time and with a family;
  • More than 80% of undergraduates are employed at least part time while going to school; the ideal of students seeing college as their full time vocation is no longer the norm.
  • 40% of first year students are underprepared for college;
  • 70% of first years at open-access institutions are unprepared.
  • Only half of students who start college (and this includes community college) earn a degree.

In short, we need to teach the students we actually have, instead of the ones we’d prefer (or the ones we think we used to have).  (A number of speakers at the ELI made this point.)  Faculty who do not accept this will remain disappointed.

To be continued…

Posted in Teaching and Learning | 2 Comments

We need to blow up the strong boxes of teaching, scholarship and service

I woke up last night and couldn’t go back to sleep because my mind was on fire. I was in that state because of four days spent at an extraordinary conference, though few would have expected that. It wasn’t so much the conference as the people who were there. It is a rewarding experience to be surrounded with very bright people, all of whom want the enterprise to be successful. And so it will be.

Like the Titanic, higher education is sinking, though to most of the stakeholders, it is business as usual.  But make no mistake: The Titanic was doomed once it hit the iceberg.  The iceberg of higher education is the digital revolution.  Like the Titanic, higher education is such a large vessel that it may take a while to sink, but nonetheless, it is mortally wounded.

 

In ten or twenty years, students will not be coming to our schools because we offer CHEM 101 or ECON 201.  Those will be commodity courses, obtainable any number of ways.  They will come to our schools only because we offer a vibrant, compelling intellectual community where they can explore questions that matter.  If we don’t, they won’t come.

– paraphrase from Carol Long

The key question for schools isn’t “Should we be offering MOOCs?” or “To what extent should our courses be online?”  These questions are too small and they are fundamentally the wrong questions which serve to marginalize people in academia who do these things.  The fundamental questions are: “How will student learning be different in a world of digital resources and digital communications?” and “How can teaching be different in that world?”  The question isn’t should we be teaching online or face-to-face, but rather how should we change what we’re doing whatever the venue or medium (I dislike the term mode-of-delivery) to utilize what we now know about digital knowledge?

– inspired by Gardner Campbell.

There are a chorus of voices telling institutions of higher that they need to think about being more efficient, and I agree.  But efficiency doesn’t have to mean lower cost.  It means better value, which can be reached by providing a better service, a more valuable experience, as well as by doing it more cheaply.  As Alfred Marshall, one of the economic greats, said, “Which blade of the scissors cuts the paper?”  I suspect that by thinking of these questions, we may be able to lower costs, but we will certainly be able to provide better, more valuable education.

Increasingly, faculty are spending their time on things which don’t fit nicely into the categories of teaching, scholarship and service.  Which category should hold supervision of undergraduate research, for example?  A great deal of effort has been spend on figuring out how to shoehorn these types of activities into the “correct” box.  If there is no clear box, these things are “appreciated, but not valued.” (The phrase is due to Phil Hall.)

The problem is that faculty, like most people, respond to incentives.  As a consequence, if things are not valued, they tend not to get done.  There is something in the nature of a positive externality here where the benefit to society exceeds the benefit to the individual who needs to do them.  And yet, increasingly we believe they should be valued.

The solution is to blow up the boxes.  These boxes are the flip side of the credit/course system for student learning.  Both of these are analogous to the tenure system.  Tenure is sometime described by insiders as “velvet handcuffs,” because once you have tenure, it’s difficult to leave.  How can we add supervision of undergraduate research to our professional responsibilities, when we have no time to add anything?  How can we give credit for undergraduate research, when students already have courses to take?  Sure, we could eliminate some course requirements, but only the courses that don’t matter, and none of my courses.  So if we’re going to support undergraduate research, we need to shoehorn it into the curriculum and into our professional workload.

Unless we blow up the boxes.  Suppose we were to start from a strong and clear understanding of what we wanted our students to accomplish, to know and be able to do in our program.  Then suppose we thought of the best ways to accomplish those goals.  In my discipline, the ultimate goal would be to be able to analyze issues and problems like an economist.  The most complete way to demonstrate that is to complete an original research project.  Suppose that was our capstone experience.  Can that be done within the context of a course (or courses) and credits?  Perhaps it could, but is that the best way, or is it simply shoehorning another thing into the strongbox.  What would students need to learn first to be able to complete an original research project?  What would be the best ways to organize teaching and learning of those experiences?  What other activities should add to the undergraduate economics experience?  If we built our program around these questions, we would have a far better way of teaching what we have to offer.  And who knows, it may well be more efficient too.  Perhaps it would only take 3 years to complete.  Or perhaps students would get more out of it.   It would be more difficult to administer, to be sure.  How would we know when a student was done, if we didn’t have credits to add up?

Imagine if a faculty member’s full time work load were negotiated between the needs of the department and his or her interests and abilities.  Perhaps a faculty member’s full time load might be to spend half time supervising undergraduate research projects and half time advising first year students and majors.  (If you think one couldn’t put enough time and effort into those types of activities to amount to full time work, perhaps you’re marginalizing the import of those activities because you’ve never put full effort into them.)  Another faculty member might spend all of their time teaching courses.  Another might spend ¾ of their time completing a significant research project of their own, while teaching ¼ time.  These things are all possible, though not without plenty of cultural hurdles.  But first, we would need to blow up the strong boxes. 

Who has the dynamite?

Posted in Teaching and Learning | 3 Comments

Interaction in a Content-Based Online Course

The more I work on my first online course, the more I feel that one could spend an infinite amount of time on this and still find new things I’d like to add or expand upon.  If you’ve never taught online and you want to know how this feels, think about the first course you ever had to develop to teach.  It’s like that for me.  But, I digress.

The question I’ve been struggling with is how to create an online learning environment that helps my students to:

  • Interact with the course materials/readings,
  • Interact with each other, and
  • Interact with me.

How can I guide the learning process (e.g. these interactions) so that students “get” what they need to from the course materials?  This is roughly analogous to what I do in class sessions.

At the same time I see a complication:  The course has a great deal of content students need to learn.  So I’m not sure DS106 is a good model for that.  I may be wrong (and I’m sure someone will correct me) but it seems like the “content” in DS106 is broad categories, where students have a lot of freedom about what they learn and how they learn it, as opposed to the specific concepts, theories, etc. that characterize a content-based course.

I don’t want to play my “I’m not teaching a humanities course” card.  I love teaching seminars about big questions and letting the class go where it will.  But this isn’t a class like that.  It’s an intro course, a general education course for the social sciences, but also an introduction to the major and required for several other majors.  I love giving my students freedom to learn, but at the end of the day if they don’t learn the content, the course will be a failure.

Here is my current thinking to which I invite your comments.  The course is divided into ten topics.  Each topic includes:

  • A list of questions to be explored [the answers to which satisfy the learning objectives],
  • A list of readings/resources to provide content/expert views on the questions

1. First, I would like the students to engage with the content (i.e. read the readings, watch the video clips, listen to the audio recordings).  As they do so, I’d like them to think about the study questions.  Then they should tweet any questions they have about the content.

2. Next, I would like students to analyze the content using the schema I developed some years ago for my face-to-face teaching.  When I say analyze, I mean answer the three extended questions at the end of the schema and then send me their work.

3. Both of the above items can be done individually, but I’m looking for ways to get the students to interact and to learn from each other.  What I propose to do is ask each student to post [to the as yet undefined collaborative space] one concept, theory or fact/finding from the schema, as well as their commentary per the schema.  The class size is capped at 20, but it’s likely the laggards will find that the early birds identified (& posted) all the items.  In that case, the laggards may add an additional reason or example or present a reason against one of the previously identified items.

4. The last step would be to ask small groups to clean up each submitted item, resolve any issues, and present the results (e.g. on a new page).

In a sense, the purpose of this activity is to develop collaborative class notes.  I see this as a worthwhile activity, because if the students can do this (both individually and as a group), they will have mastered the learning objectives for the course.

Would this work?  What are the pros and cons?  How would I get everyone to contribute productively and not encourage free riding?  Your thoughts would be much appreciated.

Posted in The Experiment | Tagged | 6 Comments

How can an online course be superior to a traditional face-to-face course?

I’ve gotten into the habit of posting nearly completely thought out ideas, with the result  that I’ve largely stopped blogging, or more precisely, I have a stack of half written posts in draft none of which I’ve managed to publish.  Alan pointed this out to me some weeks ago, and reminded me that I should just do it.  Shannon’s recent postings also gave me a push.  But it was Jim’s post the other day that made me act.  So what I have to say here is provisional and I am definitely looking for feedback.

One of the goals of the UMW Online Learning Initiative is to identify models of online learning that provide a superior learning experience to that which can be done in a traditional face-to-face classroom.  Lest you think that’s crazy, we have identified two such models to date (out of the seven online courses developed in the initiative last year.  The first model is the DS106-version of a Massive Open Online Course (or MOOC), which many of you are familiar with.  The second model is Donald Rallis’ Regional Geography course, which deserves its own blog post.  One of my tasks now is to figure out how to generalize those models beyond the specific courses.  That is, what are the essential features of those models and how can we use them to enhance the learning experiences in other courses?  After all, not all of us are Jim Groom or Donald Rallis!

This summer, as part of the Online Learning Initiative, I’m developing a course that I will teach fully online this Fall.  Principles of Macroeconomics is a standard course in the economics curriculum and one I’ve taught for more than three decades.  Modifying it to teach online has been a fascinating experience, one of the most interesting aspects of which is that it has made me rethink fundamental aspects of my face-to-face teaching.   [Could this be a hidden agenda of the OLI?  But I digress.]  A large part of the work has been thinking about how to do what I typically do in class but in an online environment (e.g. What does the online teacher do with what used to be one’s lectures?  Hint of an Answer: Only a part of my class sessions are spent distributing content.)  But, I’ve also pondered the question of what could be done online to improve the learning experience over a traditional face-to-face course.  The answer I’ve come up with is to use the power of the internet, the ability to connect to resources and voices outside of our institution and bring those resources and voices into my course.   I take no credit for this, since it derives from the community of educational thinkers and practitioners that I’ve managed to surround myself with.

Option #1 The Open Online Course Resource (a MOOC-like device)

I’ve decided to join the MOOC-bandwagon, but not exactly.  The term “MOOC” has grown a little ambiguous with at least two models now, what I call the “Corporate Model” (e.g. Udacity, Coursera, MITx) & the “Original Model” (e.g. CCK11, DS106).  What I’m planning is closer to DS106, but it’s not a whole course; rather, it’s going to be one piece of my course, one piece of content and interaction, somewhat like a class discussion is.

What I’m imagining is a standalone web space where participants (students, faculty, interested others) can explore specific questions about macroeconomics.  By “standalone,” I mean independent of anyone’s course.  Instructors can use this space however they like for their courses, so we want it to be flexible—Just a forum for exploring, discussing and developing tentative answers to interesting current questions in macroeconomics.

The basic model could be “modules,” each organized around a single main question.  The model might be described as:

  • Pose a question/problem,
  • Solicit initial responses,
  • Submit evidence,
  • Develop conclusions,
  • Move on to next the question/problem.

I’d like to solicit some seed questions (each defining a module) from faculty participants in advance, the exploration of which will help students in their courses, but the discussion on the web space would be open to anyone interested.

I could see a number of questions being explored simultaneously, but if too much is happening at the same time, we spread the participants too thin to benefit from the group.

We would need to develop some basic ground rules, not to limit discussion but to keep it focused on the module questions.  We probably also need the behavioral expectations spelled out.

What’s the Point?

I think this could be a useful experience by bringing more voices into a course than just that of the instructor.  I am recruiting colleagues from Canada and the UK as well as different regions of the US to participate in this experiment.  Since many of the issues I can imagine discussing have subjective /political components, I think it would be a plus to have our students experience diverse views, both among experts and students.  In a recent post, Cathy Derecki described this more generally as “the notion of connecting people and ideas as the goal, with technology as a way to do that.”  Justin Reich (as EdTech Researcher) explains:

These courses are designed to bring people together for learning experiences, rather than to deliver a discrete set of learning objectives to be mastered. Stephen Downes goes so far to say that the “content is a MacGuffin”, the thing that brings people together so that the real learning can happen through dialogue, interaction, and exploration.

An Example:

One question that I would like to organize a module around is “Which US Presidential candidate’s economic platform makes the most sense?”  I can imagine different responses from people from the US Northeast or say Ohio, people from the US south, Canadians, British, or participants from other parts of the world.  I would want to solicit participation from folks of all political and economic persuasions so students get the full breadth of views.  While I try to be balanced in my presentation of perspectives different from my own, it’s not the same as hearing it from a proponent.  This isn’t primarily intended to be place for people to just emote.  Rather, I want the site to generate an analysis of the underlying economic theories, as well as allowing for subjective conclusions.  It would be interested to unpack the assumptions behind people’s views.  I know my first year students often have strong opinions but aren’t clear on why they hold them.  I think this resource could help.

Option #2 It’s not an e-Portfolio.

This idea is less further developed than Option #1.

Our school has been exploring the concept and uses of an e-Portfolio.  I could explain our findings in detail, but for now let me just say we’ve decided that a commercial product is not for us, that we would like to explore what we understand might be the benefits of an ePortfolio with a new project we’re developing for next fall called a “Domain of One’s Own.”  (Note: By “we” I mean UMW, not me.  I’m just hoping to be a free-rider.)

My thought (and this is not original) is to ask students to create something that narrates, illustrates, and summarizes their learning in my course.  My hope is that this would provide students with a tangible sense of what they’ve accomplished over the semester, something they can literally take with them when they complete the course.

I can imagine using a domain of their own to help students build their understanding of the course topics, archive their thinking, and possibly link it all together (perhaps using a mother-blog).  One question: Could we somehow build a collaborative understanding of the material?  A “network of thought and interaction” perhaps?  My concern is that my course enrolls mostly first and second year students who may not be cognitively ready for that.

I’d love to hear your thoughts on these ideas.

Posted in Teaching and Learning, The Experiment | Tagged | 7 Comments

Time for a Change.edu?

I recently finished Andrew Rosen’s Change.edu.  I found a lot to like in the book, but I also think the author missed an opportunity to clarify something important that I don’t understand about For-profit universities.  The book has six chapters and each is largely stand-alone.

  1. Harvard Envy – This is the same point Christensen & Eyring made in The Innovative University: That Harvard is the epitome of higher education and that which all (not-for-profit) universities strive for.
  2. Club College: Why so many colleges look like resorts — This chapter on the forces pushing schools to become like “Club Med” was powerful.  Admittedly, this has been a pet peeve of mine for years.   Should schools try to compete for students based on their amenities or should schools try to compete on the basis of their educational programs?  For me, the latter is a no-brainer.  At the same time, I’m well aware that students can’t easily compare the quality of one school’s programs over another, but they can and do select the school with the professional quality fitness center or hotel quality residence halls over schools that do not.   How do we get off that train?  I don’t know and neither apparently does Rosen except to say “Just don’t do it.”  Competing on amenities is like attack ads in politics:  We say they’re bad, but we believe they work.
  3. The Challenge of Community Colleges — This chapter on why community colleges are not the answer to higher education’s woes was unpersuasive to me.  According to Rosen, the problem with community colleges is they try to do too much, from offering vocational training to general education for students interested in transferring to four-year schools to offering hobby courses.  As I read this chapter, I found myself wondering if it wasn’t merely an attempt to justify the relatively narrow range of programs offered by the For-profits.  Rosen also argues that community colleges aren’t as cheap as people think because of the subsidies offered by the states.
  4. A Crucial Part of the Solution:  How a new kind of college serves a new kind of student – This is Rosen’s argument in favor of For-profit universities.  He reminds readers that when land grant universities began, and again when community colleges began, the reaction by traditional higher education was just like the reaction today to For-profit schools.  It’s clear to me that more people need higher education, both initially and as lifetime learning.  Rosen’s argument that For-profits are part of the solution makes sense.
  5. The Case Against Private-Sector Higher Education – This is the chapter which received acclaim for Rosen’s being open to the criticisms made against For-profit schools.  I found the chapter disappointing.  After paying lip service to the well-known examples of a few schools aggressively recruiting students from homeless shelters and obtaining loans for them, Rosen didn’t seriously address any other criticisms of the For-profit sector.
  6. 2036 and the Coming 25 years of Change in Higher Education – I really liked this chapter.  Rosen may be wrong on some of the details, but I think he’s nailed the major trends we’re going to see in higher education.

I think Rosen overreaches when he argues that the tuition (only)-based model of For-profit institutions is an advantage over the multiple funding streams of most non-profit schools.   He makes a good case for the way research and intercollegiate athletics can take on lives of their own, driving some schools in directions that shortchange undergraduate education.  I found his argument that public universities are in this same category, due to the subsidies provided by states, less convincing for a school like mine where state support is only slightly more than 20% of our budget, where we have no Division 1 athletic programs, and where faculty have substantially higher teaching loads than at research universities.  Additionally, I wasn’t convinced by his argument that For-profit schools are in fact cheaper than public universities.  Rosen says that For-profits are cheaper for tax payers since there are no public subsidies, but even if that’s true, it’s not the point.  He seems to conflate two distinct issues: the relationship between private costs and benefits, and the relationship between social costs and benefits.

If higher education provides a public good, and arguably it does (though admittedly we have done a poor job in recent years in making that point clear to taxpayers), then providing the right amount of higher education requires subsidy, assuming that the social benefit is there.  It’s not clear to me that the social benefit of schools with very low completion rates, like some For-profit institutions, justifies the costs, especially when the financing takes the form of government-provided or guaranteed loans.  When those loans are repaid, there is no cost to taxpayers, as Rosen states.  But when students fail to complete a degree, they often fail to repay the loans.

One of the criticisms by traditional colleges and universities about the for-profit schools is that the latter are providing mere certification, rather than education, or that at best they offer narrowly defined training.  The author missed a chance to speak directly to this criticism.  What is the vision of education offered by the for-profits?  Is it limited to a fairly narrow range of career-oriented fields?  Does that imply that those are all we should offer in higher education?

The strength of Change.edu is the author’s assertion that we must do a better job of measuring the learning that takes place at Not-for-profit schools.  Only then can we make an apples-to-apples comparison.  I note that while assessment is critical, not all the benefits of traditional higher education can (as yet) be measured, but we need to incorporate them in our assessment nonetheless.  If quantitative assessment is difficult, then qualitative assessment is worth pursuing.

Posted in Teaching and Learning | Leave a comment

The Innovative University

Over the Christmas break, I finally found the time to read Christensen & Eyring’s The Innovative University.  I had heard that this book, written by a pair of insiders had important insights into what ails U.S. higher education.  Well maybe.  There’s a great deal the authors say that I agree with in principle, but the devil is in the details which they generally don’t provide.

The book is written for a general audience, which I take to mean people not familiar with the literature on higher education reform.   It is framed as a story rather than an analytical piece.  It presents a series of assertions (and makes a number of assumptions), but does little to provide supporting evidence for them.  Who knew, for example, that face-to-face instruction was invented at Harvard?  My biggest complaint is that the authors don’t consider any alternatives to their thesis.

It is quite a long story, slightly more than 400 pages.  The first 170 pages are a history of two schools: Harvard & BYU-Idaho.  One could get the bulk of the argument by starting with Part III, pages 171-219, and then focusing on the crux of the story in Part IV, pages 220 -324.  The remainder of the book is largely summary and conclusions.

The premise of the book is that the problems of U.S. higher education come from a single source: All colleges & universities try to mimic Harvard, but very few have the resources or students to be successful at that.  The result is that colleges & universities try to be all things to all people (as is Harvard), rather than trying to be competent at something simpler: providing a more generic higher education to the many people who need something more than high school.

A key implication of their story:  Not every student can (or should) obtain a first class education like at Harvard.  So, let’s stop pretending otherwise and explicitly tier our higher ed offerings both across institutions & within them.

If we shouldn’t be like Harvard, who should we be like?  Answer: We should be like BYU-Idaho (and a few similar institutions).  Their solution includes five or so components, each of which makes a certain amount of sense to me:

  1. End intercollegiate athletics
  2. Adopt a year-round academic schedule
  3.  Rethink pedagogy in radical ways
  4.  Simplify and standardize programs
  5.  Expand their reach through online programs

Their first point is that intercollegiate athletics is a money sink that adds to the inflation in the cost of higher ed while providing no academic benefits.  Higher education should be about education, not development for professional athletics or entertainment for students, staff and alumni.

The second point comes from the observation that campus infrastructure is essentially unused or at least underused for about a third of the calendar year, namely the summer. While many institutions have a summer term, it’s generally treated as a poor step child, rather than a full blood relation.  Most students don’t take summer school, and the courses are often considered lower quality than those taught during the regular term.  Why not create a genuine third semester during the summer?  Given the available infrastructure, it should be cost effective to expand instruction into this time, even granting the need to pay faculty to teach during the new semester.  It’s true that most faculty use the summer to conduct their research, but the authors have a solution to this also: Faculty should focus on teaching, not research.    After all, not every faculty member is capable of doing cutting edge research; much of the so-called research done is waste, unread and unnecessary.  See, for example, Mark Bauerlein’s recent work.  One implication of this argument is that research does not complement one’s teaching, which is arguable.  Also, I suspect there’s a difference between faculty in R1 institutions that teach two courses a year, and faculty at other institutions who may teach eight or more courses a year.

With respect to rethinking pedagogy, the authors give a brief nod to peer instruction, which was invented by Eric Mazur of–wait for it–Harvard.  I think peer instruction is an excellent innovation, which deserves to be more widely used in contexts where it is appropriate.  One such context is teaching large sections of science and probably social science courses.  But the authors don’t explore peer instruction in any detail.  They simply present it as part of the solution.

The primary pedagogical innovation the authors suggest is adopting something taken from the best of the for-profit institutions: a more centralized organization of what is taught and how it is taught.  Courses should be designed centrally by teams of instructional designers and subject experts (i.e. the former full-time faculty).  Begin with a list of learning objectives for each course. Think about the most efficient way to teach the content, which generally involves training lower cost adjuncts.  Think seriously about adopting some part of the Western Governors University approach, where students face a series of program learning objectives.  When they demonstrate mastery of the objectives, they are done.  Exactly how students learn on their own at WGU is not spelled out.  That’s something I’d like to hear more about.

Next, institutions should simplify their programs, by reducing the number of majors.  Does every university in the state need a major in Classics, for example?  Why not limit the number of Classics major programs so that each is a reasonable size?  Does every university need to offer an M.B.A?  WGU, for example, has only four majors: Business, Information Technology, Healthcare and Education.  Another suggestion of the authors is to create modular majors so that the same courses (or groups of courses) can count for multiple majors.  Think a common instruction to statistics that can work for the business, psychology and economics majors.  Think perhaps of a common introductory course to the social sciences.  Thus, when students change their major, they don’t have to take a completely new set of major requirements.

Something in this vein was described by Michael Rao in an op-ed the other day on articulation agreements between the Virginia Community College System and Virginia four year colleges and universities.

The “disruptive innovation” that the authors identify is online learning, though honestly that’s only a small part of the book.  Their key proposal is to expand the number of students taught by developing online programs in which full time faculty are largely replaced by (trained) adjuncts.   Existing full time faculty are redeployed to teach in the face-to-face programs and to develop courses both for face-to-face and online delivery.  As a result (say the authors), online programs can be taught at much lower cost than traditional face-to-face programs.  Additionally, by expanding the student body through online programs, the overhead expense of the face-to-face instruction can be spread to those who don’t enjoy the benefits of it.  The authors identify Southern New Hampshire University as another institution who has successfully adopted this model.

The unstated assumption here is that there is no loss of quality in the instruction, or that the “system” of course design and training can replace the lost quality.  I’m not going to argue that experienced adjunct faculty who can teach well don’t exist, just that in my experience many adjuncts are relatively inexperienced (e.g. graduate students), and few adjuncts have as deep ties to the institution as full-time faculty do.  I would like to see the evidence on the quality of those online courses.  The authors seem to be arguing that this type of online learning is good enough for those who have no alternatives.  As an economist, I can appreciate that argument but I think that that undervalues the potential of online learning.

Given the tremendous diversity of institutions in U.S. higher education, it’s hard to imagine that the authors’ prescription is appropriate for all of them (aside from the special few who inhabit the highest reaches:  Harvard & its peers).   The authors know little about a school like mine, the University of Mary Washington.  We are a largely undergraduate institution.  The standard teaching load is eight courses per year, and the vast majority of the courses are taught by full-time faculty–we have no graduate teaching assistants.   While promotion is driven largely by one’s scholarship, the vast majority of faculty here (>90% I would guess) care deeply about their teaching and put the majority of their professional effort into it.  That is not to say that we have no room for improvement—just that the authors may not have much to say of relevance to us.

Is the authors’ proposal worth pursuing for some institutions?  Absolutely.  Is it the answer for all institutions besides Harvard?  I doubt it.

What really disappoints me, though, is that Christensen and Eyring fail to really dig into the fundamental issues facing higher education today:  What should compose a college education for the 21st Century? Should degree completion be primarily about certification or education?  Should degree completion be defined by inputs (e.g.120 credits) or outputs (e.g. some list of competencies)?  How should the role of instructors change to suit this as yet undefined model of higher education?  What should the workload be for a full-time professor?  How can the entrenched cultures in higher education be changed?  For example, how can academic departments and programs be persuaded to take assessment and learning outcomes seriously, to see them as critical tools for improving student learning?  (I’ll note briefly that BYU-Idaho is rather a special case, given the authority of the Mormon Church, whose leaders unilaterally instituted the changes there.  I can imagine few other institutions whose leaders could make such unilateral changes and have them stick.)  How can what researchers have learned about cognition and learning more generally be disseminated to all faculty in higher education?  How can faculty be induced to reconfigure their teaching to incorporate those research findings?

The book that answers these questions would be much more insightful than The Innovative University.

Posted in Teaching and Learning, The Future of Higher Education | 4 Comments

Son of Pedablogy

I am planning to teach an online course a year from now during Fall 2012.  The course is ECON 201, Principles of Macroeconomics, a course I have taught nearly every year since I began teaching in 1982, but always in a traditional classroom.  As I teach the course this term, I am thinking carefully about what I am doing, in order to figure out how I will need to do it differently online.  The purpose of this post is to announce that I have started a new blog to narrate the process I am going through.  The blog is called “Dissecting a Course.”  I hope some of you will find it worth following.

Posted in Teaching and Learning, The Experiment | Leave a comment

Redesigning My Intro Course

This post is a continuation of my thinking over (at least) the last two posts.  The focus is on how I plan to incorporate high impact practices into my introduction to macroeconomics course this Fall to improve on last year’s experience.  I wish I had more time to flesh out my thinking, but classes start tomorrow so this will have to suffice.

The course will be incorporate the following four elements:

  1. Establish high expectations – The literature seems pretty clear that establishing high expectations is critical to student learning.   The approach I’m going to take starts with a “Promise Syllabus.”  The first class session I will tell students

“I assume you’re here, not for the grade or the credits, but because you want to learn macroeconomics.  You may have heard that economics is a difficult subject.  This course is challenging, … but if you do the work, you will learn the material.”

Only a handful of students have been unable to learn this material in my 30 years of teaching.  The vast majority of students who fail, do so because of lack of effort.

I am attempting to integrate some of the findings from Daniel Pink’s book Drive.  Pink identified three factors which lead to better performance for cognitive or creative tasks, such as university teaching and learning:

  • Autonomy – if students know what they need to do to be successful, they will perform better.   This is part of “establishing high expectations” as well as some of the elements described below.
  • Mastery – the urge to get better at something.   Challenge and mastery drives people.  (How many of you think you’re good at economics?  How many of are a bit concerned that it might be challenging?  It *is* challenging, but you can do it.  This is part of the first week’s discussion including an Economics Concept Inventory I’ll be having the class do.  (This idea is from Angelo 2011.)  The idea is to confront students with a series of key concepts, only some of which they know.  After having students work individually on this, I will create small groups to discuss their individual responses.  The variety of responses should create uncertainty about what is “the right answer.”  That (hopefully) sets the stage for convincing students that they can learn this if they engage with the course.
  • Purpose – Do something important; Do real work; make a difference.   This factor will be the hardest to implement at the introductory level, though it works very well for my senior seminar model.  The first thought paper (see below) in my intro course asks students to identify a couple of analytical questions they’d like to be able to answer by the end of the term.  Though not part of the grading, I will also ask them to rate how important each question is to them personally.  I plan to sprinkle the submitted questions in appropriate spots around the course, such as the web pages introducing each Course Topic (i.e. Course Module) .   I’m hoping this will stimulate intrinsic motivation and make the course more relevant to students.

2.  Build the Course on “Backward Design” Principles.   Start your thinking from your Course Learning Objectives: What is it that you want your students to know or be able to do by the end of the course?  Identify explicit learning objectives for each of the Course Topics.   Think carefully about what activities (e.g. lecture, class discussion, laboratory activities, papers, problem sets, etc.) can best help students master the LOs.  Design each section of your course around those.  Figure out how you will know the extent to which students are learning.  These are your assessments.

As I reworked my course materials to be consistent with Backward Design, I learned a few interesting things.  Lecture notes, like writing, make us possessive.  We put so much into them, we hesitate to discard them.  This is especially true since, when most of us started teaching, writing lectures was about filling a semester’s worth of class time.  Backward Design requires that we revisit the notes for each class session and ask:  Is this necessary for reaching the next learning objective?  If not, it should be discarded.  From this perspective, I found at least a few lectures that no longer seemed important.  To  date, I’ve reviewed my notes through the first exam.  I’ll have to do the rest during the semester.

 3.  Give Regular assignments with frequent, but low stakes assessment.  One of the points, Kuh (2008) makes is that students need to be actively and regularly engaged in course material to learn best.   Students need regular formative, ideally low-stakes assessment so they can know how well they are learning, and so they can make adjustments before the midterm exam, by which time without such feedback they may have dug themselves into a big hole.  My course will have three types of assignments:

  • Weekly “minute” papers in which students identify those concepts which we covered which they don’t think they’ve mastered.   If they feel they’ve mastered everything we covered, they say so.  If they email me the assignment, they get a small number of homework points.  I don’t grade these papers.  I use them to help me understand what students are getting and what I need to explain again.  This may be an example of the sort of simple, straightforward tasks (e.g. a clear set of rules with a single correct solution) which Pink finds respond predictably to (financial) rewards. E.g. Read the chapter, get the points!
  • Aplia problem sets, for each chapter in the text.  The problems are automatically graded by Aplia.  This is formative assessment for the students who see how well they are doing.  If they score a passing grade, they get a small number of homework points.  Text book problem sets are notoriously poor.  Aplia’s are not ideal, but they seem to be better than the rest.
  • Periodic Thought Papers.  These are about half a dozen assignments which ask bigger questions than the Aplia problem sets do.  Questions posed include: Did Hurricane Katrina result in price gouging?   What is the state of the economy (and how do you tell)?  What is the role of government in the U.S. economy?

  4.  Build regular reflection into the course.  Angelo and Chew each emphasize the importance of metacognition to achieve deep learning.  One way to obtain this is by having students reflect on the meaning or importance of what they are learning.  This is the least developed aspect to date of my course, but I do have a couple of ideas:

  • The first Thought Paper asks students Why are you taking this course, What are your goals, and What are two or three analytical questions you’d like to be able to answer from this course by the end of the semester.
  • In-class reflections– This is something I haven’t tried before but I plan to take a few minutes of class time at the end of each Course Topic to ask students to write down:   What were the most important concepts in this topic?  How are they connected to something you already know?  How are they relevant (or how can you connect them) to your life?

Two questions that I will be pondering this term:  The course starts slowly, but then becomes more difficult as we explore more complex topics.   As the semester progresses, students seem to underperform, more than I would expect can be explained by the difficulty of the material.  Could it be because we’re rushed at the end?  If so, what can I do to fix this?  Second, in recent years, students have mastered one of the two main analytical models in ECON 201: the model of supply & demand.  They have done less well on the other model (which comes later in the term): the income-expenditure model.  Why is that and how can I fix the latter?  Do I spend less class time having students work through examples with the second model?

Some may argue that this rethinking the design of my course is like applying Band-Aids to a compound fracture, which at best its merely addresses the surface issues.  That employing phrases like “Backwards Design,” “Autonomy,” and “Reflection” doesn’t really change the fundamental character of a course.  What I’m  attempting here, though, is to think carefully about each component of my course, using criteria that I haven’t used explicitly before.  And remember, this is an experiment with an introductory level course.  I wouldn’t use the same approach with a senior seminar.

Class starts at 10am tomorrow morning.  I guess I’m ready.

References:

Branford et al, How People Learn, 2000.

Dan Pink, Drive: The surprising truth about what motivates us, 2011.

George Kuh, High Impact Educational Practices: What they are, who has access to them and why they matter, 2008.

Thomas Angelo, “Seven Levers for Higher and Deeper Learning:  Research–based Guidelines and Strategies for Improving Teaching, Assessment & Feedback.” Preconference Workshop at the 2011 Annual Meetings of the Educause Learning Initiative.

Stephen Chew, “Improving Classroom Performance by Challenging Student Misconceptions About Learning,” paper: https://www.psychologicalscience.org/observer/getArticle.cfm?id=2666   April 2010, and videos: http://www.youtube.com/playlist?list=PL85708E6EA236E3DB

Posted in Teaching and Learning, The Experiment, Uncategorized | 3 Comments