Monday, November 14, 2011

Grade Inflation and Choice of Major

Like so many other bad habits, grade inflation is lots of fun until someone gets hurt. Students are happy with higher grades. Faculty are happy not quarreling with students about grades.

When I refer to someone getting hurt by grade inflation, I'm not talking about the sanctity of the academic grading process, which is a mildly farcical concept to begin with and at any rate too abstract for me. I'm also not referring to how it gets harder for law and business schools to sort out applicants when so many students have high grades. In the great list of social problems, the difficulties of law and B-school admissions offices don't rank very high.

To me, the real and practical problem of grade inflation is that it causes students to alter their choices, away from fields with tougher grading, like the sciences and economics, and toward fields with easier grading.
A couple of recent high-profile newspaper stories have highlighted that college and university courses in the "STEM" areas of science, technology, engineering and mathematics tend to have lower average grades than courses in humanities, which is one factor that discourages students from pursuing those fields. Here's an overview of those stories, and then some connections to more academic treatments of the topic from my own Journal of Economic Perspectives.

A New York Times story on November 4, by Christopher Drew, was titled, "Why Science Majors Change Their Minds (It’s Just So Darn Hard)."  Drew writes: "Studies have found that roughly 40 percent of students planning engineering and science majors end up switching to other subjects or failing to get any degree. That increases to as much as 60 percent when pre-medical students, who typically have the strongest SAT scores and high school science preparation, are included, according to new data from the University of California at Los Angeles. That is twice the combined attrition rate of all other majors."

Part of the reason is that most of the STEM fields start off with a couple of years of tough, dry, abstract courses, for which many students are not academically or emotionally prepared. Another reason is that the grading in these courses is tougher than in non-STEM fields. Drew describes some of the evidence: "After studying nearly a decade of transcripts at one college, Kevin Rask, then a professor at Wake Forest University, concluded last year that the grades in the introductory math and science classes were among the lowest on campus. The chemistry department gave the lowest grades over all, averaging 2.78 out of 4, followed by mathematics at 2.90. Education, language and English courses had the highest averages, ranging from 3.33 to 3.36. Ben Ost, a doctoral student at Cornell, found in a similar study that STEM students are both “pulled away” by high grades in their courses in other fields and “pushed out” by lower grades in their majors."

(For those who want the underlying research, the Rask paper is available here, and the Ost paper is available 
here.)

On November 9, the Wall Street Journal had a story called "Generation Jobless: Students Pick Easier Majors Despite Less Pay," written by Joe Light and Rachel Emma Silverman.

"Although the number of college graduates increased about 29% between 2001 and 2009, the number graduating with engineering degrees only increased 19%, according to the most recent statistics from the U.S. Dept. of Education. The number with computer and information-sciences degrees decreased 14%." Again, part of the problem is insufficient preparation before college for the STEM classes, and part is the discouragement of getting lower grades than those in non-STEM fields. Also, even with lower grades, the STEM majors are more work: "In a recent study, sociologists Richard Arum of New York University and Josipa Roksa of the University of Virginia found that the average U.S. student in their sample spent only about 12 to 13 hours a week studying, about half the time spent by students in 1960. They found that math and science—though not engineering—students study on average about three hours more per week than their non-science-major counterparts."

(For those who want to go for original sources, Arum and Roksa discuss the several thousand students that they surveyed over several years in their 2011 book Academically Adrift: Limited Learning on College Campuses. When they make comparisons back to how much students studied in 1960s, they are drawing on work by Philip Babcock and Mindy Marks. For a readable overview of that work, see their August 2010 essay on "Leisure College, USA: The Decline in Student Study Time,"  written as an Education Policy brief for the American Enterprise Institute. For the technical academic version of their work, see their essay in the May 2011 Review of Economics and Statistics (Vol. 93, No. 2, Pages 468-478), "The Falling Time Cost of College: Evidence from Half a Century of Time Use Data."

As noted, there are lots of reasons why students don't persevere in STEM courses: inadequate preparation at the high school level, students who have unrealistic expectations or don't want to commit the time to studying, or that the courses are just hard. It's of course possible to address these issues, but difficult. However, if one of the issues discouraging students from taking STEM courses is that grade inflation is happening faster in the humanities, then surely, this cause at least is fixable? In my own Journal of Economic Perspectives, which is freely available from the current issue going back to the late 1990s courtesy of the American Economic Association, several authors have taken a stab at quantifying the differences in grades across majors and what difference it makes to course choice.

The first such paper we published was back in the Winter 1991 issue. It was by Richard Sabot and John Wakemann-Linn, and called "Grade Inflation and Course Choice." It's too far back to be freely available on-line, but it's available through JSTOR. The complaints in that article sound quite familiar. They write:

"The number of students graduating from American colleges and universities who had majored in the sciences declined from 1970-71 to1984-85, both as a proportion of the steadily growing total and in
absolute terms. ... Students make their course choices in response to a powerful set of incentives: grades. These incentives have been systematically distorted by the grade inflation of the past 25 years. As a consequence of inflation, many universities have split into high- and low-grading departments. Economics, along with Chemistry and Math, tends to be low-grading. Art, English, Philosophy, Psychology, and Political Science tend to be high-grading." They present more evidence on grade inflation and course choice from Amherst College, Duke University, Hamilton College, Haverford College, Pomona College, the University
of Michigan, the University of North Carolina and the University of Wisconsin, and more detailed analysis from their own Williams College. As they write: "This sample is admittedly small, but was selected so as to include private and state schools, large universities and small colleges, and Eastern, Southern, Midwestern and Western schools."

Based on more detailed statistical analysis from Williams College, where they have access to more detailed data, they write: "Our simulation indicated that if Economics 101 grades were distributed as they are in English 101, the number of students taking one or more courses beyond the introductory course in Economics would increase by 11.9 percent. Conversely, if grades in English 101 were distributed as they are in Economics 101, the simulation indicated that the number of students taking one or more courses beyond the introductory course in English would decline by 14.4 percent. The results of applying this method to-the Math department, which had the lowest mean grade and the highest dispersion of grades, are more striking. If the Math department adopted in its introductory course the English 101 grading distribution, our simulation indicated an 80.2 percent increase in the number of students taking at least one additional Math course! Alternatively, if the English department adopted the Math grade distribution, there would be a decline of 47 percent in the number of students taking one or more courses beyond the introductory course in English."


We took another swing at the issue of grades and course choice with a couple of articles in our Summer 2009 issue. Alexandra C. Achen and Paul N. Courant asked "What Are Grades Made Of?" They argue: "Grades are an element of an intra-university economy that determines, among other things, enrollments and the sizes of departments. ... Departments generally would prefer small classes populated by excellent and highly motivated students. The dean, meanwhile, would like to see departments supply some target quantity of credit hours—the more the better, other things equal—and will penalize departments that don’t do enough teaching. In this framework, grades are one mechanism that departments can use to influence the number of students who will take a given class."



Focusing on 25 years of grade data from the University of Michigan, they find:  "First, the distribution of grades is likely to be lower where courses are required, and where there are agreed-upon and readily assessed criteria—right or wrong answers—for grading. By contrast, departments that evaluate student performance using interpretative methods will tend to have higher grades, because using these methods increases the personal cost to instructors of assigning and defending low grades. Second, upper-division classes are likely to have higher grades than lower-division classes, both because students have selected into the upper-division courses where their performance is likely to be stronger and because faculty want to support (and may even like) their student majors. Third, grades can be used in conjunction with other tools to attract students to departments that have low enrollments and to deter students from courses of study that are congested. We find some evidence in support of each of these patterns. As it happens, the consequence of the preceding tendencies is that, indeed, the sciences (mostly) grade harder than the humanities. ..."
 
"We argue that differential grading standards have potentially serious negative consequences for the ideal of liberal education. At the same time, we conclude that any discussion of a policy response to grade inflation must begin by recognizing that American colleges and universities are now in at least the fifth decade of well-documented grade inflation and differences in grading norms by field. Current grading behavior must and will be interpreted in the context of current norms and expectations about grades, not according to some dimly imagined (anyone who actually remembers it is retired) age of uniform standards across departments. Proposals that attempt to alter grading behavior will face the costs of acting against prevailing customs and expectations, whether in altering pre-existing patterns of grades across departments within a college or university or in attempting to alter grades in one institution while recognizing that other universities may
not change."
In that same issue, Talia Bar, Vrinda Kadiyali, and Asaf Zussman discuss one proposal to alter the incentives for grade inflation about "Grade Information and Grade Inflation: The Cornell Experiment." They report that in "April 1996, the [Cornell] Faculty Senate voted to adopt a new grade reporting policy which had two parts: 1) the publication of course median grades on the Internet; and 2) the reporting of course median grades in students’ transcripts. ... Curbing grade inflation was not explicitly stated as a goalof this policy. Instead, the stated rationale was that “students will get a more
 accurate idea of their performance, and they will be assured that users of the transcript will also have this knowledge."

To given a sense of the institutional obstacles here, they report that while median grades were publicly available on-line in 1998, at the time the article was written this information did not yet appear on actual student transcripts. As they point out, making this information available may have the undesired effect of encouraging students even  more to take courses with easier grades! They also argue that the propensity to take easier-grading courses will be greater for lower-ability students. Thus, student will tend to sort themselves into higher-ability students in tougher-grading classes, and lower-ability students in easier-grading classes. Indeed, they estimate that nearly half of the grade inflation for Cornell as a whole, in the years after median grades were posted on the web, was attributable to students sorting themselves out in this way.



In short, grade inflation in the humanities has been contributing to college students moving away from science, technology, engineering, and math fields, as well as economics, for the last half century. It's time for the pendulum to start swinging back. A gentle starting point would be to making the distribution of grades by institution and by academic department (or for small departments, perhaps grouping a few departments together) publicly available, and perhaps even to add this information to student transcripts. If that answer isn't institutionally acceptable, I'm open to alternatives.