Pauline T. Kim

The Supreme Court Forecasting Project: Legal and Political Science Approaches to Predicting Supreme Court Decisionmaking

This Essay reports the results of an interdisciplinary project comparing political science and legal approaches to forecasting Supreme Court decisions. For every argued case during the 2002 Term, we obtained predictions of the outcome prior to oral argument using two methods—one a statistical model that relies on general case characteristics, and the other a set of independent predictions by legal specialists. The basic result is that the statistical model did better than the legal experts in forecasting the outcomes of the Term’s cases: The model predicted 75% of the Court’s affirm/reverse results correctly, while the experts collectively got 59.1% right. These results are notable, given that the statistical model disregards information about the specific law or facts of the cases. The model’s relative success was due in large part to its ability to predict more accurately the important votes of the moderate Justices (Kennedy and O’Connor) at the center of the current Court. The legal experts, by contrast, did best at predicting the votes of the more ideologically extreme Justices, but had difficulty predicting the centrist Justices. The relative success of the two methods also varied by issue area, with the statistical model doing particularly well in forecasting “economic activity” cases, while the experts did comparatively better in the “judicial power” cases. In addition to reporting the results in detail, the Essay explains the differing methods

Competing Approaches to Predicting Supreme Court Decision Making

Political scientists and legal academics have long scrutinized the U.S. Supreme Courts work to understand what motivates the justices. Despite significant differences in methodology, both disciplines seek to explain the Courts decisions by focusing on examining past cases. This retrospective orientation is surprising. In other areas of government, for example, presidential elections and congressional decision making, political scientists engage in systematic efforts to predict outcomes, yet few have done this for court decisions. Legal academics, too, possess expertise that should enable them to forecast legal events with some accuracy. After all, the everyday practice of law requires lawyers to predict court decisions in order to advise clients or determine litigation strategies. The authors thank Michael Cherba, Nancy Cummings, David Dailey, Alison Garvey, Nick Hershman, and Robin Rimmer for their assistance. Their project is supported in part by National Science Foundation grants SES-0135855 and SES 0136679. The foundation bears no responsibility for the results or conclusions.