The Living Room Times

In light of the discussion here about the relative strength of different college football conferences, I decided to review the performance of each conference in BCS games since the BCS’s inception in 1998.

For comparing conference strength, this is a reasonable metric because it’s a focused sample where the best teams from different conferences play each other in meaningful games. This is something that happens too rarely in the regular season, where the polling system’s penalty for losses probably discourages strong teams from scheduling strong discretionary (non-conference) opponents. In addition, by focusing on the actual performance of the top teams, it avoids undervaluing the leading teams from conferences with high variance (both good and bad teams), as would happen from an evaluation of all interconference regular season games.

The results were interesting. In order of winning percentage:

Non-BCS conferences 3-1 (.750) (Mountain West 2-0, WAC 1-1)
SEC total 12-5 (.706), champions 8-3, at-large 4-2
Pac 10 total 9-4 (.692), champions 7-4, at-large 2-0
Big East champions 6-5 (.545), no at-large selections
Big 12 total 7-9 (.438), champions 4-7, at-large 3-2
Big 10 total 8-11 (.421), champions 4-7, at-large 4-4
ACC champions 2-9 (.182), no at-large selections
Independent (Notre Dame) 0-3 (.000)

Since at-large entrants from BCS conferences are presumably weaker (on average) than the champions from the same conferences, I felt that including at-large entrants might unfairly lower the apparent performance of their conferences, and I considered looking only at conference champions. However, in three conferences (Big 10, Big 12, and Pac 10) the inclusion of at-large teams actually improved their winning percentage, and in only one conference (SEC) did it slightly lower this value (from .727 to .706).

The strong performance of at-large teams from BCS conferences was notable. These teams had a 13-8 record (.619), in contrast to BCS conference champions, with a record of 31-35 (.470). This isn’t merely due to the “conference champion” pool being pulled down by poorly performing conferences (such as the ACC) while the at-large pool is not weighted down by the forced inclusion of poor teams. If that were true, we wouldn’t expect the at-large teams to boost the winning percentage of 3 of 4 BCS conferences with at-large invitations.

A stronger source of bias against conference champions may be the BCS championship game format, since one of the two supposedly best teams (usually both conference champions) will lose a game they might win against a random BCS opponent. Over this period, 9 BCS conference champions have lost in the BCS championship game.

However, for the purpose of comparing conference strength, this factor does not seem important. The main effect should be reducing the spread in winning percentages, since the better conferences are more likely to have a conference champion invited to (and have an opportunity to lose in) the BCS championship game. Except for small sample size effects, it would not seem to influence the relative ranking of the conferences.

Another possible concern is the non-random pairings of conference champions in the Rose Bowl’s Pac 10 – Big 10 matchup. If one conference champion routinely beats the other in the Rose Bowl, this would not tell us anything about how to place these conferences against other conferences. However, the Rose Bowl formula does not appear to have been much of an influence. Over this period, there have only been five matchups in the Rose Bowl between Pac 10 and Big 10 champions, with the Pac 10 leading the series 3-2. In other years, the matchup was disrupted by one of the conference champions going to the BCS Championship game, or the Rose Bowl itself being the BCS championship game.

In summary, the SEC and Pac 10 seem to be the strongest conferences, with a wide gap between them and everyone else. Given the performance of the Big East, the only other BCS conference with a winning record, the absence of any at-large invitations suggests that it’s undervalued. The extraordinary performance of non-BCS conferences — with a higher winning percentage than any BCS conference (albeit with a small sample size) — suggests that the BCS is too reluctant to extend invitations to these teams.

I believe my math is correct (and my knowledge of which teams are in which conferences), but if you want to check the numbers, here is my source material with raw data:

Source: http://www.bcsfootball.org/bcsfb/timeline

Oregon just finished a dramatic double OT victory over Arizona in Tucson which means that the December 3rd Civil War between Oregon and Oregon State will decide the conference champion and Rose Bowl opponent for Ohio State.