Home / Dave Brockington / Election Prediction

Election Prediction


This is the time of the season where many if not most of us pore over the various state level election tracking sites available.  Electoral Vote was a big one in 2004, and remains my favorite for daily poll releases; 538 in 2008 and again now under the New York Times in 2012.  One I wasn’t familiar with, inexplicably, until yesterday is Princeton Election Consortium.  I’m assessing the distinctiveness of this one when I have time, which means I haven’t accomplished more than a superficial perusal.  Their current analysis is similar to Silver’s: there appears to be a slight erosion in support for Obama in national polls that is not replicated in state level polls.  The model itself seems far less sophisticated in terms of variables, but this is not necessarily a bad thing in a purely predictive exercise.

It’s worth a look.

h/t Jeffrey Dudas

UPDATE: link fixed.  I hope.

  • Facebook
  • Twitter
  • Google+
  • Linkedin
  • Pinterest
  • Glenn

    FYI, for me that Princeton link wouldn’t work until I took the “www” off. Don’t know if that’s just my ISP or what.

    • Gary K

      You are correct: the link needs to be edited.

      Wang has been in this business (or in his case, this hobby) since 2004. In 2008 he predicted an EC outcome of 364-174, which missed by the single Nebraska EV picked up by Obama. More on that in a Daily Kos postmortem. Also here’s an explanation of his aggregation methodology.

      • Dave Brockington

        I believe I fixed the link.

        • Anonymous

          Oh, good, and can you fix mine? (Sorry to be so elderly.)

  • Gary K
  • Jameson Quinn

    Any good House predictions/models out there?

    • Anderson

      Here is a good House prediction: we don’t take it back.

      • dave

        Wang thinks the House is a coin flip with Dems having a very slight edge. He does note that the lack of polling in House races makes predicting the House more difficult.

        • Ian

          Wang is being insufficiently complex in this regard. As Dave Weigel pointed out recently, one has to take redistricting into account. We’re not taking it back until the demographics change again.

          • Craigo

            While I respect Weigel as a reporter, I have to ask – where’s the math? historically, what sort of popular vote edge is needed to take the House? How much of an advantage is the redistricting? Is the first number larger or smaller than the second?

            When he does his homework I’ll take him seriously on this issue.

            • Ian

              Obviously there is some level of popular vote at which we would take back the House. But it’s not clear to me that it can be effectively modelled by historical comparisons.

              The aggressive redistricting following the 1990 census ushered in an era of Republican dominance, but by the Bush administration demographics had shifted enough that many seats were more or less at parity–thus, a Democratic wave was enough to gain a large majority, and a subsequent Republican wave was enough to get the House back. But now they’ve rejiggered it again, with the intention of securing the gains of 2010.

              If we’re going to compare the post-2010 map with the pre-2010 map, we need to go district by district to find the new partisan lean, and calculate the new overall lead necessary for a Dem victory. But why bother? As far as I can tell, every predictor who is looking at the race district by district thinks it’s hopeless for the Democrats.

              • Njorl

                As far as I can tell, every predictor who is looking at the race district by district thinks it’s hopeless for the Democrats.

                The problem with that is their predictions would present a result which is utterly at odds with history. Assuming toss-ups split roughly 50/50, people are predicting a 40 seat Republican advantage while Dems win the cumulative house ballot by about 2 points. That is not going to happen. Something is clearly wrong with the polling.

        • thusbloggedanderson

          Wang is drinking happy juice. Time will tell.

          RCP sees 26 tossups. Give ALL of those to Dems. That gets us to 209 vs. 226. I know RCP tilts red, but still, I’m not buying Wang here. Neither is Drum.

          • Njorl

            If you trust Drum where math is involved you are a fool.

            • thusbloggedanderson

              Oh, I’m a fool regardless of Drum or math.

  • The model itself seems far less sophisticated in terms of variables, but this is not necessarily a bad thing in a purely predictive exercise.

    This is precisely backwards. Sam Wang’s model is much simpler and more transparent than Silver’s, but the parsimony of the former, in fact, is what makes it vastly more sophisticated than the latter.

    • mpowell

      You cannot just change words to suit your meaning. It could only be more sophisticated in this sense if it relied on an improved fundamental insight that rendered additional details unecessary. But it’s simplicity is hardly proof of this. The question is how well it actually performs and since it is untested on out-of-sample material, we don’t know yet.

      • Craigo

        No, he’s correct. Silver’s model makes two mistakes – he overfits (seven econometric variables, seriously?) and overweights (if the econometric variables are affecting public opinion, then it’s already priced in). This is odd, as Silver has previously warned of the danger of overfitting and the general uselessness of econometric models. He is likely including a lot of noise in his dataset, which is why his numbers are relatively volatile compared to models that don’t use econometric data or at all (Sam Wang) or only as a prior (Drew Lizner).

        Wang’s model performed very well in 2004 and 2008, and actually came out ahead of 538 on a few counts four years ago.

        • thusbloggedanderson

          overweights (if the econometric variables are affecting public opinion, then it’s already priced in)

          Don’t agree. Economic pain can take a while to sink in and affect people. And IIRC, the closer we get to the election, the less Silver counts his econ variables.

      • All other things being equal, simply including more parameters (even if the inputs are noise) will increase a model’s fit. That’s why when choosing between two distinct models you use a a criteria that penalizes for additional complexity (for the technically minded: AIC). Given that they both did about the same in 2008, but Wang’s model uses only polling data, his model is clearly superior.

        • thusbloggedanderson

          Evaluating on the basis of a single election?

          • Does Silver have some secret record of electoral prediction success that I’m not aware of? Neither Wang or Silver are going to be wrong unless the “unskewed polls” guy is right, and there is some massive systematic bias in the polls.

            You can favor whatever model you like, I am just speaking out against the common misconception that the model with the most parameters to tweak and proprietary knobs to twist is the most “sophisticated”… when really the opposite is true.

            • dave brockington

              I didn’t intend for my use of “sophisticated” as a word to have normative implications, which several comments seem to assume. It’s a statement of fact, and in order to deflect any judgment assumptions that might be read into it, I added the clause that said something like ‘this is not necessarily a bad thing . . . ‘. FWIW, I have a strong preference for parsimony in modelling, when possible, and I teach the same.

              • dave brockington

                To wit: according to Websters, one definition is “highly complicated or developed”. That’s not a judgment, that’s simply empirical fact. If two models, one parsimonious, one “sophisticated” in the sense I used the word, reach the same conclusion, the preference should always be for the former.

  • Pingback: Pollsters. | Akkam's Razor()

  • DocAmazing

    Guess we’ll find out in a few weeks…

  • Kori Nevis

    Bed Bugs Chicago, Treatment of Bed Bugs Chicago, Removal of Bed Bugs Chicago Don’t stress about those bed bugs anymore! Contact the experts at http://www.bedbugstreatmentchicago.com/

It is main inner container footer text