Welcome to DU! The truly grassroots left-of-center political community where regular people, not algorithms, drive the discussions and set the standards. Join the community: Create a free account Support DU (and get rid of ads!): Become a Star Member Latest Breaking News Editorials & Other Articles General Discussion The DU Lounge All Forums Issue Forums Culture Forums Alliance Forums Region Forums Support Forums Help & Search
 

DestinyIsles

(263 posts)
Mon Jan 23, 2023, 09:44 PM Jan 2023

Nate Silver and FiveThirtyEight Are on ABC's Chopping Block

https://www.thedailybeast.com/nate-silver-and-fivethirtyeight-are-on-abcs-chopping-block

Questions over FiveThirtyEight’s future come as Silver faces public criticism for his reliance on polls that inaccurately predicted a “red wave” in the midterm elections.

“There’s no question in my mind that FiveThirtyEight was used by partisan sources to create a false impression of the election and that Nate was aware this was happening and by not addressing it he ended up contributing to misleading the American people about what was happening in the election,“ Democratic strategist and former ABC News producer Simon Rosenberg told Confider. “This is an existential threat to FiveThirtyEight. If he refuses to make significant reforms and changes the political elite should move on to other sources to get information about polling.”

Silver did not respond to a request for comment, but an ABC News spokesperson texted Confider: “There are no imminent decisions about our relationship with 538.”


Geehee.... Nate Silver being a right wing tool doesn't surprise me.
56 replies = new reply since forum marked as read
Highlight: NoneDon't highlight anything 5 newestHighlight 5 most recent replies
Nate Silver and FiveThirtyEight Are on ABC's Chopping Block (Original Post) DestinyIsles Jan 2023 OP
They are wonderful, actually. And will likely have no trouble finding another home. ColinC Jan 2023 #1
I disagree Fiendish Thingy Jan 2023 #7
It is a little odd to me. Happy Hoosier Jan 2023 #22
I disagree...Silver allowed the right wing to put fake poll out and acted like they were real. Demsrule86 Jan 2023 #33
Seems to.me that NPR lead the "Red Wave" was inevitable narrative The_Casual_Observer Jan 2023 #2
Mara Liasson has always been a right side hack.....in my humble opinion. Years ago when she a kennedy Jan 2023 #9
A pain in the ass that is shown too much respect. Her unfounded The_Casual_Observer Jan 2023 #12
I was unfamiliar with Mara Liasson, so looked her up- MerryBlooms Jan 2023 #32
If you are unfamiliar with Mara you are unfamiliar with the The_Casual_Observer Jan 2023 #49
Called it in real time. It was obvious. onecaliberal Jan 2023 #3
Hell, even I saw that the red wave was not materializing. Sky Jewels Jan 2023 #4
I saw it too and was ridiculed here and even my son gave me a hard time...his first words to Demsrule86 Jan 2023 #34
Haha, restraint can be tricky. Sky Jewels Jan 2023 #46
It's not as simple as Silver being a right wing tool Fiendish Thingy Jan 2023 #5
The only Senate seat that was off was NV, and even in that the Republican was barely leading Polybius Jan 2023 #6
They didn't predict it Sympthsical Jan 2023 #10
A red wave was predicted...because of deliberate right wing bullshit polls. It didn't happen and Demsrule86 Jan 2023 #37
Oh please there was no red wave and you posted that there would be...we gained a Senate seat! Demsrule86 Jan 2023 #35
I think you misunderstood me Polybius Jan 2023 #47
Good analysis, thanks n/t Just_Vote_Dem Jan 2023 #14
He is like 99% of the other people who break into the top echelon of corporate media Cosmocat Jan 2023 #16
The polls were not that far off. former9thward Jan 2023 #8
I have no idea where this "The polls were super wrong" narrative is coming from Sympthsical Jan 2023 #11
Because for weeks they predicted a huge red wave that never happened Just_Vote_Dem Jan 2023 #15
The media and the data are not the same things Sympthsical Jan 2023 #17
But the commentary IS the important thing Just_Vote_Dem Jan 2023 #18
But that's not what people are saying Sympthsical Jan 2023 #21
Preach it! inthewind21 Jan 2023 #50
"more than they were paying attention to the data and the facts." BumRushDaShow Jan 2023 #23
They also used YouGov and Morning Consult Sympthsical Jan 2023 #24
In response BumRushDaShow Jan 2023 #27
You explained it a lot better than me, thanks! Just_Vote_Dem Jan 2023 #28
You are welcome and that December DU OP on this 538 poll bias issue BumRushDaShow Jan 2023 #29
Very nice. scipan Jan 2023 #30
Thank you BumRushDaShow Jan 2023 #31
Races Called Correctly per FiveThirtyEight: W_HAMILTON Jan 2023 #53
This is an extremely dishonest use of statistics Sympthsical Jan 2023 #55
LOL! W_HAMILTON Jan 2023 #56
The data was the basis for the predictions...so please, take another look. Demsrule86 Jan 2023 #38
.it was the accompanying commentary that was relentlessly pushing The_Casual_Observer Jan 2023 #13
+1, thier analysis of the data was slanted uponit7771 Jan 2023 #26
The polls were completely off there was no red wave and only three times in history have we Demsrule86 Jan 2023 #36
Good BumRushDaShow Jan 2023 #19
Nate Silver is a right wing tool now. LOL Laura PourMeADrink Jan 2023 #20
Real Clear Politics is now funded by the righties. Demsrule86 Jan 2023 #39
Interesting. But jeez they just take numbers and crunch. Laura PourMeADrink Jan 2023 #40
He was either terribly incompetent or worse for going with RW fake pollsters in aggregates. themaguffin Jan 2023 #25
Hell it took us a while... Why would he be expected to Laura PourMeADrink Jan 2023 #41
Not instant, it's his stubborn stance when known. I'm not a Nate hater. I just think that was themaguffin Jan 2023 #44
Somehow ABC and 538 are affiliated. Haven't looked up how. Laura PourMeADrink Jan 2023 #48
Hmmm. Seems pretty forthright to me Laura PourMeADrink Jan 2023 #45
They have proof that Nate Silver Laura PourMeADrink Jan 2023 #42
Polls are always a gamble. ificandream Jan 2023 #43
In other news inthewind21 Jan 2023 #51
Good for them. I don't hold that much weight in them. ificandream Jan 2023 #52
Many of us ignore polls - I can't help it, I've lived through too many elections FakeNoose Jan 2023 #54

ColinC

(11,098 posts)
1. They are wonderful, actually. And will likely have no trouble finding another home.
Mon Jan 23, 2023, 09:48 PM
Jan 2023

Just like they did after the NYTimes dropped them.

Fiendish Thingy

(23,236 posts)
7. I disagree
Mon Jan 23, 2023, 11:03 PM
Jan 2023

Silver’s intransigence in refusing to admit his error in handling the flood of shitty polls in the final weeks of the 2022 campaign is far more serious than any past missteps he may have made.

Happy Hoosier

(9,535 posts)
22. It is a little odd to me.
Tue Jan 24, 2023, 10:21 AM
Jan 2023

In the past, he has been quick to drop sources that appear to have partisan intent, even if methods they claim they use are sound. His refual to even seriously engage on this publicly makes his analysis increasingly suspect IMO.

Not to mention, a seeming lurch to the right in some of his public statements on Twitter.

Demsrule86

(71,542 posts)
33. I disagree...Silver allowed the right wing to put fake poll out and acted like they were real.
Wed Jan 25, 2023, 12:30 AM
Jan 2023
 

The_Casual_Observer

(27,742 posts)
2. Seems to.me that NPR lead the "Red Wave" was inevitable narrative
Mon Jan 23, 2023, 09:50 PM
Jan 2023

From the very start. Mara Liasson was on there everyday the day after the 2020 election talking shit about it endlessly.

a kennedy

(35,980 posts)
9. Mara Liasson has always been a right side hack.....in my humble opinion. Years ago when she
Mon Jan 23, 2023, 11:23 PM
Jan 2023

started at NPR I always thought she had quite a different slant to her stories. JMHO. Never cared for her at all.

 

The_Casual_Observer

(27,742 posts)
12. A pain in the ass that is shown too much respect. Her unfounded
Tue Jan 24, 2023, 02:08 AM
Jan 2023

Opinions are always couched in "the people believe..." it's horrible it's been horrible for 30+ years.

MerryBlooms

(12,248 posts)
32. I was unfamiliar with Mara Liasson, so looked her up-
Tue Jan 24, 2023, 11:09 PM
Jan 2023
https://www.thepanthernewspaper.org/politics/24jo6hob4zmpwi2glyhzd5zj1mu7st

I'm on my phone, and not sure how to post a snippet... But from this article, she doesn't seem to be promoting a Red Wave narrative to me. I only listen to NPR in my car during work commute. Could you please link to her Red Wave, narrative? I would like to have a full balance before I form an opinion. 🤗
 

The_Casual_Observer

(27,742 posts)
49. If you are unfamiliar with Mara you are unfamiliar with the
Fri Jan 27, 2023, 02:53 PM
Jan 2023

Last 3 years of Mara's inevitably of the red wave. She was on "Morning Edition" at least 3 times a week with it and on Fox news as well. I can't help that you are unaware of this.

 

Sky Jewels

(9,148 posts)
4. Hell, even I saw that the red wave was not materializing.
Mon Jan 23, 2023, 10:00 PM
Jan 2023

I have the posts to prove it, too.

Demsrule86

(71,542 posts)
34. I saw it too and was ridiculed here and even my son gave me a hard time...his first words to
Wed Jan 25, 2023, 12:33 AM
Jan 2023

me after the election were 'don't say I told you so!' I would never...well maybe.

Fiendish Thingy

(23,236 posts)
5. It's not as simple as Silver being a right wing tool
Mon Jan 23, 2023, 10:57 PM
Jan 2023

Silver takes great pride in his modeling system, how it runs thousands of election simulations, with weighting and adjustments based on a polling house’s history of reliability and accuracy.

In the 30 days leading up to the midterms, several polling houses with right leaning biases, biases which Silver’s model is supposed to adjust for, flooded the media with shit- polls with questionable methodology that were so far away from results of other polls, it should have triggered alarm bells.

The purpose of this flood of outliers was to deliberately shift the averages in the poll aggregations, and create the illusion of a last minute shift to a Red Wave.

What did Silver do? He doubled down and refused to adjust his model. Maybe it was too costly, time consuming or labor intensive to do so. Silver could have said so, and either put a disclaimer/asterisk on his model’s projections, or suspended making projections.

What did he choose to do?

He shrugged and said “Democrats could also flood the zone with shitty polls themselves if they wanted to”, and continued with business as usual.

In the past, when a pollster was caught pulling stunts like this, Silver would ban them and exclude them from his aggregation and projection model, at least after the election when the dust had settled. I have seen no reports of 538 banning any pollsters in the wake of the 2022 “Flood the Zone” wave of shitty polls.

That doesn’t mean Silver is a right wing tool; it does call into question his integrity as a statistician, one who is apparently unwilling to admit to errors or adjust his practices moving forward. The question that needs to be asked, and answered is : did Silver prioritize clicks over accuracy?

Polybius

(21,900 posts)
6. The only Senate seat that was off was NV, and even in that the Republican was barely leading
Mon Jan 23, 2023, 11:02 PM
Jan 2023

I don't know why they predicted that Republicans would win the Senate.

Sympthsical

(10,969 posts)
10. They didn't predict it
Mon Jan 23, 2023, 11:31 PM
Jan 2023

They said they won in 59% of simulations.

59% isn't in any sense a kind of galloping certainty. People act as if he stuck a 90% sticker on there.

People keep claiming these polls were the worst ever and all the pollsters are biased, etc. etc. etc. I don't get it. I'm a lay person of no particular consequence but some education. I looked at the same polls everyone else did. I posted my predictions on DU and got the House and Senate . . . exactly right.

The polls were fine. The media were a chaotic mess.

There's just too much, "Polls I like are good. Polls I don't are bad," that floats around the issue. People are confusing the media with the data. I thought the data for midterms was fantastic. Gave me a good sense of what was happening, what was important, what was factored in already, etc. And it all came out pretty much as the polls said it would.

Yeah, there were some surprises here and there (DeSantis by 20), but overall things went as expected.

Demsrule86

(71,542 posts)
37. A red wave was predicted...because of deliberate right wing bullshit polls. It didn't happen and
Wed Jan 25, 2023, 12:43 AM
Jan 2023

there really is no defense for any of them.

Demsrule86

(71,542 posts)
35. Oh please there was no red wave and you posted that there would be...we gained a Senate seat!
Wed Jan 25, 2023, 12:37 AM
Jan 2023

That never happens for the president's party during a first midterm... and the handwringing posts about Hobbs and Fetternam were everywhere...I said the first debate hurt Oz not Fetteran as Oz totally f'd up the abortion question...most disagreed.

Polybius

(21,900 posts)
47. I think you misunderstood me
Wed Jan 25, 2023, 01:33 PM
Jan 2023

I'm saying the Senate polling wasn't far off. I'm also saying that no one should have said a Red Wave was coming, since they accurately predicted every race except Nevada. Even if Nevada went Red, Republicans wouldn't have won the Senate.

I also didn't post that there would be. By November I predated Fetterman would win by 4. I got two Senate seats wrong in my final prediction.

Cosmocat

(15,424 posts)
16. He is like 99% of the other people who break into the top echelon of corporate media
Tue Jan 24, 2023, 08:12 AM
Jan 2023

The right brow beats them into submission, while they look at who is cutting them their checks.

The game is the game - the corporate media has a very clear set of basic marching orders, prop up Rs and slag on Ds.

You play that game, you can have a long career making good $, see Andrea Mitchell, heck even Chris Mathews, an actual lefty did it. I had it with him early in the 2000s when he just flat out said shit like, "Rs are just good on national security, just the way it is" live on his show after they lost interest in OBL, lied the country into Iraq and bungling the hell out of it. He kept being the hapless dipshit he was on the air for another decade until he got me too'd.

I swore Chuck Todd was left leaning when he was a low level CSPAN contributor, but the more he moved up , the more he sold out.

Whatever Nate's basic inclination, one he was was sucked into big $ corporate media, he knew what he had to do, you saw the derisive way he talked about "liberals" while he did things like this.

former9thward

(33,424 posts)
8. The polls were not that far off.
Mon Jan 23, 2023, 11:22 PM
Jan 2023

Nationally Rs won 50.6% of the vote and Ds 47.8%.

https://www.cookpolitical.com/charts/house-charts/national-house-vote-tracker/2022

Most of the polls were consistent with each other. Silver uses averages. He said the Rs were favored to win the House. They did. He was right.

https://projects.fivethirtyeight.com/2022-election-forecast/house/

He forecast a R win in the Senate but only gave them 59% chance. The Ds had a 41% chance to win. So the 41% won. People just don't know how to read statistics. 59% is not 100% and 41% is not 0%.

https://projects.fivethirtyeight.com/2022-election-forecast/senate/

Sympthsical

(10,969 posts)
11. I have no idea where this "The polls were super wrong" narrative is coming from
Mon Jan 23, 2023, 11:32 PM
Jan 2023

They were really good this year. Anyone who read through their data knew what the election would look like.

Thanks for the links.

Just_Vote_Dem

(3,645 posts)
15. Because for weeks they predicted a huge red wave that never happened
Tue Jan 24, 2023, 07:54 AM
Jan 2023

Perhaps it was the analysis that was more off, but for example, no one picked up Desantis winning by 20%, and there were others.

Sympthsical

(10,969 posts)
17. The media and the data are not the same things
Tue Jan 24, 2023, 08:40 AM
Jan 2023

People were obsessing over the commentary more than they were paying attention to the data and the facts.

There's not much to be done for that other than pointing out for the billionth time that narrative is more precious than information in this day and age and it's an enormous problem in our politics.

Every election is going to have outliers and wrong polls. It's never 100%. I've used DeSantis many times as the example of probably the most off prediction I saw. However, that doesn't change the fact that the data was overwhelmingly pretty sound. As the previous poster points out, Republicans actually won the national popular vote by 3%. That should have slightly favored them in the Senate. And that's all Nate Silver said. "Slightly favored." People are acting like he said, "They're 100% going to win, slam dunk, take it to the bank and deal with it." It's revisionist when google is right there.

At some point, pushing fiction to maintain narrative has to be called out. I'm calling it. The data was good. The internet commenting and media were awful. People ignored objective information and continue ignoring it. All anyone has to do is take a minute and go back to look at what the polls said - not the media stories, not the twitter commentary - the polls.

They were good this time. Objectively good.

Just_Vote_Dem

(3,645 posts)
18. But the commentary IS the important thing
Tue Jan 24, 2023, 08:54 AM
Jan 2023

The people providing the commentary know that most people don't have the time or the inclination to pore over all of the data, so a narrative is given. And generally it is manipulated by those who don't have the best interest of the majority of Americans.

Why can't we just admit that a majority of media is owned by right-wing interests who create a narrative that is hurtful to most people, instead of blaming those who are basically assaulted daily with nonsense in order to keep them "in line"? I don't like blaming victims.

Sympthsical

(10,969 posts)
21. But that's not what people are saying
Tue Jan 24, 2023, 09:56 AM
Jan 2023

This thread is about Nate Silver. He's horrible and super wrong and deserves to be fired from wherever. And the justification for these feelings are that his data were bad. There is a claim and feeling he made predictions he did not. There's a narrative about him at play - not facts. And this keeps happening around other discussions of polls.

If we cannot say what is simple and true and have to contort into an idea of what we think or want to be true or what we believe on faith, what's the point? What are we all doing here? I didn't sign up for a church.

The media problem is simple. Stop. Watching. Them. When people talk, the money listens. The media know drama, tension, horse race, fear, anxiety, and keeping people picking at each other in polarized sides sells. They know where our eyeballs go and they do everything they can to ensure we keep returning to it.

For all the complaining I read here every single day about the media, people seem awfully glued to it. I wake up at 5am every morning, pour a cup of coffee, and spend time catching up on news, social media, random things - including here. Before I've taken the first sip, I'll already have seen multiple threads of, "Can you believe what this person I don't like on this right-wing channel I hate (which is, uh, MSNBC) is outrageously saying to outrage?"

It's like watching alcoholics blame the beer distributors. Eventually people have to take responsibility. When does accountability for our own behavior start kicking in here? Fox News is 40% Democratic viewers. Like, tf . . . Stop. Watching.

BumRushDaShow

(169,757 posts)
23. "more than they were paying attention to the data and the facts."
Tue Jan 24, 2023, 10:24 AM
Jan 2023

The "data" that 538 chose to use for this 2022 mid-year cycle was heavily weighted on KNOWN partisan outfits that they only tacitly admitted to. I.e., nonsense like Trafalgar and InsiderAdvantage, and in the most ludicrous move, a pair of high school juniors from just outside of here in Philly who created an outfit called Patriot Polling, who claim on their site to be "non-partisan" but was co-founded by self-identified GOP member.

There was an OP last month that discussed a NYT an analysis on what happened with the 2022 election and at 538 (notably since they were an outfit that NYT had contracted in the past and had given them their lifeblood boost back in the day) - https://www.nytimes.com/2022/12/31/us/politics/polling-election-2022-red-wave.html

No paywall

The ‘Red Wave’ Washout: How Skewed Polls Fed a False Election Narrative

The errant surveys spooked some candidates into spending more money than necessary, and diverted help from others who otherwise had a fighting chance of winning.


By Jim Rutenberg, Ken Bensinger and Steve Eder
Dec. 31, 2022

(snip)

But a New York Times review of the forces driving the narrative of a coming red wave, and of that narrative’s impact, found new factors at play. Traditional nonpartisan pollsters, after years of trial and error and tweaking of their methodologies, produced polls that largely reflected reality. But they also conducted fewer polls than in the past. That paucity allowed their accurate findings to be overwhelmed by an onrush of partisan polls in key states that more readily suited the needs of the sprawling and voracious political content machine — one sustained by ratings and clicks, and famished for fresh data and compelling narratives.

The skewed red-wave surveys polluted polling averages, which are relied upon by campaigns, donors, voters and the news media. It fed the home-team boosterism of an expanding array of right-wing media outlets — from Steve Bannon’s “War Room” podcast and “The Charlie Kirk Show” to Fox News and its top-rated prime-time lineup. And it spilled over into coverage by mainstream news organizations, including The Times, that amplified the alarms being sounded about potential Democratic doom.

The virtual “bazaar of polls,” as a top Republican strategist called it, was largely kept humming by right-leaning pollsters using opaque methodology, in some cases relying on financial support from hyperpartisan groups and benefiting from vociferous cheerleading by Mr. Trump. Yet questionable polls were not only put out by Republicans. The executive director of one of the more prominent Democratic-leaning firms that promoted polls this cycle, Data for Progress, was boasting about placing bets on election outcomes, raising at least the appearance of a conflict of interest.

Other pollsters lacked experience, like two high-school juniors in Pennsylvania who started Patriot Polling and quickly found their surveys included on the statistical analysis website FiveThirtyEight — as did another high school concern based at Phillips Academy in Andover, Mass.

(snip)


For a local example here in PA, the mess that came out from 538 about Fetterman's race was a case in point.



ACTUALS



That linked piece in the NYT is long but very comprehensive and worth a read. It carefully separates out the "data" crunching outfits - i.e., that from the 538s and RCPs that spit out what became a skewed "expectation" using heavily RW-weighted polls because there were "more of them" available to throw in their toxic stew vs the party internal polls, and how the media opted to go with the 538-RW lean, and actually insulted and skewered those who protested despite their actually HAVING the more accurate "data".

Sympthsical

(10,969 posts)
24. They also used YouGov and Morning Consult
Tue Jan 24, 2023, 10:59 AM
Jan 2023

Which are heavily, heavily tilted Democratic and always have been because they're mostly voluntary paid internet surveys (but apparently never worth commentary in a discussion of polls that are off for some mysterious reason). And if you don't believe me, check out their final results for 2020 and 2022. They are way to the left of where the results ended up. In some cases, way way way off in our favor.

And that article you're citing agrees with me. The overall accuracy was really good. The narrative was fucked. I'm not arguing against that. I'm not arguing that there weren't some shitty polls in all of it. I am arguing that if you took the data sets available and said, "What's going to happen November 8th?" the information was about as accurate as one could expect and pretty damn good considering the previous three elections.

I'm saying if you had ignored the narrative and looked at the data, the data was fine for the most part. Not perfect, because no election polling ever is. But if you cared about the data and not the narrative, the election results were not a surprise.

I looked at the polls before the PA election. I called Fetterman by 2-3% (it's in my history). I'll say now what I said then - I think early and mail voting did him a lot of favors. Look at the numbers in your graph. That debate was a trainwreck, but many people had already voted. I think polls shifted after that debate - as borne out right there in your graph - but early voting kept the results more in his favor. Silver was off by 6% in the end results, but I don't think he was 6% off in what people were thinking at the time the final surveys were taken. If everyone had voted after the debate, those results would have looked a lot closer to Silver's numbers, IMO.

BumRushDaShow

(169,757 posts)
27. In response
Tue Jan 24, 2023, 12:44 PM
Jan 2023
Which are heavily, heavily tilted Democratic and always have been because they're mostly voluntary paid internet surveys (but apparently never worth commentary in a discussion of polls that are off for some mysterious reason). And if you don't believe me, check out their final results for 2020 and 2022. They are way to the left of where the results ended up. In some cases, way way way off in our favor.


When has "YouGov been "heavily tilted Democratic"? YouGov is a UK Conservative-founded outfit that expanded beyond the UK into other countries including the U.S.

And that article you're citing agrees with me. The overall accuracy was really good. The narrative was fucked. I'm not arguing against that. I'm not arguing that there weren't some shitty polls in all of it. I am arguing that if you took the data sets available and said, "What's going to happen November 8th?" the information was about as accurate as one could expect and pretty damn good considering the previous three elections.


No it doesn't. You apparently didn't read it. The increase of "shitty polls" is what created the 2022 mess that 538 put out there. It's simply "garbage in garbage out".

I explicitly highlighted the problem that they ran into that they didn't have a way to correct, so they just stuffed MORE RW-leaning polls into their regurgitated nonsense.

I'll separate out the part so that it is easily seen -

But a New York Times review of the forces driving the narrative of a coming red wave, and of that narrative’s impact, found new factors at play. Traditional nonpartisan pollsters, after years of trial and error and tweaking of their methodologies, produced polls that largely reflected reality. But they also conducted fewer polls than in the past. That paucity allowed their accurate findings to be overwhelmed by an onrush of partisan polls in key states that more readily suited the needs of the sprawling and voracious political content machine — one sustained by ratings and clicks, and famished for fresh data and compelling narratives.


I'm saying if you had ignored the narrative and looked at the data, the data was fine for the most part. Not perfect, because no election polling ever is. But if you cared about the data and not the narrative, the election results were not a surprise.


The average voter, let alone the average non-politically geeky person is NOT going to just cherry-pick and "look at the polls". They end up (because there is more to life than "politics" ) getting spoon-fed "a narrative" and that "narrative" is informed from the data aggregators like 538. So when bad data is input into their aggregated models, the results are thrown off. Meanwhile the media will use that to inform their own opinions for how things will go.

This had gotten so bad that those who DID have better data, were laughed at by big media (this was in the article that you didn't read).

Shaping perceptions across the ideological spectrum, the steady flow of data predicting a red wave prompted real-world decision-making that members of both parties now say could have tilted the balance of power in Congress.

“These frothy polls had a substantial, distorting impact on how people spent money — on campaign strategy, and on people’s expectations going into the election,” said Steven J. Law, the chief executive of the Republicans’ Senate Leadership Fund, which poured $280 million into the midterms. Its own private polling showed no red wave at all.


So with the above news flash, even the big GOP outfits like Turtle's Senate Leadership Fund, KNEW there was no "red wave", yet the narrative persisted thanks to the shit that 538 and RCP were selling.

I looked at the polls before the PA election. I called Fetterman by 2-3% (it's in my history). I'll say now what I said then - I think early and mail voting did him a lot of favors. Look at the numbers in your graph. That debate was a trainwreck, but many people had already voted. I think polls shifted after that debate - as borne out right there in your graph - but early voting kept the results more in his favor. Silver was off by 6% in the end results, but I don't think he was 6% off in what people were thinking at the time the final surveys were taken. If everyone had voted after the debate, those results would have looked a lot closer to Silver's numbers, IMO.


What? The issue here is aggregators like 538 and their "prediction" that Fetterman would LOSE by "0.5%" and the actual result was of him winning by almost 5%, which was outside of 538's margin of error.

Similarly a prediction of a Josh Shapiro 10% margin win ended up in an almost 15% one instead - https://projects.fivethirtyeight.com/2022-election-forecast/governor/pennsylvania/



ACTUALS (https://www.electionreturns.pa.gov/General/SummaryResults?ElectionID=94&ElectionType=G&IsActive=1)



So 538 blames it all on "Democrats 'outperforming partisan lean'" - https://fivethirtyeight.com/features/candidate-quality-mattered/



(meaning THEIR "partisan lean" )

It's this type of "garbage" that begs that the "business" needs to change its models.

Here in PA, despite yet another "narrative" that seems to promote the idea that Democrats ONLY "vote by mail". MOST DEMOCRATS here in the state of PA voted IN PERSON, which would be the DAY OF the election. AND here in Philly, the biggest city AND county in the state of PA, they did so by an almost 3-1 margin - (from here - https://results.philadelphiavotes.com/)



The state of PA has no "early voting", only "no excuse absentee (mail) ballots" or regular "absentee" (mail) ballots and otherwise voting "in person", and many of those mail ballots were sent out late due to printing errors or in the case of Philly, due to a snafu of needing to hold special elections for 4 City Council Reps who resigned to run for mayor in the 2023 mayoral race, they needed to set aside time for assigning ballot numbers for those candidates before they could print and mail the ballots.

The "narrative" of what happened in the debate supposedly torpedoing Fetterman's chances was the same type of RW bullshit ALSO embraced on DU that insisted that "the little woman" was more fucking interested in "inflation" and "the price of eggs" than ROE V WADE, and that we "better ditch the 'Roe talk'" and focus on "inflation" and "Social Security".

BumRushDaShow

(169,757 posts)
29. You are welcome and that December DU OP on this 538 poll bias issue
Tue Jan 24, 2023, 07:29 PM
Jan 2023

was an eye opener for me and I saw it first hand with what transpired here in PA with John Fetterman!

https://www.democraticunderground.com/100217509947

When Gallup messed up the 2012 general election predicting that Mitt Romney would win, after their mea culpa, USA Today, that had partnered with them for polling, dropped them after a 20-year relationship, and Gallup stopped doing the daily tracking polls for Presidential election trial heats.

BumRushDaShow

(169,757 posts)
31. Thank you
Tue Jan 24, 2023, 09:43 PM
Jan 2023

It was very very frustrating here in PA with what they were doing with the narratives AND a lack of quality polls. So there was all the "guessing" and unabashedly filling in the gaps in the number of reliable non-partisan polls, with RW drivel ones.

A HUGE case in point is that NO ONE predicted that Democrats would flip the PA State House. NO ONE.

We gained 12 seats (for 102 (D) - 101 (R) majority) and right now, pending a special election for 3 (D) seats (1 to replace a state Rep. who passed away just before this past election, 1 to replace a Rep. who is now a brand new member of Congress, and 1 to replace a Rep. who resigned to become Lt. Governor), the chamber is at a standstill.

The GOP refuses to stand down so through an odd election of a (D) who indicated that he would govern as an (I) as Speaker (and not the GOP retaining the Speakership since we are still due to have the special elections where Democrats WILL BE in the majority), the state House is not in session, and the GOP is throwing fits.

I say tough shit.

So this is the type of thing that the aggregators missed and the so-called "accurate" polls ALSO missed. And this repeated in other states as well because Democrats managed to gain something like (IIRC) 4 "Trifectas". This in a year where there was a guaranteed RED TIDE that would wipe Democrats off the face of the earth.

W_HAMILTON

(10,333 posts)
53. Races Called Correctly per FiveThirtyEight:
Fri Jan 27, 2023, 07:49 PM
Jan 2023

89% - YouGov
83% - Morning Consult
67% - InsiderAdvantage (Opinion Savvy)
66% - Trafalgar

Sympthsical

(10,969 posts)
55. This is an extremely dishonest use of statistics
Fri Jan 27, 2023, 09:04 PM
Jan 2023

Which you and I have tussled over before. I just don't understand the point of discussing data when it will be misrepresented and misused. It's just us. No one else cares. The performative nature feels so pointlessly out of place.

I noted in my reply that Morning Consult tilts heavily left.

https://projects.fivethirtyeight.com/pollster-ratings/morning-consult/

I shared this with you before. It got ignored before. I suspect it will be again. However, go down the list and see where and how they were off. It backs up my statement that they have a heavy tilt.

Your response has nothing to do with my words and arguments. Literally zero.

Which has kind of become drearily the norm with these things. Which is why I ask, I don't get who this is for. Is it an audition for something?

W_HAMILTON

(10,333 posts)
56. LOL!
Fri Jan 27, 2023, 09:23 PM
Jan 2023

Using numbers from their own website that judges how accurate each of these pollsters end up being in hindsight is being "extremely dishonest?"



No, I would say conflating inevitable leans from nonpartisan and relatively accurate pollsters with propaganda polling from partisan and inaccurate pollsters is what is "extremely dishonest" here.

 

The_Casual_Observer

(27,742 posts)
13. .it was the accompanying commentary that was relentlessly pushing
Tue Jan 24, 2023, 03:00 AM
Jan 2023

The inevitability of the red wave for two solid years prior. Cook was the worst followed closely by 538. On election day Cook was essentially calling it for the republicans by 9AM in AZ.

Demsrule86

(71,542 posts)
36. The polls were completely off there was no red wave and only three times in history have we
Wed Jan 25, 2023, 12:39 AM
Jan 2023

we've seen something like...let's not rewrite history by cherry-picking bad polls.

BumRushDaShow

(169,757 posts)
19. Good
Tue Jan 24, 2023, 08:57 AM
Jan 2023

The lack of a mea culpa analysis from more than just one guy and not even from Silver himself, means he's no longer ready for "prime time". And not only wasn't there a "well let's take a look at what might have gone wrong", he doubled down.

The one 538 guy who IMHO, did the right thing, I posted about here - https://www.democraticunderground.com/?com=view_post&forum=1002&pid=17510055

and in part -

What I Got Wrong In 2022

By Nathaniel Rakich

Dec. 28, 2022, at 6:00 AM


Here’s a prediction that 100 percent, absolutely, positively will come true: I will get something wrong in 2023. Here at FiveThirtyEight, we make a lot of predictions every year; some of them work out, but we can’t get every single one right.  We can, however, learn from our mistakes. That’s why I like to write about everything I got wrong in the previous 12 months.1 I do this for two reasons: First, they’re often unintentionally hilarious (and when you’re a politics reporter, sometimes you need a laugh); second, identifying my blind spots has helped me become a better analyst.

And there’s no shortage of material for this year’s installment. Let’s start with a tweet I wrote on Nov. 6, 2020, shortly after it became clear that Joe Biden had won the presidential race: “Congratulations to Republicans on their victory in the 2022 midterms!” This was obviously meant to be snarky but also to communicate a political tenet: that the president’s party almost always has a bad midterm election. Of course, that tweet wasn’t from 2022, but I also made this argument in January of this year. And for several months thereafter, my analysis was colored by my expectation that 2022 would be a good election year for Republicans. As everyone knows by now, the midterms were a disappointment for Republicans. They won the House — but only barely (they gained just nine seats on net). Meanwhile, Democrats gained a seat in the Senate.



Clearly, I was overly confident in my early prediction. While it is true that the president’s party almost always has a poor midterm, there have been exceptions. And the 2022 midterms turned out to be one of these “asterisk elections,” thanks in no small part to the Supreme Court’s decision in Dobbs v. Jackson Women’s Health Organization to overturn the constitutional right to abortion. This year I should have been more prepared for the possibility that the ruling could throw a wrench into the election, especially after a draft of the decision was leaked in May. And even after the decision, it took me a while to become convinced that voter anger over Dobbs would prove durable enough to last until Election Day.

It wasn’t until the fall that I revised my expectations from a “red wave” to a “red ripple.” My biggest mistake here was not realizing just how common an “asterisk election” actually is. I often quoted one key stat: that the president’s party had gained House seats in only two of the previous 19 midterm elections. But there were four other midterms where the president’s party lost fewer than 10 House seats — so what happened in 2022 isn’t that rare. I also neglected to remember that the president’s party had lost Senate seats in only 13 of the last 19 midterms. In other words, midterms like 2022 happen about a third of the time — way too frequently to count them out.

(snip)

https://fivethirtyeight.com/features/2022-predictions-i-got-wrong/


And I also added the following comment -

As a "numbers" person, rather than actually LOOK IT UP and calculate what REALLY happened in the past, they just repeated the false narrative for what they assumed happens during midterms.

The ballot initiative in Kansas that was 2-1 defeating a state Constitutionally-imposed abortion ban was a fucking blaring klaxon to the media. But what did they do with that? Dismissed it and assumed that the "little woman" would just wave it away because (buzzword) "inflation".


When Gallup fucked up the 2012 "Presidential horse race trials" daily tracking, they did a review and published an analysis (one of places I had posted about that recently for comparison is here - https://www.democraticunderground.com/?com=view_post&forum=1002&pid=17327130)

where I included (in part) -

And eventually the mea culpa had to happen and they released a final analysis of what went wrong (PDF), their partner USA Today officially dropped them as a partner after that, and Gallup no longer does this poll -


Gallup identifies flaws in 2012 election polls


Martha T. Moore
USA TODAY
Published 2:24 p.m. E.T. June 4, 2013 | Updated 5:02 p.m. ET June 4, 2013



WASHINGTON – Pollsters at Gallup said Tuesday they have identified flawed methods that contributed to their incorrect prediction that Mitt Romney would win the 2012 presidential election, but they are still working to determine how to better identify who is likely to vote.

The survey firm undertook a far-reaching review of its operations after its surveys came up short in the election: Gallup's final pre-election estimate showed Romney with 49% support to Obama's 48%, with a margin of error of +/-2%. Most polls estimated Obama would win the popular vote by 1 percentage point. Obama won the popular vote by 3.85 points.

In pre-election polling, Gallup consistently showed Romney with a 3-percentage point lead over Obama. When Gallup switched to surveying only "likely voters," Romney's edge increased to 4 percentage points.

Gallup, with researchers from the University of Michigan, will experiment with ways to better identify likely voters in surveys during the 2013 governor's races in New Jersey and Virginia. Gallup asks seven questions in its phone surveys to determine whether people are likely to vote – a questionnaire that may rely too much on past voting and on how much "thought" voters have given to the election, Gallup Poll editor in chief Frank Newport said. Though all polling outfits showed an increase of support for Romney among likely voters vs. registered voters, Gallup's bump for Romney was the most extreme. "We really are re-evaluating that from square one," Newport said.

(snip)

https://www.usatoday.com/story/news/politics/2013/06/04/gallup-poll-election-obama-romney/2388921/
 

Laura PourMeADrink

(42,770 posts)
20. Nate Silver is a right wing tool now. LOL
Tue Jan 24, 2023, 09:32 AM
Jan 2023

He's a statistician number cruncher. Doubt he's got the staff to thoroughly investigate every single poll that comes out. Hell, it took a lot of people days to figure it out to begin with back then. Obviously Rs figured out how to beat the system toward the end when time was running out..

Who else does what 538 does? Real Clear Politics, NY Times. Did they do a lot better than 538? It should be interesting to see who ABC picks. Seems way too short-sighted at this point in my humble opinion.




 

Laura PourMeADrink

(42,770 posts)
40. Interesting. But jeez they just take numbers and crunch.
Wed Jan 25, 2023, 12:55 AM
Jan 2023

People act like they're devil incarnate. They just take polls and average them. Now they are expected to vouch for every poll out there?. I would just say, ok YOU do it you just start looking at every poll individually and decide.

 

Laura PourMeADrink

(42,770 posts)
41. Hell it took us a while... Why would he be expected to
Wed Jan 25, 2023, 01:00 AM
Jan 2023

to instantly know? At the time everyone was starving for info. That's what he's guilty of, trying to feed the beast. Let everyone figure it out on their own from now on! No consolidating statisticians !!!!!

themaguffin

(5,221 posts)
44. Not instant, it's his stubborn stance when known. I'm not a Nate hater. I just think that was
Wed Jan 25, 2023, 10:05 AM
Jan 2023

at best not a good look for him to dig in and let's be real, it's a lot worse in context.

Again, I don't dislike him. He has done a segment on ABC's This Week and still watched it even. I think that he can redeeem himself, but yeah, his response (or lack thereof) was ridiculous.

 

Laura PourMeADrink

(42,770 posts)
48. Somehow ABC and 538 are affiliated. Haven't looked up how.
Wed Jan 25, 2023, 09:39 PM
Jan 2023

I'll have to dig deeper because haven't seen his initial reaction to some bad polls seeping in toward the end. Everything I have read that he writes - he's very open about where his assumptions were wrong and stresses that he's not a pollster

 

Laura PourMeADrink

(42,770 posts)
42. They have proof that Nate Silver
Wed Jan 25, 2023, 01:06 AM
Jan 2023

knew some polls were jive? No way would I ever believe this!!! The man ( if you read his book) doesn't even care about politics!!!

Think ABC wants out for other reasons. Just my opinion

ificandream

(11,837 posts)
43. Polls are always a gamble.
Wed Jan 25, 2023, 01:07 AM
Jan 2023

The media talked a lot about a possible red wave in November. He wasn't alone.

 

inthewind21

(4,616 posts)
51. In other news
Fri Jan 27, 2023, 04:13 PM
Jan 2023

There are posts in GD right now boasting about some poll favorable for D's.

ificandream

(11,837 posts)
52. Good for them. I don't hold that much weight in them.
Fri Jan 27, 2023, 07:33 PM
Jan 2023

Granted, they can be right. But they can also be wrong. Some pollsters were predicting a red wave in the midterms. Look how that worked out.

FakeNoose

(41,634 posts)
54. Many of us ignore polls - I can't help it, I've lived through too many elections
Fri Jan 27, 2023, 08:19 PM
Jan 2023


On the other hand, I was very optimistic for a Dem sweep in Pennsylvania. We knew Josh Shapiro would beat Doug Mastriano. And there was no way John Fetterman (our newest Senator) would lose to Dr. Oz. Even in the smaller races many new Dems rode the coattails of Shapiro and Fetterman, which flipped the Pennsylvania House of Representatives to BLUE for the first time in 12 years.

It didn't matter to me what the national pollsters were saying. I knew what was happening in my home state.

Latest Discussions»General Discussion»Nate Silver and FiveThirt...