<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:atom="http://www.w3.org/2005/Atom">
<channel><title>Baril Musings — Pollsters are still asking the wrong question.</title><link>https://barilmusings.com/pollsters-are-still-asking-the-wrong/</link><description>One article by Dan Baril, with its complete text and original illustration.</description><language>en</language><atom:link href="https://barilmusings.com/pollsters-are-still-asking-the-wrong/feed.xml" rel="self" type="application/rss+xml"/>
<item><title>Pollsters are still asking the wrong question.</title><link>https://barilmusings.com/pollsters-are-still-asking-the-wrong/</link><guid isPermaLink="true">https://barilmusings.com/pollsters-are-still-asking-the-wrong/</guid><pubDate>Fri, 28 Aug 2026 12:00:00 GMT</pubDate><dc:creator>Dan Baril</dc:creator><description><![CDATA[<p><em>Ten years after Trump shocked America, voting intention may be the least interesting thing we could measure</em></p><p><img src="https://barilmusings.com/assets/3.webp" alt="Illustration for Pollsters are still asking the wrong question."></p><p>Nearly ten years ago, on November 9, 2016, the morning after Donald Trump shocked America and much of the world by being elected President of the United States, I wrote a piece titled “Pollsters not wrong, they merely failed to ask the right question.”</p><p>My argument wasn&#x27;t that pollsters couldn&#x27;t count. It was that they were measuring the wrong thing. Ask people, “Who are you going to vote for?” and they&#x27;ll give you an answer. Properly sample enough of them, weight the responses appropriately, and you&#x27;ll get a number. But that number doesn&#x27;t necessarily tell you what&#x27;s going on underneath.</p><p>In 2016, I wondered whether conventional polling was missing an underlying sentiment toward Trump - people who wanted change, people reluctant to admit their support publicly, and people simply saying, damn the torpedoes, let&#x27;s try something different.</p><p>I ended that piece wondering whether America had elected what I rather impolitely described as “Howard Stern, the buffoon,” or whether Donald Trump (like Stern) possessed another side - intelligent, insightful, reasonable and considerably less buffoonish. I finished with three words: Time will tell.</p><p>Well, time told.</p><p>Ten years later, I&#x27;m less interested in telling you what it told us than in knowing what Americans think it told them. And once again, I think pollsters may be asking the wrong question.</p><h2>THE MEASUREMENT PROBLEM</h2><p>With all due respect to an industry that was my career beginning with Statistics Canada in 1976, most pollsters still don&#x27;t know how to bend the edges of the box when it comes to sampling and questionnaire design.</p><p>The first criterion is knowing precisely what you wish to measure; the second is knowing how to reach the appropriate sample; and the third is knowing what questions to ask - or, increasingly, what combination of quantitative and qualitative sentiments to record without introducing bias. By the way, in the right hands, AI is good at doing this. More on that another day.</p><p>Simply asking people how they intend to vote is old school. It&#x27;s useful and sometimes highly predictive, but it isn&#x27;t necessarily very informative. The answer to “Who will you vote for?” can be two or three layers removed from the attitudes, experiences, emotions and expectations that determine it.</p><p>This is why qualitative research - focus groups, in-depth interviews and simple human conversation - can be so important before quantitative measurement. It helps you discover what the hell you&#x27;re trying to measure. Then comes the quantitative phase. After the numbers come in, more qualitative research can answer the most interesting question of all: Why?</p><p>So what does this have to do with the current political climate in America? More importantly, what might it tell us about the path Americans - and inevitably much of the rest of the world - are on for the next two, five or ten years?</p><p>America has experienced - or perhaps been forced through - a tectonic shift, politically and geopolitically, at home and abroad. The purpose of this piece isn&#x27;t to argue whether that shift has been good or bad. We&#x27;ve had ten years of that, producing plenty of angst, anger and partisanship but remarkably little useful insight into where America may be heading.</p><p>For this exercise, we already have a pretty good idea how Democrats feel about Donald Trump. Pretty much all of them. Measure voter intention, enthusiasm, engagement and likelihood of showing up and you&#x27;ll learn much of what you need to know. Republicans, on the other hand, need a little dissecting. To say the least.</p><p>Let&#x27;s set aside the labels Republican and Democrat for a moment. Using the language you might hear at a family BBQ, on a golf course or around a bar - anywhere people talk when there isn&#x27;t a pollster standing in front of them - imagine several broad groups within the American electorate.</p><h2>BUCKET ONE</h2><p>I voted for Trump all three times and I&#x27;d do it again in a heartbeat. Hell, I hope he finds a way to run for a third term so I can vote for him again.</p><p>These aren&#x27;t simply Republican voters. They are Trump voters, and the distinction matters.</p><h2>BUCKET TWO</h2><p>I may or may not have voted for Trump in the past, but what he started needs to continue. Looking ahead, people such as JD Vance, Pete Hegseth or Marco Rubio are the guys I have confidence in going forward.</p><p>This may be the most important bucket. These aren&#x27;t necessarily Trump loyalists; they&#x27;re potentially Trumpism loyalists. If this group is large and growing, Trump has created something more consequential than an election victory: a movement capable of surviving him.</p><h2>BUCKET THREE</h2><p>Okay, that didn&#x27;t turn out quite the way I expected. If I had to do it over again, I might change my vote. Either way, it&#x27;s probably time for something different.</p><p>Conventional approval polling can easily misunderstand this group. Disappointment doesn&#x27;t necessarily mean conversion. Someone can be finished with Trump without becoming a Democrat; they can remain conservative, become politically homeless, vote independent or stay home.</p><h2>BUCKET FOUR</h2><p>That was an unmitigated disaster and America and the world will be paying the price for years to come. It&#x27;s time to give the Democrats another shot.</p><p>These people have crossed the bridge. Whatever they once thought about Trump, Republicans or the political experiment of the past decade, they&#x27;ve concluded that the answer lies in the opposite direction.</p><h2>THEY ARE HYPOTHESES, NOT SURVEY QUESTIONS</h2><p>Make no mistake, you are unlikely to find my wording on a survey instrument anytime soon. If you saw those statements verbatim on a professional questionnaire, there would be enough industry criticism to choke a horse. They aren&#x27;t survey questions. They are hypotheses.</p><p>They are the underlying sentiments I would want research to identify, refine and ultimately measure. That&#x27;s where the methodological creativity comes in. Don&#x27;t ask, “Are you a disappointed Trump voter?” or “Do you regret voting for Donald Trump?” or “Are you loyal to Trump or to MAGA?” Those questions practically beg respondents to tell you how they want to see themselves.</p><p>Instead, measure the components:</p><p class="bullet">Did the last ten years turn out better or worse than you expected?</p><p class="bullet">Would you vote for Trump again - or for a candidate he endorsed?</p><p class="bullet">Would you prefer a Republican who continues Trump&#x27;s policies but has a very different personality?</p><p class="bullet">Should the Republican Party continue in its present direction or change course?</p><p class="bullet">Could you imagine voting for a Democrat?</p><p class="bullet">Could you imagine not voting at all?</p><p class="bullet">Is America stronger or weaker than it was ten years ago?</p><p class="bullet">Which changes would you keep, which would you reverse, and related to this, how certain are you?</p><p>Don&#x27;t ask respondents which bucket they belong in. Let their answers tell you.</p><p>Use qualitative research first to discover the language and motivations conventional questionnaires may be missing. Build a quantitative instrument around what you learn, segment people by patterns across several questions rather than one convenient headline number, then return to qualitative research to find out what the numbers mean.</p><p>And most importantly: measure it again.</p><p>Six months later.</p><p>Then six months after that.</p><h2>MOVEMENT MATTERS MORE THAN THE SNAPSHOT</h2><p>The size of the buckets matters, but the movement between them matters even more. If Bucket One remains enormous, Trump&#x27;s personal political power survives. If people move from One into Two, something more historically significant may be happening: Trumpism is successfully separating itself from Donald Trump.</p><p>If Two begins moving into Three, the movement itself may be weakening. If Three grows but doesn&#x27;t move into Four, America could be heading toward political fragmentation rather than a Democratic realignment. And if Three begins flowing heavily into Four, the political pendulum hasn&#x27;t merely stopped. It&#x27;s swinging.</p><p>That&#x27;s what I&#x27;d want to measure - not another snapshot showing Republicans at 46%, Democrats at 47% and everybody arguing about the margin of error. Conventional voting-intention polling is pretty good at telling us where Americans stand today. What interests me is where they&#x27;re prepared to move tomorrow.</p><h2>THE QUESTION THAT MATTERS</h2><p>Ten years ago I argued that pollsters weren&#x27;t necessarily getting the answers wrong. They were asking the wrong question. Ten years later, I think we are in danger of doing it again.</p><p>The most consequential political question in America today isn&#x27;t “Do you approve of Donald Trump?” It isn&#x27;t even “Who would you vote for if an election were held tomorrow?” The question is:</p><p>After ten years of Donald Trump, what do Americans want America to become next?</p><p>Figure out how to measure that accurately - without telling respondents what answer you&#x27;re looking for - and then measure how those sentiments change over time.</p><p>The pollster with the balls and methodological creativity to do that won&#x27;t merely have a better chance of predicting the next election. He or she may be able to tell us where America is going for the next two, five and ten years.</p><p>Again, time will tell.</p>]]></description><content:encoded><![CDATA[<p><em>Ten years after Trump shocked America, voting intention may be the least interesting thing we could measure</em></p><p><img src="https://barilmusings.com/assets/3.webp" alt="Illustration for Pollsters are still asking the wrong question."></p><p>Nearly ten years ago, on November 9, 2016, the morning after Donald Trump shocked America and much of the world by being elected President of the United States, I wrote a piece titled “Pollsters not wrong, they merely failed to ask the right question.”</p><p>My argument wasn&#x27;t that pollsters couldn&#x27;t count. It was that they were measuring the wrong thing. Ask people, “Who are you going to vote for?” and they&#x27;ll give you an answer. Properly sample enough of them, weight the responses appropriately, and you&#x27;ll get a number. But that number doesn&#x27;t necessarily tell you what&#x27;s going on underneath.</p><p>In 2016, I wondered whether conventional polling was missing an underlying sentiment toward Trump - people who wanted change, people reluctant to admit their support publicly, and people simply saying, damn the torpedoes, let&#x27;s try something different.</p><p>I ended that piece wondering whether America had elected what I rather impolitely described as “Howard Stern, the buffoon,” or whether Donald Trump (like Stern) possessed another side - intelligent, insightful, reasonable and considerably less buffoonish. I finished with three words: Time will tell.</p><p>Well, time told.</p><p>Ten years later, I&#x27;m less interested in telling you what it told us than in knowing what Americans think it told them. And once again, I think pollsters may be asking the wrong question.</p><h2>THE MEASUREMENT PROBLEM</h2><p>With all due respect to an industry that was my career beginning with Statistics Canada in 1976, most pollsters still don&#x27;t know how to bend the edges of the box when it comes to sampling and questionnaire design.</p><p>The first criterion is knowing precisely what you wish to measure; the second is knowing how to reach the appropriate sample; and the third is knowing what questions to ask - or, increasingly, what combination of quantitative and qualitative sentiments to record without introducing bias. By the way, in the right hands, AI is good at doing this. More on that another day.</p><p>Simply asking people how they intend to vote is old school. It&#x27;s useful and sometimes highly predictive, but it isn&#x27;t necessarily very informative. The answer to “Who will you vote for?” can be two or three layers removed from the attitudes, experiences, emotions and expectations that determine it.</p><p>This is why qualitative research - focus groups, in-depth interviews and simple human conversation - can be so important before quantitative measurement. It helps you discover what the hell you&#x27;re trying to measure. Then comes the quantitative phase. After the numbers come in, more qualitative research can answer the most interesting question of all: Why?</p><p>So what does this have to do with the current political climate in America? More importantly, what might it tell us about the path Americans - and inevitably much of the rest of the world - are on for the next two, five or ten years?</p><p>America has experienced - or perhaps been forced through - a tectonic shift, politically and geopolitically, at home and abroad. The purpose of this piece isn&#x27;t to argue whether that shift has been good or bad. We&#x27;ve had ten years of that, producing plenty of angst, anger and partisanship but remarkably little useful insight into where America may be heading.</p><p>For this exercise, we already have a pretty good idea how Democrats feel about Donald Trump. Pretty much all of them. Measure voter intention, enthusiasm, engagement and likelihood of showing up and you&#x27;ll learn much of what you need to know. Republicans, on the other hand, need a little dissecting. To say the least.</p><p>Let&#x27;s set aside the labels Republican and Democrat for a moment. Using the language you might hear at a family BBQ, on a golf course or around a bar - anywhere people talk when there isn&#x27;t a pollster standing in front of them - imagine several broad groups within the American electorate.</p><h2>BUCKET ONE</h2><p>I voted for Trump all three times and I&#x27;d do it again in a heartbeat. Hell, I hope he finds a way to run for a third term so I can vote for him again.</p><p>These aren&#x27;t simply Republican voters. They are Trump voters, and the distinction matters.</p><h2>BUCKET TWO</h2><p>I may or may not have voted for Trump in the past, but what he started needs to continue. Looking ahead, people such as JD Vance, Pete Hegseth or Marco Rubio are the guys I have confidence in going forward.</p><p>This may be the most important bucket. These aren&#x27;t necessarily Trump loyalists; they&#x27;re potentially Trumpism loyalists. If this group is large and growing, Trump has created something more consequential than an election victory: a movement capable of surviving him.</p><h2>BUCKET THREE</h2><p>Okay, that didn&#x27;t turn out quite the way I expected. If I had to do it over again, I might change my vote. Either way, it&#x27;s probably time for something different.</p><p>Conventional approval polling can easily misunderstand this group. Disappointment doesn&#x27;t necessarily mean conversion. Someone can be finished with Trump without becoming a Democrat; they can remain conservative, become politically homeless, vote independent or stay home.</p><h2>BUCKET FOUR</h2><p>That was an unmitigated disaster and America and the world will be paying the price for years to come. It&#x27;s time to give the Democrats another shot.</p><p>These people have crossed the bridge. Whatever they once thought about Trump, Republicans or the political experiment of the past decade, they&#x27;ve concluded that the answer lies in the opposite direction.</p><h2>THEY ARE HYPOTHESES, NOT SURVEY QUESTIONS</h2><p>Make no mistake, you are unlikely to find my wording on a survey instrument anytime soon. If you saw those statements verbatim on a professional questionnaire, there would be enough industry criticism to choke a horse. They aren&#x27;t survey questions. They are hypotheses.</p><p>They are the underlying sentiments I would want research to identify, refine and ultimately measure. That&#x27;s where the methodological creativity comes in. Don&#x27;t ask, “Are you a disappointed Trump voter?” or “Do you regret voting for Donald Trump?” or “Are you loyal to Trump or to MAGA?” Those questions practically beg respondents to tell you how they want to see themselves.</p><p>Instead, measure the components:</p><p class="bullet">Did the last ten years turn out better or worse than you expected?</p><p class="bullet">Would you vote for Trump again - or for a candidate he endorsed?</p><p class="bullet">Would you prefer a Republican who continues Trump&#x27;s policies but has a very different personality?</p><p class="bullet">Should the Republican Party continue in its present direction or change course?</p><p class="bullet">Could you imagine voting for a Democrat?</p><p class="bullet">Could you imagine not voting at all?</p><p class="bullet">Is America stronger or weaker than it was ten years ago?</p><p class="bullet">Which changes would you keep, which would you reverse, and related to this, how certain are you?</p><p>Don&#x27;t ask respondents which bucket they belong in. Let their answers tell you.</p><p>Use qualitative research first to discover the language and motivations conventional questionnaires may be missing. Build a quantitative instrument around what you learn, segment people by patterns across several questions rather than one convenient headline number, then return to qualitative research to find out what the numbers mean.</p><p>And most importantly: measure it again.</p><p>Six months later.</p><p>Then six months after that.</p><h2>MOVEMENT MATTERS MORE THAN THE SNAPSHOT</h2><p>The size of the buckets matters, but the movement between them matters even more. If Bucket One remains enormous, Trump&#x27;s personal political power survives. If people move from One into Two, something more historically significant may be happening: Trumpism is successfully separating itself from Donald Trump.</p><p>If Two begins moving into Three, the movement itself may be weakening. If Three grows but doesn&#x27;t move into Four, America could be heading toward political fragmentation rather than a Democratic realignment. And if Three begins flowing heavily into Four, the political pendulum hasn&#x27;t merely stopped. It&#x27;s swinging.</p><p>That&#x27;s what I&#x27;d want to measure - not another snapshot showing Republicans at 46%, Democrats at 47% and everybody arguing about the margin of error. Conventional voting-intention polling is pretty good at telling us where Americans stand today. What interests me is where they&#x27;re prepared to move tomorrow.</p><h2>THE QUESTION THAT MATTERS</h2><p>Ten years ago I argued that pollsters weren&#x27;t necessarily getting the answers wrong. They were asking the wrong question. Ten years later, I think we are in danger of doing it again.</p><p>The most consequential political question in America today isn&#x27;t “Do you approve of Donald Trump?” It isn&#x27;t even “Who would you vote for if an election were held tomorrow?” The question is:</p><p>After ten years of Donald Trump, what do Americans want America to become next?</p><p>Figure out how to measure that accurately - without telling respondents what answer you&#x27;re looking for - and then measure how those sentiments change over time.</p><p>The pollster with the balls and methodological creativity to do that won&#x27;t merely have a better chance of predicting the next election. He or she may be able to tell us where America is going for the next two, five and ten years.</p><p>Again, time will tell.</p>]]></content:encoded><enclosure url="https://barilmusings.com/assets/3.webp" length="194482" type="image/webp"/></item>
</channel></rss>
