This blog only enters my mind when I need to remember how to post on it, usually every six month or so. One of my last posts, which I wrote more than a year ago, is entitled What Happens When Russia Loses?

“Yikes,” I thought. “That was a more optimistic time. I might have to write a new post called What I Really Meant to Say Was…”

Actually, the only part I’d change is the title. I’d make it What Happens When It Takes a Long Time for Russia to Lose? In addition to the good things that could happen in the region when Russia loses (all still true), there are, I should point out, some bad things that will happen if it takes a long time. They are happening now.

FOUR BAD THINGS (a non-exhaustive list)

OBVIOUSLY, Ukrainians continue to suffer unbearable losses

Even if there’s a “peace agreement,” an undefeated, revanchist Russia will attack Ukraine again once it has reconstituted itself after staggering losses in its stupid war of aggression. Ukraine will not live peacefully until Russia is militarily and politically incapable of invading it. The longer this war goes on, the more Ukrainians die. They will not stop fighting.

Emboldened regional autocrats

In a recent webinar hosted by Coda Story, certified smart person Peter Pomerantsev (my advice: read everything he writes on influence operations, especially his three books on the topic) argued persuasively that an emboldened Russia provides space for openly pro-Russian regimes (Belarus, Georgia) to be more aggressive. For example, the pro-Russian Georgian Dream ruling party has rammed through a copy of Russia’s foreign agent law, despite massive public protests. Regimes that keep a finger to the wind, like Turkey, Kyrgyzstan, Hungary and Serbia, will use an emboldened Russia for cover to shore up their own corrupt structures. All have or are planning a similar Foreign Agent Law. To them, there’s no downside to stepping into Russia’s footprints and the benefit – defanged civil society in no position to challenge them – is obvious. Why is this bad? Read this report that I helped write about what happened in Russia after passage of its Foreign Agent law.

Incremental progress toward democratic development in Moldova, Georgia, Armenia and Kazakhstan, at best, is halted

At best, Russia will continue to meddle, through influence operations, election fraud and political interference. It will be impossible for these countries to chart their own paths. At worst, irredentist Russia will reabsorb them; the USSR with a more palatable name.

An emboldened Russia threatens Europe

As a resident of France, I find this one compelling. A war with a Russia that has subsumed the Ukrainian arms industry, army and geography is a much stronger opponent for Europe than one that Ukraine defeats and sends back to its 1991 borders. This is Professor Timothy Snyder’s “1938 Argument.” Helping Ukraine defeat Russia now means Russia can’t threaten Poland and the Baltics (something it already does regularly) and next, France, Germany and Italy. President Macron (link in FR) gets what is at stake. If you understand French, he explains it in simple terms.

DOES IT GO TO 11?

For Russia, the absence of defeat is victory. If I wrote that 2023 post again, I would turn the volume on the sense of urgency up to 11. We’re seeing, right now, today, what happens when Russia’s defeat is delayed by slow American aid delivery and absurd restrictions on how Ukraine uses weapons to defend itself. Ukraine is the biggest victim by a huge margin. But other countries, like Georgia and Moldova, are in Russia’s crosshairs too. It’s not going to get better, especially for Europe. Give Ukraine the tools it needs to finish the job.

Contact Quirk Global Strategies to talk about new and clever ways to measure public opinion in complicated places.

 

 

Sometimes when I’m feeling dark, I pretend I am a Russian “political technologist” designing influence operations in Ukraine. I try to deconstruct what Russia is trying to achieve and why. I scratch my head. Do they know their efforts to undermine Ukrainians’ commitment to defending themselves is dumb and ineffective? Do they do any research at all?

Russians have had little success in undermining Ukrainians’ support for the war effort or their leaders. Pre-full scale invasion, however, Russians were pretty good at causing division in Ukrainian politics, particularly around major strategic issues like EU and NATO membership. Russia used its television channels, Ukrainian political allies and Ukraine’s natural political divisions to prevent leaders from building consensus about Ukraine’s future direction. For a number of reasons, it has become much harder lately for Russia to get traction.

Four Major Changes in Ukraine

I can identify four major changes in the Ukrainian information environment to help explain why. These are important for anyone trying to understand Ukrainian public opinion since the full-scale invasion.

  • Ukraine blocked Russian TV channels from Russia in 2014 and shut down Russian-language channels in Ukraine owned by Russian-aligned oligarchs in 2021.
  • Ukraine banned 11 Russian-backed political parties in March 2022.
  • Ukrainians are sophisticated information consumers.
  • Ukrainians are not receptive to and/or are openly hostile toward messaging they perceive as coming from Russia.

No more Russian TV channels

Television remains the most effective tool to shape mass public opinion. Accordingly, the single most important factor limiting Russian influence over public opinion in Ukraine has been the closure of Russian channels from Russia and Russian channels from Ukraine. Kremlin narratives and coordinated messages simply do not reach a mass audience in Ukraine like they used to. (Ukraine’s United TV Marathon has succeeded, to some degree, in achieving this. That’s a different post).

Sure, Russia has access to Telegram. Everyone does. Telegram channels are useful for delivering targeted messages to receptive audiences who are looking to confirm their biases, who distrust official narratives or who want to fill information gaps. All kinds of channels fill this space, however, making it quite fragmented and noisy. Russia holds no particular advantage, like it did when Kremlin-friendly TV stations pumped garbage 24/7 into millions of Ukrainian living rooms, unchallenged.

Russia-backed political parties shut down

 Ukraine’s democratic institutions provided cover for Russian-backed political parties and their parliamentary faction, allowing them to undermine democracy from within for years. The largest, Opposition Platform/For Life, enjoyed legitimate support from voters in Ukraine’s East and South and held 44 seats in the Rada. However, it was backed by Viktor Medvedchuk, a pro-Moscow Ukrainian oligarch with close ties to Putin. Banning these parties, while controversial, inhibited Russia’s ability to take advantage of Ukraine’s democratic system to promote the Kremlin’s agenda.

Ukrainians are sophisticated information consumers

 Ukrainians have become sophisticated information consumers, a process that predates the full-scale invasion. Going back to at least 2016, Ukrainian civil society and educational institutions developed tools to help Ukrainians identify information sources designed to manipulate them. Some approaches worked, some didn’t. Some Ukrainians will never be reached and will remain vulnerable to, or even embrace, Russian influence. Many more, however, learned to pay close attention to who might be fighting for their attention and why.

Most Ukrainians now consume information primarily in Ukrainian, either via Telegram channels or United TV Marathon. They can identify Russia-friendly channels and commenting bots by their bad grammar and spelling as easily as native English speakers can spot Russicisms. Ukrainians also know that Telegram channels are the main source of unproven, manipulative information. They say they read with caution and double check against other sources, evidence of their information resilience.

Most Ukrainians are deeply hostile toward Russia and its narratives

 Pre-full scale invasion, a substantial number of Ukrainians used to hold, if not positive attitudes toward Russia, at least neutral views, particularly in the East and South. No longer. I suppose Russia can count that as an accomplishment of sort. No one else – certainly not the West — could have turned so many Ukrainians against it so thoroughly and most likely, irreversibly.

Ukrainians swat down messages they suspect might be coming from Russia, including common imperialist tropes that few questioned. Not only are Ukrainians generally not receptive, but the narratives often infuriate them. That’s not fertile ground for your influence operation to take root.

Most importantly, Russians not only lack the tools to influence Ukrainians’ opinions, they lack an understanding of their audience. Russians are trying – and failing — to undermine Ukrainians’ faith in a democratic system in which most Russians cannot perceive value. If they could relate to the importance of independence to Ukrainians and the complex relationship Ukrainians have with their democratically elected leaders, Russians might rethink their approach. The enormous gap between Russia’s and Ukraine’s worldviews makes it difficult for Russians to understand post full-scale invasion Ukrainians well enough to create anything but the clumsiest narratives.

May Russia continue to fail

None of this is to say that influence operations can’t work to undermine Ukrainians’ support for the war effort, build resentment toward their leaders and sow divisions in society. I’ve also thought a great deal about how that can be done. Russia, however, isn’t doing a very good job at it. Let’s hope they keep it up.

 

Christine Quirk is a France-based opinion research consultant and strategist who has been managing strategic qualitative and quantitative research projects in Ukraine since 2006 for a variety of clients. She has observed hundreds of focus groups on topics such as Ukrainians’ view of the full-scale invasion, elections and the political environment, how Russian influence operations shape Ukrainian public opinion, LGBTQI rights, women’s political participation and many others. Contact Quirk Global Strategies for more information about our work.

 

 

What a horrible, stupid war. As historians debate whether militaries make the same mistake over and over again, we here on the opinion-research side of things run the same risk. But we don’t like to lose, so we do what we can to keep from being surprised by events.

Do you want to be taken by surprise by what happens when Russia loses this war?

Russia is Going to Lose

What do I mean by lose? Russia is militarily, politically and economically weakened to the point where it is less able to exert direct influence over its neighbors’ political systems, less effective at shaping public opinion and unable to invade its neighbors.

Plenty has been written about how the West misread what happened in 1991. Amidst the triumphalism of having “won the cold war” and reaching “the end of history,” too many policies privileged Russia’s interests at the expense of newly independent states including, but not only, Ukraine. Subsequently, many have struggled to develop rule of law, equal rights, uncontrolled media and fair elections under Russian influence.

Understand What’s Going to Happen Next

I’ve long been bearish on Ukraine’s ability to defeat Russia. I’ve thought a lot about how, post-victory, Ukrainians will approach politics without Russia occupying territory, without political parties led by corrupt Russian interests, and with a population deeply wounded by Russian atrocities.

We know post-victory Ukraine is going to be very different. I’ve already got questions I want to ask: How will the (generally flawed and unpopular) political parties respond to the challenges of reconstruction? From what quarters will the next generation of leadership emerge? Who or what will fill the vacuum – long dominated by Russian-oriented parties – in eastern Ukraine? We’ll only know by asking Ukrainians what they think.

I’ve also got questions about how dynamics in Belarus, Georgia, Moldova, Serbia and Hungary might change without the incentives provided or imposed by Russia. A weakened Russia may be less able to back up Lukashenka’s dictatorial control over Belarus. Will this give opposition forces the opening they’ve been positioning themselves for years to run through? But what do Belarusians think about a post-Russia future?

Georgians just killed a draft foreign agent law, a version of which has decimated Russian civil society by, among other things, playing on Soviet-era fears of foreign spying. Energized, could Georgians take the giant leap of evicting a weakened Russia from territory it has occupied since 2008? Who do Georgians think can lead that effort?

Russia is not going away. Indeed, Russia itself could be wracked by internal conflict and competition for power that’s unlikely to favor democrats. But what’s the spillover of that going to be in the North Caucasus and Siberia? Seems like it’s worth trying to understand what people there think about their future.

Ask the Questions and Listen to the Answers

Like at the end of the cold war, Russia’s failed war on Ukraine could cause liquefaction of the political soil in Eastern Europe and Central Asia. Political dynamics that have been frozen in amber for decades could disappear, reconstitute or explode into chaos. Arguments in favor or against such scenarios are legitimate and worthy of debate.

However, unlike 30 years ago, there’s zero excuse for assuming we know (or not caring!) what people in countries from the Balkans to the Chinese border think about such big changes. Listening to people that have been living with Russian influence makes it less likely we’ll be taken by surprise by the fallout from another major event, like Russia losing to Ukraine.

 

Contact Quirk Global Strategies to talk about new and clever ways to measure public opinion in complicated places.

 

 

Survey research is a tool. Like all tools, it can be used for good or evil.

It remains the best way to understand divisions in public opinion and the context that explains them. Once the data reveal the depth and breath of societies’ fault lines, mitigating or exploiting the divisions becomes easier.

Pollsters working on the side of good do their best to mitigate those divisions. If the goal is exploiting divisions, however, polling can be the devil’s tool.

As a general policy, Quirk Global Strategies works on the side of good. We’ve talked a lot on this blog about how we use polls and focus groups to help our clients navigate complicated environments and advance a positive agenda. The type of strategic research which QGS conducts rarely appears in public. It’s used to guide decisions in support of and to measure the success of political campaigns, advocacy campaigns and program design or evaluation. Benign stuff, really.

What Would the Devil Do?

Back in the 2016 US election, there was a lot of talk about how Russian interests exploited societal divisions to benefit Donald Trump. I believed at the time, and still do — though I haven’t seen proof — that these operators relied on polling to identify segments of the US population most receptive to divisive election messages. The degree to which Russia interfered is hard to measure. However, exploiting existing divisions in society has long been part of Russia’s global playbook. Polling in the US is easy to do. There are plenty of US pollsters who would take Russian money. There are lots of divisions to exploit. Why wouldn’t they use research to inform their strategy?

If I were to interview the devil on how he uses polling to advance his agenda, I would probe on the example from the US: Who? When? How? Which issues? How much did you pay your pollster?

Does the Devil Poll in Ukraine?

Having worked in Ukraine since 2006 and watched hundreds of focus groups there in the last six years, I know the fault lines that transect Ukrainian society. Ukraine’s democracy is fragile. Corruption is a major issue. If I were the devil (I am not), I would ask myself which issues would most effectively undermine Ukrainians’ support for their government and increase societal tensions. I would commission research to identify the top issues and the populations most receptive to divisive messages, just to make sure I was on track.

Anyone who has spent as much time mucking around in Ukraine as the Russians already knows where the fault lines lie. Russia has sophisticated “political technologists.” Ukraine’s data collection capacity is robust. Survey research is cheap. They should be smart enough to check their assumptions against hard data, especially if they plan high-risk political investments. It would be dumb not to.

Is There Any Evidence?

The Plot to Destroy Ukraine” by the Royal United Services Institute for Defense and Security Studies (RUSI), is an excellent report. Seeing the suggestion in print that Russians use opinion research in Ukraine shouldn’t have surprised me, but it did. Here’s a paragraph that pretty clearly lays out the devil’s usual polling strategy:

The energy axis of Russia’s unconventional operations was detected early by Kyiv and measures were taken to try to control its impact. Ukrainian officials believe that they have succeeded in countering this initial thrust, though Russia could go much further. Energy was one of many axes by which Russia was and is trying to undermine the credibility of the Ukrainian government. The aspiration is to create a domestic political crisis that Russia can capitalise upon to bring politicians willing to reach an accommodation with Moscow to power. Using extensive social surveys of Ukrainian citizens, the Russian government has been working out which pressures lead to a domestic reaction and which do not. [italics mine]

The paragraph ended with a tantalizing footnote but rather than evidence, it was just a link to some public polling.  It did not answer any of my questions about how Russia uses opinion research in Ukraine: Who? How? When? Which issues?

Why Wouldn’t You?

It’s not surprising that Russians use opinion research to support their operation in Ukraine, just as they likely did in the US. Polling is something that everyone does but no one talks about, especially if you have bad intentions. If a tool exists that helps you advance your agenda, why wouldn’t you use it?

Quirk Global Strategies prefers to use opinion research for good rather than evil. If you want to learn more about how we can help you advance your agenda anywhere in the world without invading anything, contact us.

Election polling in the US has a problem. Or, depending on who you ask, more than one problem.  Since the 2016 election, many big brains have tried to fix these issues with varying degrees of success.

I have problems too, but mine aren’t the same. Pre-COVID, my biggest problems were long fielding times, QC issues and inaccessible sampling points. I don’t have to deal with response rates in the low single digits.

For once this post isn’t about my problems. It is about what I have learned from other folks’ attempts to answer the question: what is the best way to obtain a random, proportionate sample when the tools we’ve always used (for North Americans, telephone surveys) aren’t working very well anymore?

Mixed Mode: Is it the Future?

The answer seems to be some form of “mixed mode” data collection. This means giving respondents several ways to participate in the survey. It could be by telephone, SMS, face-to-face, web, or even snail mail.

I’m not going to get in to the pros (there are some) and the cons (there are many) of each mode, particularly in low- and middle-income countries. Internet, smartphone and literacy distribution vary widely. Although the combination and proportionality are different for every country, mixed mode could mitigate some sampling and data collection problems that pre-date and/or have been exacerbated by COVID. Letting people respond on their terms, rather than mine, seems like an obvious step to take.

Meet Respondents Where They Are

While watching this very interesting University of Chicago panel, it occurred to me that even though I haven’t got the same worries as US election pollsters who can’t get people to answer the phone, I could make my surveys better by providing response options that are more convenient for respondents. These tools exist and COVID has forced us to start using them more!

                      Staying on top of things during the storm is hard

For example, if younger participants prefer online surveys, they should have that option. If it is better to reach older, technophobic or less literate respondents through face-to-face interviewing in their homes, then get out the Kish grid. With careful questionnaire design to mitigate design effects and framing that accounts for selection effects, it is possible to do both in the same survey. Creative use of incentives could also help.

Substituting one mode for another is rarely a solution. I’ve been resisting this approach through this whole COVID year. Running an online-only survey and expecting a representative sample in a country where many people lack smartphones, internet access or have difficulty reading is a big mistake. Younger, better-educated urbanites are already overrepresented in policy discussions. And don’t get me started about panels. Most aren’t, ahem, Pew-level quality.

Shorter Surveys Are Good

There’s more! Shifting away from long and complex face-to-face surveys will force clients to accept shorter questionnaires. As I’ve said before, making busy, less-educated, sometimes food insecure respondents slog through an hour-long survey on constitutional reform does not produce good data. Telephone and online surveys forcing simpler, shorter instruments is an unmitigated good.

COVID has forced us to rethink the ways we’ve always collected data. If one mode appeals more to one group and another group is easier to reach using different mode, why not figure out how to use them both? It’s worth putting in the extra thought. Respondents do us a big favor by answering our questions. It is incumbent on us to make it as easy as possible.

Contact QGS and we can talk about ways to make mixed mode work for your issue and country.