Skip to content Skip to search

Republish This Story

* Please read before republishing *

We’re happy to make this story available to republish for free under an Attribution-NonCommercial-NoDerivatives Creative Commons license as long as you follow our republishing guidelines, which require that you credit The 19th and retain our pixel. See our full guidelines for more information.

To republish, simply copy the HTML at right, which includes our tracking pixel, all paragraph styles and hyperlinks, the author byline and credit to The 19th. Have questions? Please email [email protected].

— The Editors

Loading...

Modal Gallery

/
Sign up for our newsletter

Menu

  • Our Mission
  • Our Team
  • Latest Stories
  • Search
  • Upcoming Events
  • Contact Us
  • Newsletter
  • Donate
  • Work With Us
  • Fellowships
    • From the Collection

      Changing Child Care

      Illustration of a woman feeding a baby a bottle
      • The full PUMP Act is now in effect. Here’s what it does for lactating parents.

        Chabeli Carrazana · April 28
      • 1 in 4 parents report being fired for work interruptions due to child care breakdowns

        Chabeli Carrazana · February 2
      • Washington, D.C., offers financial relief to local child care workers

        Orion Rummler · September 20
    • From the Collection

      Next-Gen GOP

      Illustration of a woman riding an elephant
      • Mayra Flores’ victory set a record for women in Congress. It also reflects the growing visibility of Republican Latinas

        Candice Norwood · June 21
      • A banner year for Republican women

        Amanda Becker · November 11
      • Republican women could double representation in the U.S. House

        Amanda Becker · November 4
    • From the Collection

      On The Rise

      Illustration of three women marching
      • Can Cheri Beasley build a winning coalition in North Carolina?

        Candice Norwood · October 11
      • Los Angeles has never elected a woman mayor. Karen Bass hopes to change that.

        Nadra Nittle · September 8
      • Judge J. Michelle Childs is confirmed to D.C. appeals court

        Candice Norwood · July 20
    • From the Collection

      Pandemic Within a Pandemic

      Illustration of four people marching for Black Lives Matter with coronavirus as the backdrop
      • Some LGBTQ+ people worry that the COVID-19 vaccine will affect HIV medication. It won’t.

        Orion Rummler · November 23
      • Why are more men dying from COVID? It’s a complicated story of nature vs. nurture, researchers say

        Mariel Padilla · September 22
      • Few incarcerated women were released during COVID. The ones who remain have struggled.

        Candice Norwood · August 17
    • From the Collection

      Portraits of a Pandemic

      Illustration of a woman wearing a mask and holding up the coronavirus
      • For family caregivers, COVID is a mental health crisis in the making

        Shefali Luthra · October 8
      • A new database tracks COVID-19’s effects on sex and gender

        Shefali Luthra · September 15
      • Pregnant in a pandemic: The 'perfect storm for a crisis'

        Shefali Luthra · August 25
    • From the Collection

      The 19th Explains

      People walking from many articles to one article where they can get the context they need on an issue.
      • The 19th Explains: How to ease the ‘loneliness epidemic’ and social isolation among older adults

        Sara Luterman · April 24
      • The 19th Explains: Who will be most impacted by Medicaid changes — and when

        Rebekah Barber · March 28
      • The 19th Explains: What we know about Brittney Griner’s case and what it took to get her home

        Candice Norwood, Katherine Gilyard · December 8
    • From the Collection

      The Electability Myth

      Illustration of three women speaking at podiums
      • Mayra Flores’ victory set a record for women in Congress. It also reflects the growing visibility of Republican Latinas

        Candice Norwood · June 21
      • Stepping in after tragedy: How political wives became widow lawmakers

        Mariel Padilla · May 24
      • Do term limits help women candidates? New York could be a new testing ground

        Barbara Rodriguez · January 11
    • From the Collection

      The Impact of Aging

      A number of older people walking down a path of information.
      • From ballroom dancing to bloodshed, the older AAPI community grapples with gun control

        Nadra Nittle, Mariel Padilla · January 27
      • 'I'm planning on working until the day I die': Older women voters are worried about the future

        Mariel Padilla · June 3
      • Climate change is forcing care workers to act as first responders

        Jessica Kutz · May 31
    • From the Collection

      Voting Rights

      A series of hands reaching for ballots.
      • Ranked-choice voting is gaining momentum. So are efforts to stop it.

        Barbara Rodriguez · April 24
      • Connecticut voters approved early voting. Here’s how their new secretary of state wants to make it happen.

        Barbara Rodriguez · February 13
      • Women lawmakers in Minnesota are in the vanguard of the democracy movement

        Barbara Rodriguez · February 3

    View all collections

  • Explore by Topic

    • 19th Polling
    • Abortion
    • Business & Economy
    • Caregiving
    • Coronavirus
    • Education
    • Election 2020
    • Election 2022
    • Election 2024
    • Environment & Climate
    • Health
    • Immigration
    • Inside The 19th
    • Justice
    • LGBTQ+
    • Military
    • Politics
    • Press Release
    • Race
    • Sports
    • Technology

    View All Topics

Home
  • Our Mission
  • Our Team
  • Latest Stories
  • Search
  • Upcoming Events
  • Contact Us
  • Newsletter
  • Donate
  • Work With Us
  • Fellowships

We’re an independent, nonprofit newsroom reporting on gender, politics and policy. Read our story.

The 19th News(letter)

News that represents you, in your inbox every weekday.

You have been subscribed!

Submitting...

Uh-oh! Something went wrong. Please try again later.

Become a member

The 19th thanks our sponsors. Become one.

A photo illustration of a horizontal bar chart and tape measure.
(Rena Li for The 19th)

19th Polling

How we conducted the first 19th News/SurveyMonkey poll

More data helps us better cover and serve women and LGBTQ+ people. Here’s why we tackled this project – and how.

By

Jasmine Mithani, Terri Rupar

Published

2022-09-15 04:00
4:00
September 15, 2022
am

Share

  • Twitter
  • Facebook
  • Email

The 19th and SurveyMonkey have teamed up on a poll to explore core issues in our coverage. SurveyMonkey surveyed more than 20,000 adults on politics, abortion, caregiving, health care, the workplace and more. Here’s why we tackled this project — and how. 

Why do a poll?

We talk to a lot of people in the course of our reporting on issues that disproportionately affect women, particularly women of color, and LGBTQ+ people. That reporting is invaluable, but it’s just one tool, and one that doesn’t always give us the widest view. This poll sheds light on what women and LGBTQ+ people across America think about the state of the country — its politics, its politicians and its systems. 

The 19th thanks our sponsors. Become one.

Many news outlets and organizations do polls, often focusing on issues of the day or head-to-head electoral matchups. Our poll is different, designed to probe opinions on topics relevant to people The 19th serves. We aim to keep asking these questions every year to see how experiences, attitudes and concerns change over time.

Often as we report on other polls, we run into a lack of data on smaller segments of the American population, such as transgender people. SurveyMonkey’s reach allows us to collect significant insight into the views of the communities we cover who are often overlooked in traditional polling. We want to know how our country’s systems are working: What is motivating people? And where do they run into barriers? Doing our own poll with SurveyMonkey is a chance to get new, more detailed data.

The data from this poll informs a number of stories we’re publishing and will continue to help us better cover and serve women and LGBTQ+ people going forward.

  • Explore Our Findings:
    A photo illustration of people inside a voting booth with a cutout of a paper ballot and shapes.
  • Explore Our Findings: The State of Our Nation

How this poll worked — plus how polls work generally

In any public opinion poll, not everyone in the country is asked for their opinion. Pollsters reach out to a representative sample of people and ask a series of questions. Most often outreach occurs through calling landlines or cell phones, though now some pollsters use online or text message surveys. SurveyMonkey, our partner, leverages the reach of its online survey service — engaging more than 2 million people a day — to select a random sample of respondents and ask if they’re willing to answer more questions. 

For this 19th News/SurveyMonkey poll, 20,799 American adults took the survey in either English or Spanish. The modeled error estimate — the equivalent of a traditional margin of error for surveys of this type — is plus or minus one percentage point. That means the true value of any number for the total number of respondents is expected to be at most one point more or less than what is reported in this survey, at a 95 percent level of confidence. For results based on subgroups, the error estimate will be higher.

SurveyMonkey goes into more detail here.

But how do you know these answers are accurate?

Even if a pollster is really careful with sampling in the traditional manner, they won’t have an exact replica of the total U.S. population. That’s where weighting comes in. SurveyMonkey, like many other pollsters, compares the population who answered the poll to data collected as a part of the Census’s American Community Survey (ACS) along axes of race, sex, age, education and geography. Then the data is weighted so that it matches the population at large. For example, if a survey had significantly more women respondents than men, weighting ensures that the reported results aren’t skewed due to the sample.

  • More from our poll
    A photo illustration of a mother working and playing with her baby.
  • Taking care of kids makes balancing work and life harder — particularly for moms, poll finds
  • ‘I felt judged’: LGBTQ+ Americans report significantly more medical discrimination
  • 70% of Americans don’t trust politicians to make abortion policy, 19th News/SurveyMonkey poll finds

What are the limitations of the survey language?

People describe themselves in a lot of ways; the ACS has more limited options. (As The 19th has previously covered, the Census Bureau only just started explicitly gathering data on LGBTQ+ individuals.) To ensure accurate weighting, certain demographic questions in polls must mirror the ACS exactly. That means the phrasing for several questions on our survey deviated from our editorial guidelines around language, which were created to promote clarity as well as equity. 

When respondents were asked how they identify their gender, they were given only three options: male, female or “not listed/non-conforming.” A followup question asked respondents whether they identified as transgender, but we weren’t able to provide more expansive gender options to explicitly collect more granular data on nonbinary individuals. 

In a similar vein, The 19th uses the term Latinx to describe people of Latin American origin or descent. However, the ACS refers to this category as Hispanic or Latino, which is the phrasing used in our survey questions. (We are reporting the results as “Latinx.”) 

Again, SurveyMonkey’s methods allow us to capture a wide range of perspectives and highlight views from segments of the population in a way that a lot of polls don’t allow. But it’s important to also acknowledge our limitations.

Do we still trust polls?

We trust them to do what they’re supposed to do: give us information about public opinion at a certain point in time. By themselves, they’re not intended to predict what will happen, and there’s always some error inherent in any polling figure. That’s why we share how the survey was conducted, as well as the estimate for the potential error. 

“Polls haven’t failed us. They’re still the best way to capture data that accurately reflects the views of millions of people in just a few simple statistics,” said Laura Wronski, director of research at SurveyMonkey. People have particularly high expectations of precision for election polls, she pointed out — maybe unrealistic ones. 

When they see two polls give slightly different numbers for how many people support a policy, for example, they tend to accept the variation, she said. 

“They wouldn’t be so forgiving if the same were true of an election poll — even though they use the same methodology,” Wronski said. “So it’s really all about knowing what the goal of a poll is, and having enough understanding of statistics to interpret the results correctly.”

The 19th worked with SurveyMonkey to make sure we are doing just that. And in the process of reporting, our journalists have also reached out and followed up with respondents to build on the information in hand.

You can see the full data here and the questionnaire here.

Have more questions on how this poll was done, or how polls work in general? Share them. 

Methodology: This SurveyMonkey online poll was conducted online in English and Spanish from August 22-29, 2022 among a national sample of 20,799 adults. Respondents for this survey were selected from the more than 2 million people who take surveys on the SurveyMonkey platform each day. The modeled error estimate for this survey is plus or minus 1.0 percentage points. Data have been weighted for age, race, sex, education, and geography using the Census Bureau’s American Community Survey to reflect the demographic composition of the United States age 18 and over. 

Here’s what we found

We’re focusing in on the experiences of the communities we serve. Explore the rest of our findings and read the stories we’re publishing.
Dive In

Share

  • Twitter
  • Facebook
  • Email

The 19th News(letter)

News that represents you, in your inbox every weekday.

You have been subscribed!

Submitting...

Uh-oh! Something went wrong. Please try again later.

Become a member

Up Next

Senator Lindsey Graham speaks beside anti-abortion leaders.

Abortion

Abortion bans like Lindsey Graham’s say they have rape and incest exceptions — in practice, they don’t work.

The exceptions require people to jump through significant logistical, legal and bureaucratic hoops that render them nearly impossible to utilize, experts said.

Read the Story

The 19th
The 19th is a 501(c)(3) tax-exempt organization. Our stories are free to republish in accordance with these guidelines.

  • Donate
  • Newsletter
  • Events
  • Search
  • Jobs
  • Fellowships
  • Contact Us
  • About Us
  • Community Guidelines
  • Membership
  • Membership FAQ
  • Major Gifts
  • Sponsorship
  • Privacy
  • Twitter
  • Facebook
  • Instagram