← All Labs·Methods & Data Literacy·Related: The Answer Key · Multi-Perspective History · The Negotiating Class
← All Labs · Section 4.5.14 · Building 5 · DCV Building · College V · Humanities · DCV Methods & Data Literacy · Related: The Socratic Mirror · Multi-Perspective History · Small but Mighty
🌲 Opathorlokan University opathorlokanuniversity.net
Data Literacy Type a topic. Pull six surveys. The most important question is the one nobody asked.
Data Literacy · College V · DCV

A Survey of Surveys

Type a topic. Pull six surveys. The most important question is the one nobody asked.

01 · Disambiguation

One word. Four different machines.

This lab started by accident. Someone typed "new discoveries in survey" into a search engine, expecting land surveys, and got back a fistful of headlines that all said "survey" — and not one of them meant the same thing. That confusion is the first lesson. Before you can compare surveys, you have to notice they aren't the same animal.

Species 01

The Opinion Poll

Measures how people feel. A sample stands in for a population; the result is a snapshot of mood at a moment.

e.g. the Elon "America at 250" poll · the Myrtle Beach locals survey
Species 02

The Census / Count

Not opinion at all. Counts how many things exist — people, students, dollars. No "feelings," just totals.

e.g. the NSF count of every science grad student in the U.S.
Species 03

The Survey About Surveying

Methodology looking at itself. Studies how the asking shapes the answer — the survey is the subject.

e.g. Pew on war contaminating fieldwork · a multi-campus design study
Species 04

The Instrument Itself

The measuring stick is born, retired, or replaced. When the ruler changes, every trend line built on it quietly breaks.

e.g. Gallup ending approval polling as a new index launches

A survey looks like a measurement — a clean number handed to you. It's really a stack of decisions: who to ask, how to word it, when to run it, what to count, and what to leave off entirely. Line six surveys up side by side and those decisions stop hiding. That's the whole skill: surveying the surveys.

■■■ the thesis of this lab

The most important question in any survey is the one it didn't ask.

Everything that follows is just learning to see that blank.

→ Next: the actual six we pulled, and the five things to look for in any set.

02 · The pull

Here's what one search actually returned.

Five real surveys, pulled from a single search for "new discoveries in survey" in June 2026 — nothing curated, nothing invented. Read across them. Hit "show the hidden choices" on each to see the decisions the headline didn't print.

Opinion / civic input № 01 "New survey asks locals their thoughts on the Myrtle Beach area"
Who ran itThe Greater Myrtle Beach Collaborative & Partnership Grand Strand — an economic-growth group
Who got asked1,900+ Horry County residents who chose to take part
WhenReported June 2026
Headline finding: residents want to keep seeing the area grow, with more support for local businesses and careers.
Decisions the headline didn't print
  • Who paid steers the frame. A growth collaborative ran it — so "do you want growth?" is the axis, and growth is the assumed good.
  • Self-selected, not random. People who opt into a civic survey skew engaged and invested. The disengaged never show up.
  • Residents only. Tourists, seasonal hospitality workers, and recent arrivals — the people growth affects most — aren't in the frame.
Opinion poll № 02 "Proud but Uneasy: Americans' mixed feelings about the nation at 250"
Who ran itThe Elon University Poll (dir. Jason Husser); reported via the Black Press of America
Who got asked1,000 U.S. adults
WhenJune 2026
Headline finding: ~68% say they're proud to be American, yet ~73% rate the health of democracy only fair or poor.
Decisions the headline didn't print
  • The tension is manufactured by juxtaposition. "Proud" and "democracy is unhealthy" answer two different questions; pairing them creates the "uneasy" story.
  • "Americans" = adults. Noncitizens and everyone under 18 aren't in the number, though they live here too.
  • Who tells you matters too. The same 1,000-person poll gets a different spin depending on which outlet foregrounds which finding.
Survey about surveying № 03 "What happens when war breaks out in the middle of a survey?"
Who ran itPew Research Center (Tully, Schulman & Silver)
Who got asked~1,000 adults each, across 36 countries, weeks in the field
WhenFieldwork interrupted by Feb 2026 airstrikes on Iran
Finding: as the war and the fieldwork ran on together, views of the U.S. shifted mid-collection — the shutter stayed open while the world moved.
Decisions the headline didn't print
  • "When" can poison "what." A poll is a snapshot at a point in time. If reality changes mid-fieldwork, early respondents and late respondents are answering different worlds.
  • Honesty about it is rare. Most polls report one number and never tell you the days behind it. This one is unusual for showing its own blur.
  • Slicing by week shrinks the sample. Splitting 1,000 people across weeks makes each slice small and noisy — a real cost of looking closely.
Census / count № 04 NSF "Survey of Graduate Students and Postdoctorates in Science & Engineering"
Who ran itNSF's NCSES + NIH; data gathered by RTI International
Who got "asked"Every eligible U.S. department — via institutional coordinators, not students
WhenAnnual since 1972; 2026 renewal notice
Not a mood at all: a head-count of graduate students, postdocs, and researchers by field, demographics, and funding source.
Decisions the headline didn't print
  • "Science & engineering" only. Humanities and arts grad students simply don't exist in this dataset — a whole population defined out of the count.
  • Institutions answer, not people. It's the registrar's-eye view: who's enrolled, not how they're doing or why they leave.
  • The categories drift. NSF itself warns the field taxonomy has changed over the years, so old and new counts aren't cleanly comparable.
Survey about surveying № 05 "Expanding a single-institution survey to multiple institutions: lessons learned"
Who ran itA researcher writing up design & deployment lessons (Cooper, 2020)
What it studiesThe survey's own reach — scaling one campus to many
When2020
Finding: what works at one institution breaks at the next — populations differ, deployment differs, and comparability gets hard fast.
Decisions the headline didn't print
  • The frame is a choice with consequences. Widen who's surveyed and you don't just get "more data" — you get harder-to-compare data.
  • Single-site findings get over-generalized. Results from one campus often travel as if they were universal. This piece is about the seams.
  • It's a survey whose subject is surveys. Easy to mistake for a results paper; it's really a methods confession.

□ The lens you carry to your own pull

  1. Who got asked? And who couldn't be in the frame at all?
  2. Who's asking / who paid? Funders rarely commission questions whose answers they'd hate.
  3. How was it worded? Small changes swing the result hugely.
  4. Sample & margin? Almost never in the headline — go find it.
  5. When did it run? A snapshot is only true for its moment.
  6. What got left out? The hardest one. That's Tab 03.
Wording isn't a footnote — it's the result. In a classic Pew case, support for U.S. military action in Iraq sat at 68% — until the question mentioned possible American casualties, and it fell to 43%. Same people, same war, same week. Different sentence.

→ Now the centerpiece: across all five, what did each one decline to ask?

03 · The blank line

What did each one decline to ask?

Here's the move that turns you from a reader into an analyst. For each survey, take a second — in your head or in the box — and guess the question it carefully avoided. Then lift the bar. There's no wrong answer here; the point is only that you looked.

№ 01 · Myrtle Beach locals
It asked: "Do you want the area to keep growing?"
So what's the question a growth collaborative would rather not put on the form?
unasked → "Growth for whom — and who pays for it in rent, traffic, and displacement?"
№ 02 · America at 250
It asked whether you're proud, and whether democracy feels healthy.
It measured the mood. What did it never pin down?
unasked → "Proud of what, exactly — and uneasy because of what? The causes underneath the feeling."
№ 03 · Pew, war mid-survey
It asked what people think of the U.S. — honestly noting the timing.
This one's unusually transparent. So what does even it leave unasked of the respondent?
unasked → "Had you already heard about the airstrikes when you answered?" The week is tracked — each person's awareness isn't.
№ 04 · NSF grad-student census
It counts who is enrolled, by field and funding.
A perfect count of bodies. What does a head-count structurally refuse to ask?
unasked → "How are they actually doing — and who left, and why?" A census counts presence, never experience.
№ 05 · Multi-institution lessons
It asks how to scale a survey across campuses.
A paper about reaching more people. What's the question it doesn't turn on itself?
unasked → "Should this survey exist across all these places at all — or does one size quietly erase real differences?"

□ How to find the blank in your own set

  1. List who answered. Then say out loud who couldn't. The missing group usually holds the missing question.
  2. Follow the money. Ask what answer would embarrass whoever paid. That answer is often the one not asked.
  3. Separate count from experience. If it measured "how many," ask "how well." If it measured "how they feel," ask "why."
  4. Read across, not down. When five surveys on one topic all skip the same thing, that silence is the finding.
■■■ you can put the bar back now

A survey is never just what it measured. It's also the shape of everything it chose not to. Read the set, find the silence, and you're reading like an analyst.

01 / 03