Call for Proposals: Data Collection for
Replication+Novel Political Science Survey Experiments
Alexander Coppock and Mary McGrath
January 27, 2026
We invite proposals for a survey experiment replication+novel design competition. Se-
lected replication+novel design survey experiments will be conducted on large samples of
American respondents, quota sampled to match U.S. Census margins and filtered for quality
and attention by the survey sample provider Rep Data (repdata.com).
Each proposal consists of two parts: (1) a replication study of an existing, previously
published survey experiment, and (2) a novel experimental design on a topic of the authors’
choosing.
The replication studies and reanalyses of the existing studies will be combined into a
meta-paper to be co-authored by all authors of accepted proposals along with the princi-
pal investigators (Coppock and McGrath). As a condition for acceptance, authors commit
to sharing the data and producing a write-up of the findings from their novel design for
submission to a scholarly journal, and public posting of a working paper pre-publication.
🎺 Call for proposals 🎺
1️⃣ replicate an existing experiment
2️⃣ run a novel experiment
on repdata.com
3️⃣ coauthor with Mary McGrath and me to meta-analyze the replications and existing studies
4️⃣ publish your study
details: alexandercoppock.com/replication_...
applications open Feb 1
please repost!
27.01.2026 22:16
👍 77
🔁 70
💬 0
📌 3
Thanks
26.01.2026 18:10
👍 2
🔁 0
💬 0
📌 0
Can anyone point me to a credible estimate of how much ICE operations are costing taxpayers per day? Either in general or Minneapolis-specific.
26.01.2026 13:48
👍 25
🔁 5
💬 4
📌 0
The 7yo and 9yo are totally enthralled by William Steig's "CDB!" A true classic.
19.01.2026 19:41
👍 2
🔁 0
💬 0
📌 0
Awesome! Just requested a review copy for my Political Persuasion class.
04.12.2025 17:17
👍 1
🔁 0
💬 0
📌 0
This is wonderful. I was on leave this semester but this makes me excited about coming back. I also think AI has forced us profs to become more creative and thoughtful about our assignments and our teaching, which is a good thing.
04.12.2025 17:08
👍 1
🔁 0
💬 0
📌 0
And I'm pretty sure your office is right by a Nordstrom Rack, just saying...
20.11.2025 17:19
👍 1
🔁 0
💬 1
📌 0
I also recently needed a new wallet and got so overwhelmed by the online options that I went to Marshalls and just bought the most acceptable of the four options they had available. Satisficing!
20.11.2025 17:18
👍 4
🔁 0
💬 2
📌 0
Review says "Good toy. It pleased the child."
Love a concise Amazon review.
10.11.2025 19:23
👍 36
🔁 0
💬 2
📌 1
Just logged onto this site for the first time in a couple of weeks and THANK YOU! So glad it is resonating.
31.10.2025 16:28
👍 0
🔁 0
💬 0
📌 0
I never buy luxury brands inconsistent with the characteristics with which I describe myself (seven point scale from strongly disagree to strongly agree)
Guys today is a red-letter day for bad survey questions. Look at this lovely double negative that just rolled in!
20.08.2025 19:31
👍 17
🔁 3
💬 4
📌 0
Good question! (1) requires too much cognitive work to parse what it's asking for, (2) too much abstract thinking, (3) poorly differentiated response options (e.g. good chance vs strong chance)
20.08.2025 14:40
👍 7
🔁 0
💬 1
📌 0
The actual survey had probably 20 versions of this question. I almost never satisfice on surveys but I lacked the cognitive focus to interpret each one. Sorry, researchers.
20.08.2025 14:11
👍 4
🔁 0
💬 1
📌 0
Survey question reading "When deciding whether to pursue a new long-term goal, what is the chance you will overestimate how challenging it will be to achieve?" Answer options: No chance, very slight chance, slight chance, moderate chance, good chance, strong chance, certain
for everyone teaching survey design this fall, great news: a new terrible question example just dropped! (this is from a real survey I just took) 😱
20.08.2025 14:08
👍 45
🔁 11
💬 10
📌 2
same. just gonna go ahead and put it all on my FSA card.
19.08.2025 18:49
👍 2
🔁 0
💬 0
📌 0
Or, even worse, accurate.
17.07.2025 12:31
👍 3
🔁 0
💬 0
📌 0
Survey question asking which of the following best describes your current job title or role, options like "Vice President," "General Manager," and "Individual Contributor"
From a Washington Post reader survey I just took. What a bizarre list of job titles. Also I love the idea that it's critically important to distinguish between the Presidents and Vice Presidents among their readership. TOTALLY different news preferences.
16.07.2025 19:19
👍 17
🔁 1
💬 2
📌 1
this made me laugh out loud in the middle of a meeting
29.05.2025 18:23
👍 2
🔁 0
💬 1
📌 0
I'm excited for what I hope will be an increase in LLM-assisted descriptive content analysis...especially looking forward to when someone (who is not me) looks at the topics of news coverage across multiple outlets and time periods.
29.05.2025 15:24
👍 1
🔁 0
💬 0
📌 0
great call — more experiments and within-subject panels / less emphasis on what the national topline happens to be today while worrying about whether it got the sample right feels like a worthwhile trade for the public polling industry
14.05.2025 13:02
👍 17
🔁 5
💬 1
📌 0
Agreed. I think they are often BETTER when they hand-write than when they type because they don't try to fancy it up and instead write more like they speak.
07.05.2025 15:48
👍 7
🔁 0
💬 1
📌 0
I switched to blue books a few years ago. It's fine! Student handwriting is mostly readable, the score distributions are similar, they have not lost the ability to write or concentrate or form coherent sentences. Students who need accommodations take at at our CDR, easy-peasy.
07.05.2025 15:45
👍 6
🔁 1
💬 0
📌 0
I think figuring out concrete strategies to deal with it is the opposite of letting down one's guard. It's acknowledging that it's a game changer and figuring out how to adapt.
07.05.2025 15:43
👍 0
🔁 0
💬 1
📌 0
I'm pretty over the doomsaying/complaining about AI and student learning and interested in moving on to the "solutions" part. In-class writing (by hand!) exercises, non-generic paper topics, etc. We can adapt! It might even be fun!
07.05.2025 13:01
👍 14
🔁 1
💬 4
📌 0
[starts going through all of Drew's coauthors so I can figure out who to high-five at the next APSA]
09.04.2025 14:27
👍 2
🔁 0
💬 0
📌 0
There is NOTHING on the front page of Fox News about the stock market crash. Nothing at all.
03.04.2025 15:28
👍 28
🔁 5
💬 3
📌 1
(screenshot taken from the linked paper by @vinarceneaux.bsky.social @m-b-petersen.bsky.social and Mathias Osmundsen)
01.04.2025 18:04
👍 2
🔁 0
💬 0
📌 0
Pretty horrifying how well the "need for chaos" survey battery describes the Trump/Musk administration's current approach to governing. www.cambridge.org/core/journal...
01.04.2025 18:02
👍 12
🔁 3
💬 1
📌 0
Also I love that you made a PDF blog.
18.03.2025 14:42
👍 3
🔁 0
💬 1
📌 0
I totally missed this (this is what happens when you log onto Bluesky only once every six weeks). And yes, I was assuming variation to measure causal effects -- I guess I shouldn't have said "descriptive" when what I meant was "causal inference that is not aimed only at 'proving' a 'theory'"
18.03.2025 14:39
👍 3
🔁 0
💬 0
📌 0