An Audit of Social Science Survey Experiments
Abstract. Survey experiments have become a popular methodology for causal inference across the social sciences. We study the efficacy of survey experiment
Needed - larger samples, more realism about (the lack of) heterogeneous treatment effects:
-"less than a third of proposed hypotheses were supported... the largest predictor of positive exp. results was sample size"
-"moderation hypotheses were rarely significant"
academic.oup.com/poq/advance-...
30.11.2025 15:16
👍 83
🔁 36
💬 4
📌 3
"The evidence reviewed here suggests that key assertions in the The Body Keeps the Score – particularly those concerning trauma-induced brain damage and the unique efficacy of body-based treatments – are not supported by the current weight of research."
04.11.2025 15:09
👍 2
🔁 1
💬 1
📌 0
What a NIMBY
11.09.2025 03:04
👍 1
🔁 0
💬 0
📌 0
Let's control for setting & experience. Does NOT count if one says, "The students in the first place I taught were known for causing more problems than students in other places," or, "There were more problems caused by students because I wasn't as good at managing a classroom earlier in my career."
22.12.2024 18:01
👍 0
🔁 0
💬 0
📌 0
I hear many fellow educators say students today cause more problems in class than past students.
I'm curious, though: has anyone known an educator who said that students they taught earlier in their career engaged in more problematic behaviors than students they taught later in their career?
22.12.2024 18:00
👍 1
🔁 0
💬 1
📌 0
...the latter.
24.11.2024 19:18
👍 1
🔁 0
💬 0
📌 0
Thanks, Lorenzo! Right back at ya!
04.10.2023 20:09
👍 2
🔁 0
💬 0
📌 0
#AcademicSky #PsychSciSky follow @williamspsych.bsky.social he be critical-thinking
04.10.2023 19:36
👍 6
🔁 3
💬 1
📌 0
Trying and failing to recall the content of my first tweet. I suspect it concerned the Iranian Presidential election in 2009.
04.10.2023 18:35
👍 2
🔁 0
💬 0
📌 0