scottatyson.bsky.social

Just published on APSR First View: "Partisan Leaning" by Zuheir Desai, Anderson Frey, and Scott Tyson. www.cambridge.org/core/journal...

To characterize the relationship between replication and external validity, they show that sign-congruent external validity and harmonization of studies are required to guarantee target-congruence between studies. You can read the paper here: www.cambridge.org/core/journal...

How do you know when a mechanism is externally valid? In“ Sign-Congruence, External Validity, and Replication,” @tara-slough.bsky.social and @scottatyson.bsky.social develop a framework for accumulating evidence across multiple studies and develop theoretical foundations for replication.

Red, yellow and white Political Analysis open access graphic

There are new #OpenAccess articles from @polanalysis.bsky.social available on the journal's #FirstView page -

cup.org/40mppbd

Inc. papers by @tara-slough.bsky.social, @devincaughey.bsky.social, @mehrl.bsky.social, @olsisblue.bsky.social, @corneliusfritz.bsky.social, @pkoc.bsky.social & and more

will need to have time to read in full, but this is 👌

📌

This book changed my mind about what a random-effects meta-analysis says about generalizability. I used to think it could *show* generalizability, now I understand it *asserts* generalizability.

An absolute thriller (although you may not be able to ID the suspect): BUY IT NOW 👇🏼

We also consider recently popular extrapolation approaches that impute from an estimated treatment effect in one setting to its analogue in another setting. These methods also invoke uniting principles which are typically very strong.

Part 2 explores applications.

We show that *meta-analysis* and *replication* both invoke distinct uniting principles. By making explicit the assumptions each approach invokes, we can see what is learned---or not---from each method.

We advocate for measurement perspectivism, which emphasizes that substantive phenomena are distinct from the tools we use to observe and measure them. Researchers make choices about what concepts to measure, how to observe those measures, and how to quantify those observations.

Takeaways from Part I:
When studying a mechanism empirically one must consider how its influence is measured

Assessing general phenomenon engages with some form of external validity

Accumulating evidence requires uniting principles characterizing relationships between studies

Uniting principles are the set of arguments that relate studies both qualitatively and quantitatively.

We explore two:

1. Common Concepts articulates the common mechanism across studies

2. Quantitative Connection gives the quantitative relationship uniting different findings

Evidence accumulation is about whether empirical findings, collected in one particular place and time, speak to a broader social phenomenon. We develop a new concept for evidence accumulation, uniting principles, which provide the foundation of any effort to accumulate evidence.

Part 1 develops key theoretical concepts for evidence accumulation. Part 2 applies those concepts to meta-analysis, replication, and extrapolation

External Validity and Evidence Accumulation Cambridge Core - Political Theory - External Validity and Evidence Accumulation

So happy to announce that my book with @tara-slough.bsky.social is now out at Cambridge Elements!!

External Validity and Evidence Accumulation

Link: www.cambridge.org/core/element...

Friendsgiving! And a birthday sash #40 @scottatyson.bsky.social