Mark Rubin's Avatar

Mark Rubin

@markrubin

social psychology ▪︎ metascience ▪︎ philosophy of science ▪︎ higher education Professor at Durham University, UK. He/him. Website: https://sites.google.com/site/markrubinsocialpsychresearch/ Substack: https://markrubin.substack.com/

19,746
Followers
1,913
Following
5,504
Posts
03.07.2023
Joined
Posts Following

Latest posts by Mark Rubin @markrubin

Vice Chancellor Prof Andy Long explained that:

“Northumbria is not facing the kind of existential crisis affecting some institutions in our sector. We are acting now precisely because we are in a position of relative strength, and we intend to stay there.”

#UKHE

07.03.2026 09:59 👍 0 🔁 0 💬 0 📌 0

“UCU regional official Lawson Armstrong pointed out that the £25 million savings target is the same amount the university is spending on the building of a space skills, research and development centre.”

07.03.2026 09:59 👍 0 🔁 0 💬 1 📌 0
Preview
University facing £25m cuts by end of 2026 as staff offered voluntary severance Northumbria University staff are being offered voluntary severance, with vice chancellor Prof Andy Long warning that UK’s higher education sector is in “one of the most challenging financial periods i...

Staff at Northumbria University told the uni needs to save £25 million by the end of the year. Voluntary severance is now on offer.

07.03.2026 09:59 👍 0 🔁 0 💬 1 📌 0

Yes parapsychology has a lot to teach us.
But I'd say, to have repeatable observations you need at least an interpretative theory, otherwise you don't know what you're observing and whether it's been "repeated."

07.03.2026 08:49 👍 1 🔁 0 💬 0 📌 0

#PhilSci #Methodology

07.03.2026 08:13 👍 1 🔁 0 💬 0 📌 0

Naive empiricism and methodologism

"The dogged experimental pursuit of paraphysical results within a vacuum of genuine paraphysical theory seems to me to be methodologically barren, even if the experiments are performed with meticulous care, and even if they produce some genuinely puzzling results"

07.03.2026 08:13 👍 3 🔁 2 💬 1 📌 0
If someone predicts the results of a long series of coin tosses with 100 percent accuracy, it is no explanation of this surprising result simply to say that the subject "has precognition." As well explain why sodium amy tal puts you to sleep ,by saying it "has a dormative virtue." A real explanation would cite the nonphysical mechanisms involved, identify the empirical facts that reflect them, appeal to the laws that govern them, and then deduce exactly the surprising effect observed. Parapsychology does none of these things.

If someone predicts the results of a long series of coin tosses with 100 percent accuracy, it is no explanation of this surprising result simply to say that the subject "has precognition." As well explain why sodium amy tal puts you to sleep ,by saying it "has a dormative virtue." A real explanation would cite the nonphysical mechanisms involved, identify the empirical facts that reflect them, appeal to the laws that govern them, and then deduce exactly the surprising effect observed. Parapsychology does none of these things.

"If someone predicts the results of a long series of coin tosses with 100 percent
accuracy, it is no explanation of this surprising result simply to say that
the subject 'has precognition'."

07.03.2026 08:13 👍 1 🔁 1 💬 1 📌 0
There are further problems with the methodology of looking for some effect, any effect, that cannot be accounted for in normal physical terms. For when such results are achieved (or rather, are alleged to be achieved), the results may indeed be mysterious from a physical point of view, but 
they remain equally mysterious from the nonphysical point of view. The reason is that the parapsychologists are no better able to provide an explanation than are the physicists, for parapsychology has no significant theoretical resources with which to construct any explanations.

There are further problems with the methodology of looking for some effect, any effect, that cannot be accounted for in normal physical terms. For when such results are achieved (or rather, are alleged to be achieved), the results may indeed be mysterious from a physical point of view, but they remain equally mysterious from the nonphysical point of view. The reason is that the parapsychologists are no better able to provide an explanation than are the physicists, for parapsychology has no significant theoretical resources with which to construct any explanations.

Theories are needed to explain effects...

07.03.2026 08:13 👍 1 🔁 0 💬 1 📌 0

And when we move to a new theoretical framework...

"Such a reconfigured vision can reveal dramatic failures in the old theory, failures that were invisible, as failures, from within the old framework."

07.03.2026 08:13 👍 2 🔁 2 💬 1 📌 0
It remains possible, however, that the important empirical facts that reflect the falsehood of the favored and so far "successful" theory are to be found in precisely those experimental areas thought to be intractable, or are to be found just over the horizon of controlled detail in areas that are tractable. In such cases the favored theory enjoys a safety from refutation that it does not deserve. The refuting facts are there, but for complex reasons they are difficult or impossible to see, at least while we continue to interpret the situation in terms of the favored theory. For it is that same theory that helps us decide which details are relevant and which are irrelevant, and which situations are tractable and which are intractable.

It remains possible, however, that the important empirical facts that reflect the falsehood of the favored and so far "successful" theory are to be found in precisely those experimental areas thought to be intractable, or are to be found just over the horizon of controlled detail in areas that are tractable. In such cases the favored theory enjoys a safety from refutation that it does not deserve. The refuting facts are there, but for complex reasons they are difficult or impossible to see, at least while we continue to interpret the situation in terms of the favored theory. For it is that same theory that helps us decide which details are relevant and which are irrelevant, and which situations are tractable and which are intractable.

"The refuting facts are there, but for complex reasons they are difficult or impossible to see, at least while we continue to interpret the situation in terms of the favored theory."

07.03.2026 08:13 👍 1 🔁 0 💬 1 📌 0

"There is no essential vice in this. The alternative is to try to control the position and character of every particle in the universe. Instead, we control as much as we think it is necessary and prudent to control, and let the rest go."

07.03.2026 08:13 👍 2 🔁 0 💬 1 📌 0

"Any successful theory quite properly ignores or suppresses a good deal of faintly troublesome empirical evidence as irrelevant and inevitable 'noise'."

07.03.2026 08:13 👍 1 🔁 1 💬 1 📌 0

"Pulling new signal out of old noise."

Fascinating discussion of the importance of theory and theory change in science, and not just parapsychology... 🧵

07.03.2026 08:13 👍 4 🔁 1 💬 2 📌 0

#statstab #499 SIMPLICITY AND COMPLEXITY IN ECOLOGICAL DATA ANALYSIS

Thoughts: I dislike this paper, but I don't mind sharing views that disagree with my own. Effective communication matters.

#analysis #critique #critical #ANOVA #ttest #simplicity #communication

doi.org/10.1890/0012...

05.03.2026 19:09 👍 2 🔁 1 💬 1 📌 0
Parsimony Since all models are wrong the scientist cannot obtain a "correct" one by excessive elaboration. On the contrary following William of Occam he should seek an economical description of natural phenomena. Just as the ability to devise simple but evocative models is the signature of the great scientist so overelaboration and overparameterization is often the mark of mediocrity.

Parsimony Since all models are wrong the scientist cannot obtain a "correct" one by excessive elaboration. On the contrary following William of Occam he should seek an economical description of natural phenomena. Just as the ability to devise simple but evocative models is the signature of the great scientist so overelaboration and overparameterization is often the mark of mediocrity.

Fair enough. Yes simpler ≠ better. But also better ≠ complex, and I sometimes worry that people use fancy stats to impress rather than out of necessity.

Anyway, here’s Box (1976) on parsimony: doi.org/10.1080/0162... And looking forward to your post!

05.03.2026 20:03 👍 1 🔁 0 💬 1 📌 0
Preview
SIMPLICITY AND COMPLEXITY IN ECOLOGICAL DATA ANALYSIS I argue that ecological data analyses are often needlessly complicated, and I present two examples of published analyses for which simpler alternatives are available. Unnecessary complexity is often ...

Appreciate you sharing. Why don't you like it?

(Working link:
doi.org/10.1890/0012... )

05.03.2026 19:23 👍 1 🔁 0 💬 1 📌 0

Maybe one for the platform's founder @mfenner.bsky.social to check out.

05.03.2026 19:22 👍 1 🔁 0 💬 1 📌 0
Preview
Open Research, Gender, and Ethics Discover how open research can shake up gender norms and ethics in this online event.

VERY excited for this event as part of the London Open Science & Scholarship Festival 2026 (online, April 20th).

We don’t talk enough about the patriarchal ideologies embedded in many dominant applications of “open science “

05.03.2026 11:31 👍 14 🔁 6 💬 3 📌 0

For similar results, see...

#MetaSci #SocialPsyc

05.03.2026 16:50 👍 1 🔁 0 💬 0 📌 0
Whereas our findings support a moderate effect of MS on clinically relevant symptoms, several limitations temper the strength of these conclusions. The observed heterogeneity, combined with flexible outcome operationalizations and the near-total absence of manipulation checks highlight the need for greater critical scrutiny. Although p-curve analyses suggest evidential value, z-curve results point to low replicability and inflated discovery rates, raising concerns about the stability of the MS effects. This reinforces the fact that relying solely on traditional univariate meta-analytic approaches may no longer be sufficient on their own. Instead, we propose a shift toward more transparent, multi-method evaluations integrating a balanced perspective on both the strengths and blind spots of (TMT) research.

Whereas our findings support a moderate effect of MS on clinically relevant symptoms, several limitations temper the strength of these conclusions. The observed heterogeneity, combined with flexible outcome operationalizations and the near-total absence of manipulation checks highlight the need for greater critical scrutiny. Although p-curve analyses suggest evidential value, z-curve results point to low replicability and inflated discovery rates, raising concerns about the stability of the MS effects. This reinforces the fact that relying solely on traditional univariate meta-analytic approaches may no longer be sufficient on their own. Instead, we propose a shift toward more transparent, multi-method evaluations integrating a balanced perspective on both the strengths and blind spots of (TMT) research.

“We propose a shift toward more transparent, multi-method evaluations integrating a balanced perspective on both the strengths and blind spots of (TMT) [terror management theory] research.”

05.03.2026 16:50 👍 0 🔁 0 💬 1 📌 0
Terror Management Theory (TMT) proposes that awareness of one’s mortality can trigger emotional distress and amplify symptoms in vulnerable individuals when protective buffers are weakened. However, doubts about replicability and methodological rigor have grown. We conducted a multivariate three-level meta-analysis examining mortality salience effects on clinically relevant outcomes, synthesizing 61 outcomes from 22 randomized controlled trials (N = 2571). Results showed a moderate pooled effect (g = 0.49, 95% CI [0.20, 0.79]), with significant moderation by DSM-5 symptom type, delay presence, and study location. Publication bias was evaluated using multilevel Egger’s tests, the three-parameter selection model, and both p-curve and z-curve. P-curve indicated evidential value and moderate-to-high power, whereas z-curve suggested inflated discovery rates and low replicability. Overall, findings point to the need for stronger transparency and methodological checks, whereas the substantial heterogeneity in outcome measures and considerable flexibility in interpretation raise concerns about the robustness of TMT research.

Terror Management Theory (TMT) proposes that awareness of one’s mortality can trigger emotional distress and amplify symptoms in vulnerable individuals when protective buffers are weakened. However, doubts about replicability and methodological rigor have grown. We conducted a multivariate three-level meta-analysis examining mortality salience effects on clinically relevant outcomes, synthesizing 61 outcomes from 22 randomized controlled trials (N = 2571). Results showed a moderate pooled effect (g = 0.49, 95% CI [0.20, 0.79]), with significant moderation by DSM-5 symptom type, delay presence, and study location. Publication bias was evaluated using multilevel Egger’s tests, the three-parameter selection model, and both p-curve and z-curve. P-curve indicated evidential value and moderate-to-high power, whereas z-curve suggested inflated discovery rates and low replicability. Overall, findings point to the need for stronger transparency and methodological checks, whereas the substantial heterogeneity in outcome measures and considerable flexibility in interpretation raise concerns about the robustness of TMT research.

New meta-analysis finds “that MS [mortality salience] effects on clinically relevant outcomes may exist, yet remain fragile and difficult to reproduce consistently.”

www.tandfonline.com/doi/full/10....

05.03.2026 16:50 👍 2 🔁 0 💬 1 📌 1
Post image

Recently published...

The Oxford Handbook of Leadership, Followership, and Identity

doi.org/10.1093/oxfo...

#SocialPsyc #OrgPsyc

05.03.2026 12:26 👍 5 🔁 1 💬 0 📌 0

#SocialPsyc #MetaSci

05.03.2026 10:46 👍 0 🔁 0 💬 0 📌 0
Preview
Yes, Cognitive Dissonance Is Still Actually a Thing | Skeptical Inquirer Psychological science—particularly social psychology—is suffering an ongoing crisis of confidence. The field has endured a replication crisis stemming from ...

“Yes, cognitive dissonance is still actually a thing. In the world of journalism, it would be a more exciting and clickable narrative if the answer were “no,” but that’s the problem with narrative. Sometimes the truth—like turning blocks one quarter of a turn—is just boring."
@stuartvyse.bsky.social

05.03.2026 10:46 👍 12 🔁 2 💬 1 📌 1
Post image

190 academic blogs are now indexed by Rogue Scholar at rogue-scholar.org

#AcademicSky #PhDSky 🧪

05.03.2026 09:16 👍 14 🔁 4 💬 1 📌 0
Preview
The Triumph of Ego Depletion The Real Story Behind One of Social Psychology’s Most Replicated Findings

And for a recent defense of the replicability of the ego-depletion effect, see...

#SocialPsyc #MetaSci

05.03.2026 08:32 👍 0 🔁 0 💬 0 📌 0

For a recent discussion of the ego depletion research program, see...

05.03.2026 08:32 👍 0 🔁 0 💬 1 📌 0
Over the past decade, the robustness of the ego-depletion effect has been widely questioned. Possible reasons for variations in the ego-depletion effect may be participant expectations of the demand of the upcoming task and experimenter expectations or demand bias. In three experiments we tested the hypothesis that the ego-depletion effect is partly or exclusively attributable to (i) participants’ expectations of the task (Studies 1a and b) and (ii) experimental demand bias (Study 2). In all studies we did not observe a robust ego-depletion effect, and only participants informed that the task was tiring exhibited the effect. Taken together, our findings suggest that participant and experimenter expectations can influence performance in ego-depletion paradigms. However, more research is necessary to determine the extent to which these expectations—rather than other social-motivational factors—drive the effect.

Over the past decade, the robustness of the ego-depletion effect has been widely questioned. Possible reasons for variations in the ego-depletion effect may be participant expectations of the demand of the upcoming task and experimenter expectations or demand bias. In three experiments we tested the hypothesis that the ego-depletion effect is partly or exclusively attributable to (i) participants’ expectations of the task (Studies 1a and b) and (ii) experimental demand bias (Study 2). In all studies we did not observe a robust ego-depletion effect, and only participants informed that the task was tiring exhibited the effect. Taken together, our findings suggest that participant and experimenter expectations can influence performance in ego-depletion paradigms. However, more research is necessary to determine the extent to which these expectations—rather than other social-motivational factors—drive the effect.

New study finds demand and experimenter bias partly explain the ego-depletion effect

Journal:
doi.org/10.1007/s121...

Open access: papers.ssrn.com/sol3/papers....

By @oulmann.bsky.social, @martinhagger.bsky.social, et al.

05.03.2026 07:56 👍 19 🔁 4 💬 1 📌 1

Ah right! Context, history, culture, reactivity! I think they’ve always been key parts of social psychology. Yes, more prominent in qualitative and interpretative traditions, but also reasonable candidates for explaining replication failures in social psyc.

04.03.2026 23:04 👍 1 🔁 0 💬 1 📌 0

Which arguments of qualitative and interpretative traditions are you thinking of? Any examples?

04.03.2026 21:17 👍 1 🔁 0 💬 1 📌 0