Online Studies
Psychological Science requires that authors who use samples from online data collection include a statement in the Method section explicitly addressing their approach to preventing and detecting automated or AI-generated responses.
Rationale
As large language models and other generative AI tools become more accessible, the risk of data contamination by non-human respondents has increased dramatically in research. Psychological science (and the social sciences generally) is particularly susceptible to this issue given its growing reliance on online data collection. Preventing automated responses during data collection and detecting them afterward often involve methodological trade-offs. For instance, technical barriers that aim to prevent LLM use (e.g., blocking copy-pasting functionalities) may eliminate behavioral indicators needed for detection (e.g., pasting rather than typing). This policy aims to enhance transparency and reproducibility of reported results by requiring authors to articulate their approach across both prevention and detection dimensions, enabling readers and reviewers to assess the likelihood of reported data being influenced by automated responses.
Scope
This policy applies to any submission with at least one study that includes data collected online without direct human supervision (e.g., via crowdsourcing platforms, student participants who complete the study online, online recruitment ads, or remote survey distribution tools).
Required Reporting
Authors must include in the Methods section either:
A statement confirming that procedures were in place to prevent and/or detect and exclude automated or AI-generated responses, including a description of those procedures (e.g., explicit participant instructions against LLM use, disabled copy–paste functionality, CAPTCHA use, IP filtering, consistency checks, attention checks, adversarial prompting) as well as the types of automated responses that these procedures are suitable …
Maybe of interest: The submission guidelines of Psychological Science now demand an explicit statement on measures taken to reduce the risk of AI-generated responses for all online studies!
www.psychologicalscience.org/publications...
25.02.2026 12:08
👍 124
🔁 53
💬 1
📌 0
Paper on statistical power necessary for interaction effects
doi.org/10.1177/2515...
20.02.2026 09:17
👍 154
🔁 60
💬 4
📌 8
The psych job market isn’t dead! Join us at UIC!!! We are looking for a clinical psychologist (assistant or associate level)!! Chicago is simply the best, and the department is incredibly lovely! I’m not on search committee, but as the “newest” hire, I’m happy to talk about my experience thus far!
02.09.2025 02:40
👍 67
🔁 38
💬 1
📌 4
We randomized 7,505 American adults experiencing depression to one of the 12 SSIs or a control.
Nearly all SSIs boosted agency and hope for improvement immediately (Cohen's ds ≤ 0.37). However, only two significantly reduced depression four weeks later (ds = 0.14 and 0.15).
26.08.2025 17:47
👍 9
🔁 3
💬 1
📌 0
So awesome — congrats!! 🥳🥳🥳
06.08.2025 13:34
👍 1
🔁 0
💬 1
📌 0
This makes me so so bloody happy to hear, Tom!!!! 🥳🥳
Also, welcome to Bluesky! It's been a while -- hopefully catch you at a conference or some catch up soon!
11.05.2025 10:39
👍 2
🔁 0
💬 0
📌 0
Headshot of Dr. Reinout Wiers smiling
THIS THURSDAY Free @abctnow.bsky.social NTTR SIG Webinar, 11am EST/8am PST/ 5pm CET! Dr. Reinout Wiers, Prof of Developmental Psychopathology, Univ of Amsterdam, will be speaking on "New Developments in Cognitive Bias Modification for Addiction." For more info, email nttrsig@gmail.com.
Plz share!
18.02.2025 07:19
👍 2
🔁 0
💬 0
📌 0
a close up of a man 's face with the words dr.doctor.tumblr visible in the corner
ALT: a close up of a man 's face with the words dr.doctor.tumblr visible in the corner
But yeah, if you're still using mean bias scores then your goose is cooked (which so much of the prior lit did).
When I get manuscripts to review that still to this day use mean bias scores, my immediate reaction is YIKKKEEESSSSS.
07.01.2025 07:02
👍 0
🔁 0
💬 0
📌 0
For measuring how attentional processes for emotional information may be biased in psychopathology? Probably not. I prefer a 2x2 free viewing task, though that is more about preferential allocation of attention. Still TONS of room for improvement but the dot-probe task *itself* isn't unreliable
07.01.2025 06:59
👍 0
🔁 0
💬 1
📌 0
modeled bias scores (a la Vanessa and co's work), and attention bias variability outcomes from the dot-probe tend to have solid reliability. A task similar to the dot-probe by Ben Grafton and co, the dual-probe task, also has good reliability.
Now is the dot-probe task the optimal approach 2/
07.01.2025 06:59
👍 0
🔁 0
💬 1
📌 0
Hesitant to wade too far into this topic (could go on for days) but it's not the task that has poor reliability per se but traditional mean RT bias scores; the outcome of subtracting two highly correlated variables will always have terrible reliability. Trial-level bias scores, computationally 1/
07.01.2025 06:59
👍 0
🔁 0
💬 1
📌 0
The Portable Mentor
Cambridge Core - Psychiatry - The Portable Mentor
So excited! A donor has made The Portable Mentor totally and completely FREE for anyone!!!!!! No royalties, no sign up, just download any/all of the 30 chapters of professional development advice!!! HOORAY!!!!! Equal access for everyone!!!!
Check out the ToC!
www.cambridge.org/core/books/p...
13.12.2024 18:26
👍 144
🔁 82
💬 6
📌 6
Hey Anthony, any chance I could get added? On the clinical practice side it’s mostly supervision and training these days but still trying to keep my clinical skills sharp!
Hope you had a wonderful Thanksgiving holiday, my friend!
30.11.2024 17:54
👍 2
🔁 0
💬 1
📌 0
At #psynom24 yesterday, I gave a 15-min presentation that some may label as a "midlife crisis" talk. I was delighted that so many people came! Thanks! A few people asked me for the slides, so I've made them available here (minus those "reflection" slides)👇
drive.google.com/file/d/1SIDw...
24.11.2024 12:45
👍 45
🔁 7
💬 1
📌 3
So many new followers!! Hi folks, nice to meet you all. 🖤
I'll introduce my core research interests by showing you some of the work we've done in recent years on the conceptualization, measurement, modeling, and theories of mental health (problems).
🧪 #PsychSciSky #psychiatry #statssky
🧵
22.11.2024 13:14
👍 414
🔁 28
💬 21
📌 3
the Summer Internship
I used to run a summer internship for expanding psychology... if you don't remember here it is: som.yale.edu/news/2018/09...
The news is that we're back up and running in partnership with the Summer Research Opportunities Program (SROP) at Northwestern: www.summerpsych.com
Applications are open!
20.11.2024 21:20
👍 158
🔁 97
💬 3
📌 3
@mcmullarkey.bsky.social Honestly really worth revisiting our ultra brief intensive Tx for anxiety 😤😤😤 The results seemed so promising and I really am curious how far they can go… 👀👀
22.11.2024 15:51
👍 2
🔁 0
💬 2
📌 0
Hey Vera! Any chance I could get added? Thanks so much for putting this pack together 🙏🏼
21.11.2024 19:47
👍 1
🔁 0
💬 1
📌 0
A name tag by an airplane window looking out at Singapore Changi Airport
ABCT2024 speed run ✅
Thankful for:
-Catching up with old friends, colleagues, and collaborators
-Plenty of stimulating talks
-Project riffing with collaborators
-Lots of cheesesteak and roast pork sandwiches
Less thankful for:
-Jetlag and 17+ hr flights each way 🥲🥲
Alr excited for ABCT2025!
18.11.2024 22:07
👍 4
🔁 0
💬 0
📌 0
ADULT FORENSIC TRACK
Fellows on the Adult Forensic Track conduct court-ordered competency evaluations. These competency evaluations are primarily conducted through the New Mexico Second Judicial District Court (SJDC) Competency Clinic, the district within which UNM resides and the largest district in New Mexico. Fellows will also be exposed to competency evaluations in other districts, many with their own unique cultural landscapes and cultural factors relevant to clinical conceptualization and competency. Additional clinical training in evaluations addressing police academy suitability, psychological fitness for duty, civil disability, additional legal competencies, and other psycholegal questions (spanning a diverse landscape of New Mexico jurisdictions) may also be available. Fellows on the Adult Forensic Track can also receive training in youth forensic evaluation offering services in the youth forensic track.
YOUTH FORENSIC TRACK
Fellows on the Youth Forensic Track will conduct juvenile competency evaluations for the Children, Youth, and Families Department of the State of New Mexico. These competency evaluations are conducted primarily in the Second District (the district within which UNM resides and the largest district in New Mexico) and neighboring districts, many of which have their own cultural landscapes relevant to child development and competency-related issues. Additional clinical training in youth-related forensic issues addressing amenability to treatment, risk assessment and sentencing considerations ("mitigation evaluations"), and other psycholegal issues affecting legally involved youth may also be available. Fellows on the youth forensic track can also receive training in adult forensic evaluation offering services in the adult forensic track.
Randy Otto, PhD, ABPP is a clinical psychologist who is board certified in clinical psychology and forensic psychology. He was a member of the faculty for 33 years at the University of South Florida and for 3 years at Nova Southeastern University. Dr. Otto will join the faculty in the Department of Psychiatry and Behavioral Sciences at the University of New Mexico in the spring of 2025, where he will serve as Chief of the Division of Forensic Behavioral Sciences. Dr. Otto currently serves as the Executive Director of the American Board of Forensic Psychology, he was president of the Board of Trustees of the American Board of Professional Psychology, he chaired the American Psychological Association committee that revised the Specialty Guidelines for Forensic Psychology, and he was a member of the American Bar Association committee that revised the Criminal Justice Mental Health Standards. He has received awards for his contributions to professional psychology from the University of Nebraska, the New York State Psychological Association, the American Psychology-Law Society, the American Academy of Forensic Psychology, and the American Board of Professional Psychology.
Fellows experience the unique position of working directly and closely with forensic policymakers via New Mexico's Behavioral Health Services Division of Health and Human Services, contributing specifically to forensic policy advocacy and change. Although the policy experience looks different each year (because of dependence on projects and programs being addressed), you can expect to learn persuasive writing techniques, overall functioning of state systems, and effective participation on committees and boards. Past fellows have written situation reports and policy papers, designed psycholegal programs, conducted program evaluation/outcome research, conducted policy analysis, served as active participants in the Supreme Court Commission on Mental Health and Competency and the Legislative/ Rule Change Subcommittee, and served on the Sentencing Commission Legislative Committee.
You will directly impact clinical forensic practice through clinical and policy work simultaneously.
Big updates to UNM's Forensic Psychology Postdoctoral Fellowship this cycle! Like:
1) We secured a 3rd position & now offer adult & youth tracks!
2) ABFP Director Randy Otto joins us as chief of our forensic division!
3) Collaborate on forensic policy w/ @jenperillo.bsky.social, me, & state reps!
18.11.2024 15:33
👍 31
🔁 15
💬 3
📌 1
Help me populate this Hidden Curriculum Starter Pack! Let's make it easy for students to find the resources they need. go.bsky.app/FFHc9C3
18.11.2024 12:01
👍 28
🔁 15
💬 8
📌 1
Congrats!!! 🎉🎊
16.11.2024 22:46
👍 1
🔁 0
💬 0
📌 0
Please help! I'm trying to make a #starterpack! Suggest some names, share, let me know if you'd like to be added!
#sociology #academicsky #socsky #psychsky #polisky
go.bsky.app/BqCatpb
13.11.2024 19:22
👍 90
🔁 35
💬 19
📌 2
Hey Miri, thanks so much for creating this awesome starter pack! 🔥🔥 Any chance I could get added? 🙏🏼 Hope all has been well!
16.11.2024 13:59
👍 1
🔁 0
💬 2
📌 0
Hey Lesley, any chance I could be added? 🙏🏼 Thanks for putting this pack together!
16.11.2024 09:50
👍 1
🔁 0
💬 1
📌 0
go.bsky.app/SsNPcGP
Here is the Starter pack!!! We have over 100 spots available (and if we hit the limit of 150, I'll make a part two). PLEASE share, ask to be added, and let me know if you'd like to see anyone added.
15.11.2024 11:26
👍 191
🔁 96
💬 91
📌 7