iiinova — where your digital self keeps evolving

Reposted by Brent W. Roberts

Dirk Wulff @dirkwulff.bsky.social · 10/06/2026

📣 Reporting checklist for LLMs in behavioral and social science New article presenting a consensus-based reporting checklist (GUIDE-LLM) for the use of LLMs in the behavioral and social sciences to foster transparency, reproducibility, and ethical use. 🔗 www.nature.com/articles/s41...

02110

Reposted by Brent W. Roberts

Sjoerd van Alten @sjoerdalten.bsky.social · 06/10/2026

1/12 Personality predicts earnings and wealth. But does it cause them? That is hard to answer: personality is correlated with family background and much else. In our new working paper, we use the randomness of genetic inheritance to get closer to a causal answer.

2198

Reposted by Brent W. Roberts

Kevin Mitchell @wiringthebrain.bsky.social · 05/10/2026

The Science of Scientific Writing www.americanscientist.org/blog/the-lon... - great advice in this article, on understanding what the reader needs!

americanscientist.org

0197

Reposted by Brent W. Roberts

Dan Quintana @dsquintana.bsky.social · 05/10/2026

Without actually sending your scripts/data to other people, it can be hard to ensure others can easily use your materials. This looks like a great solution. Another cool feature is that users can also tweak scripts to see how conclusions can change when different parameters are used.

12510

Reposted by Brent W. Roberts

Neuroskeptic @neuroskeptic.bsky.social · 03/10/2026

This is a disturbing story - two published neuroscience papers that were seemingly completed AI generated retractionwatch.com/2026/10/01/o... It was only detected because of a vigilant peer reviewer on a third submission @deevybee.bsky.social.

retractionwatch.com

When open data are misused

Credit: HALUSTD from Popspixel via Canva When Dorothy Bishop was asked to review a paper for a small neuroscience journal in August, she could tell from the abstract the authors had used a dataset …

35323

Reposted by Brent W. Roberts

Christoph Strauch @cstrauch.bsky.social · 02/10/2026

How much of a risk are LLM-generated bots for online behavioral experiments? We present results of an entirely natural language prompt-generated agent, capable of absolving any of the 26 experiments we tested it on. Most tasks are passed with data that can pass as human osf.io/preprints/ps... (1/)

59344

Reposted by Brent W. Roberts

Omid V. Ebrahimi @omidvebrahimi.bsky.social · 30/09/2026

📜 Out in Psychotherapy & Psychosomatics Most bereaved people adapt over time. Why do some stay stuck in grief? We tested whether how loss is remembered shapes grief symptoms over the first 18 months of bereavement w/Franziska Lechner-Meichsner, Anke Ehlers & Kirsten Smith doi.org/10.1159/0005...

1168

Reposted by Brent W. Roberts

Will Gervais @willgervais.com · 29/09/2026

🚨NEW PREPRINT🚨 @aiyanakoka.bsky.social Meara Geraty and I revisited religious priming, breaking the causal claim into links that we robustly tested. Do God Primes Prime God? Converging Evidence Against the Efficacy of Experimental Religious Priming osf.io/preprints/ps... #PsychSciSky #metascience

Do God Primes Prime God? Convergint evidence against the efficacy of experimental religious priming.

WIll Gervais, MEara Geraty, Aiyana Willard

then the rest of the image is a screenshot of the table of contents.

plot summarising bayes factor results testing:
Prime -> Religious concepts (overt primes yield positive evidence, scrambled sentence negative)

Prime -> prosociality: universaly evidence strongly favoring the null result across 4 primes and 2 operationalisations of prosociality

Prime -> suspicion: fairly universal evidence in favor of priming methods causing suspicion

Religious concepts -> $$$: four independent sets of evidence favoring the null

11714

Reposted by Brent W. Roberts

Richard Sever @richardsever.bsky.social · 28/09/2026

Noise/useless science rather than AI slop is a current challenge: "If medical schools and universities don't want the literature to be overwhelmed with garbage, they should stop giving every applicant ... an incentive to publish a lot of crap." www.medpagetoday.com/special-repo...

medpagetoday.com

Is AI Flooding Medical Journals With 'Meaningless' Research?

'It's not fraudulent, and it's not really slop,' one expert says

49026

Reposted by Brent W. Roberts

ingmarvisser.bsky.social @ingmarvisser.bsky.social · 28/09/2026

New paper 🍼📄 ManyBabies 3 is out (open access, registered report in Developmental Science). 30 labs, 33 languages, 839 infants set out to replicate a textbook finding: 7-month-olds learn abstract rules from speech (@garymarcus.bsky.social et al., 1999). We didn’t find it. 🧵

37948

Reposted by Brent W. Roberts

David Ho @davidho.bsky.social · 27/09/2026

The techbros don't want you to see this trailer. Pass it on.

3249752754

Reposted by Brent W. Roberts

Amanda J. Wright @ajwright.bsky.social · 25/09/2026

Since our paper on the Changing How I Live Life (CHILL) Study is now out in Psychological Science (doi.org/10.1177/0956...), here's a LONG overdue post on the intervention work we've been doing the past few years! Have you ever wanted to change one of your personality traits?

14720

Reposted by Brent W. Roberts

Institute for Replication @i4replication.bsky.social · 25/09/2026

Over the past two years, I4R partnered with Psychological Science (@psychscience.bsky.social) on a large reproducibility project. 67 independent teams reproduced 64 articles published in 2024–2025, about 44% of eligible papers. Paper: www.econstor.eu/bitstream/10... Here's what we learned 🧵

19260

Reposted by Brent W. Roberts

Kristian Steensen Nielsen @kristiansn89.bsky.social · 25/09/2026

🎯 What should we expect from behavior change interventions? Growing evidence suggests that most behavior change interventions have small effects on behavior. I regularly hear fellow behavioral scientists understandably feeling discouraged by this. But should we be discouraged? Not necessarily.🧵

44617

Reposted by Brent W. Roberts

Carsten Schwemmer @cschwem2er.bsky.social · 28/07/2026

1/6 What happens when you tell an AI browser: “Fill out this survey”? It fills out the survey. In our new study, led by @rtopinkova.bsky.social, we tested three consumer-facing agentic browsers without lengthy prompts, custom code, or technical fine-tuning.

33728

Reposted by Brent W. Roberts

McSweeney's @mcsweeneys.net · 22/09/2026

"When my guests come over, it’s gonna be like BLAMMO! Check out my shellacked decorative vegetables, assholes. Guess what season it is—fucking fall. There’s a nip in the air, and my house is full of mutant fucking squash." buff.ly/pykYN6f

buff.ly

It’s Decorative Gourd Season, Motherfuckers

For the seventeenth year: Welcome to autumn, fuckheads.

10364116

Brent W. Roberts @bwroberts.bsky.social · 21/09/2026

Exactly. Because we only publish half the truth, or half truths, then any synthesis of our work will be half wrong, at least. But given the fact that our half truths correspond to a preponderance of views searching for confirmation (bias) our work will still sell.

020

Reposted by Brent W. Roberts

Kou Murayama @koumurayama.bsky.social · 21/09/2026

Sorry I am no longer an active user but just post this job alert: With Peter Dayan and Michiko Sakaki, we are looking for a postdoctoral researcher who could work on cognitive computational modeling wth digital education data. Come to Tübingen!!: uni-tuebingen.de/fakultaeten/...

uni-tuebingen.de

Postdoctoral Research Fellow in Computational Modeling of Digital Education Data

01917

Brent W. Roberts @bwroberts.bsky.social · 21/09/2026

Lest you think this is just a self-report phenomena, we also see it in parent and teacher ratings. I think the interesting question is whether they are really getting worse, or whether they are simply feeling worse, or they are using a new set of standards to evaluate themselves, or all three. 3/

020

Brent W. Roberts @bwroberts.bsky.social · 21/09/2026

Our interpretation is that middle school, puberty, and the early adolescent Lord-of-the-Flies-social-milieu sucks and takes it out of you for a few years. @cjsotomatic.bsky.social and @jnfrltackett.bsky.social have named this the Disruption Principle. www.dropbox.com/scl/fi/d97ai... 2/

dropbox.com

Dropbox

110

Brent W. Roberts @bwroberts.bsky.social · 21/09/2026

oh, interesting interpretation. I could see if you were only focused on SRL skills that you could think that. On the other hand, we see drops in a wide range of attributes including SEB skills, self-efficacy, the variety of self-concepts, and even personality. 1/

100

Brent W. Roberts @bwroberts.bsky.social · 21/09/2026

Wait, wait, wait loads of things drop in early adolescence. It would be totally consistent with tons of longitudinal research if SRL took a nose dive between 11 and 14. Why wouldn't that be real?

110

Reposted by Brent W. Roberts

Dan Quintana @dsquintana.bsky.social · 19/09/2026

New preprint! 🎉 I analysed 1660 papers from 4 psychology journals and found materials sharing went from 9% of papers in 2015 to 82% in 2025, and these materials *do* get downloaded — a median of 135 times each. BUT shared code is often hard to run. doi.org/10.31234/osf... Let's walk through it 🧵

Two-panel figure. Panel a is a flow diagram tracking 1,611 empirical psychology articles from publication year (545 in 2015, 552 in 2020, 514 in 2025) to repository-link type: 785 link an OSF project, 85 link another platform, and 741 link no repository. Of those with an OSF link, download counts were retrieved for 670 and not retrieved for 115. Panel b is a line chart of the share of empirical papers linking OSF across 2015, 2020 and 2025. The overall rate, shown as a dashed black line, rises from 9% to 57% to 82%. All four journals rise steeply and end close together: Psychological Science 92%, JESP 89%, JML 83%, Cognition 76%, with Psychological Science highest throughout.

Three-panel figure. Panel a: ridgeline plot of downloads per file by material type on a log scale, with the percentage never downloaded labelled for each — archive 16% of 545 files, documents 20% of 2,970, code 12% of 3,471, other 17% of 1,646, data 21% of 10,051, media 35% of 2,120, images 35% of 4,102. Most files cluster between 1 and 10 downloads, with long right tails past 100. Panel b: ridgeline plot of downloads per paper by journal, log scale, with dashed median lines; Psychological Science is highest, then JESP, JML and Cognition. Panel c: stacked bars showing, for documents, data and code separately, the share of papers by download band (0, 1–10, 11–100, more than 100) in 2015, 2020 and 2025. The share exceeding 100 downloads falls sharply over time in all three types, from roughly two-thirds in 2015 to a quarter or less in 2025, as the 1–10 band grows.

Four-panel figure. Panel a: statistical languages detected among 333 papers with retrievable code — R 88%, SPSS 12%, Stata 4%, SAS 1%. Panel b: code red flags among those 333 papers — 34% hard-code an absolute path, 40% reference a missing file — above documentation among 672 OSF-linked papers — 21% have a README, 30% are documented by README, description or wiki. Panel c: among 562 Elsevier papers with no repository link, 44% (245) host at least one journal supplementary file but only 14% (77) host data, code or an archive. Panel d: composition of those 448 hosted files — documents 52%, data 21%, media 9%, other 7%, archive 6%, code 3%, images 1%. The code panels are green, the journal-supplement panels blue.

Coefficient plot (download predictors)

Dot-and-whisker plot of three standardised predictors of OSF download volume, each with a 95% confidence interval. Repository size (number of files) has the largest effect at about 0.76, citations about 0.38, and altmetric attention about 0.12. All three intervals sit entirely above zero, so each predicts more downloads, with repository size roughly twice the effect of citations and six times that of attention. X-axis: standardised effect, −0.2 to 1.0.

4266113

Reposted by Brent W. Roberts

Charlotte Walker @charlottewalker.bsky.social · 28/10/2023

Someone sent me this meme about peer reviewer comments and it is 👌🏻 #PhDSky #AcademicSky

3596183

Reposted by Brent W. Roberts

Per Engzell @pengzell.bsky.social · 18/09/2026

A paper is finished when the embarrassment of submitting it becomes smaller than the embarrassment of still working on it

630254

Reposted by Brent W. Roberts

Julia M. Rohrer @dingdingpeng.the100.ci · 18/09/2026

This is an *excellent* post on cluster analysis. If you ever thought about applying cluster, latent class or latent profile analysis to psychological scales, you absolutely should read this!>

512435

Reposted by Brent W. Roberts

Lukas Röseler @aufdroeseler.bsky.social · 17/09/2026

I predicted 1 out of 6 studies correctly in Guess the Replication, reaching the rank of "Junior Reviewer"! Can you do better? Play here: t1p.de/guther #GuessTheReplication

Guess the Replication certificate of achievement

031

Brent W. Roberts @bwroberts.bsky.social · 15/09/2026

I'd go with low C and high O. You try lots of things, unsystematically. If they are high A then they would be chaotic good. If low A, then chaotic evil...

030

Reposted by Brent W. Roberts

Health Nerd @gidmk.bsky.social · 15/09/2026

New piece on a great project from @matthewbjane.bsky.social looking at problematic research. Also, extremely worrisome issues in studies of exercise for depression. gidmk.substack.com/p/how-do-we-...

gidmk.substack.com

How Do We Deal With Seriously Problematic Research?

A new solution to a very serious issue

12910

Brent W. Roberts @bwroberts.bsky.social · 14/09/2026

Me likey--the RDoC of RDoC...we do an intensive longitudinal study of psychiatrists wearing the portable fMRI so we can capture their Id wishes in real time and therefore do double causality. Oh, and genes. We need jeans.

020

Brent W. Roberts @bwroberts.bsky.social · 14/09/2026

It represents the Id wish of the psychiatric community....

130

Reposted by Brent W. Roberts

Daniel José Older @djolder.bsky.social · 14/09/2026

"The University of Chicago’s undergrad social-sciences division will go “analog” this fall, implementing a blanket policy banning technology in class and AI assistance on coursework across the division’s core courses." www.chronicle.com/article/u-of...

chronicle.com

U. of Chicago Bans Tech, AI in Social Sciences Core Courses

The new restrictions apply to students and faculty members.

18940261

Brent W. Roberts @bwroberts.bsky.social · 14/09/2026

I know silence is typically the highest form of contempt, but in this case it is just quiet head nods of agreement

static.klipy.com

Gentleman Agree

Alt: Gentleman Agree

050

Reposted by Brent W. Roberts

Julia M. Rohrer @dingdingpeng.the100.ci · 14/09/2026

Okay before I do write my screed about cluster analysis, please send me your favorite *positive* examples that illustrate the utility of the method!

314011

Reposted by Brent W. Roberts

Protzko @protzko.bsky.social · 10/09/2026

Do small effects really accumulate to make big effects? Not really. And certainly not when there are other causes on the thing you are looking at. Which, you know, is always. From Berggren & @jkflake.bsky.social journals.sagepub.com/doi/pdf/10.1... #psych

0128

Reposted by Brent W. Roberts

Merriam-Webster @merriam-webster.com · 09/09/2026

Not to brag, but our product has been foldable since 1828.

142135252192

Reposted by Brent W. Roberts

Stephen Curry @scurry.bsky.social · 03/09/2026

Watch to the end… ;-)

062

Reposted by Brent W. Roberts

Beth Clarke @bethclarke.bsky.social · 02/09/2026

Really enjoyed chatting with Randy! I highly recommend checking out his podcast if you haven’t already @metasciencematters.bsky.social

0156

Reposted by Brent W. Roberts

Gordon Hodson @gordonhodsonphd.bsky.social · 03/09/2026

#AcademicSky #PsychSciSky #MetaScience Article worth reading, & sharing w/ your student researchers. Can't get this out of my head: "Bishop’s law: The better designed a study is, the more likely it is to obtain a null result" journals.sagepub.com/doi/10.1177/... Meimoun & @lakens.bsky.social

310134

Brent W. Roberts @bwroberts.bsky.social · 02/09/2026

I mean, Eysenck clearly cooked the books on a lot of his cancer-prone personality work (or Grossarth-Maticek did and he ignored it). Our fields are not immune to that type of personality constellation...

130

Brent W. Roberts @bwroberts.bsky.social · 02/09/2026

Maybe the clinical types don't get as much fame from the game? More likely, faked clinical data is harder to detect and the authors thereof might be more adept at hiding it? Paranoid yet??

110

Brent W. Roberts @bwroberts.bsky.social · 02/09/2026

Maybe it was a B-school phenomenon? 2/

110

Brent W. Roberts @bwroberts.bsky.social · 02/09/2026

But 2002 is early for that interpretation. Gladwell's Tipping Point had just been published so we were only just realizing the $$ that could be made by repackaging our work in book form. TED talks didn't go on-line till 2006. Of course Wansink was doing equally problematic things at the same time 1/

131

Brent W. Roberts @bwroberts.bsky.social · 31/08/2026

I mean, crisis is so uncivilized. We prefer terms that are less provocative, so we don't have to openly confess to our past indelicacies and actually do something constructive about it. We prefer terms like "blip", or "temporary lapse of judgment", or an "analytic indiscretion"....

150