iiinova — where your digital self keeps evolving

Reposted by Beth Clarke

Institute for Replication @i4replication.bsky.social · 25/09/2026

Over the past two years, I4R partnered with Psychological Science (@psychscience.bsky.social) on a large reproducibility project. 67 independent teams reproduced 64 articles published in 2024–2025, about 44% of eligible papers. Paper: www.econstor.eu/bitstream/10... Here's what we learned 🧵

18855

Reposted by Beth Clarke

Framework for Open and Reproducible Research Training @forrt.bsky.social · 17/09/2026

🚀Making Replications Count Hackathon🚀 create open source tools that make replication studies impossible to ignore. 📅11th-13th November 2026 Münster, Germany ✈️ Travel & accommodation covered Looking for coders, data wranglers, UX folks & open science enthusiasts Apply: indico.uni-muenster.de/e/marco3

054

Reposted by Beth Clarke

Randy Ellis @randalljellis.bsky.social · 23/09/2026

Here’s my conversation with Chris Chambers on Metascience Matters. Chris was the first journal editor to offer registered reports, starting in 2013 at Cortex. youtu.be/PgZjgZlxsYw?...

youtu.be

Registered reports | Chris Chambers

YouTube video by Metascience Matters

11812

Reposted by Beth Clarke

Jamie Cummins @jamiecummins.bsky.social · 24/09/2026

I sincerely hope this paper will be seen as a turning point in how the medical sciences think and approach the issue of trustworthiness assessment (and I hope the social sciences follow suit!). Congrats to @jdwilko.bsky.social and colleagues (incl. @ianhussey.mmmdata.io and @lhdjung.bsky.social)!

12210

Reposted by Beth Clarke

moin syed @syeducation.bsky.social · 22/09/2026

New paper! Despite qualitative researchers claiming that generalizability is not a goal, their published work does indeed contain generalizable claims. We document this and provide recommendations for how all researchers can better calibrate their generalizability claims. doi.org/10.1177/2515...

article header for, "Qualitative Researchers Can and Do Generalize: Generalizability Claims in Qualitative Psychological Research". Metascience!

619255

Beth Clarke @bethclarke.bsky.social · 22/09/2026

Come work on a PhD in Metascience with me! There’s just a little over one week left to apply!

02522

Reposted by Beth Clarke

Malika Ihle @malikaihle.bsky.social · 09/09/2026

Please anonymise your data before sharing ! At the @lmu-osc.bsky.social we promote responsible data sharing through data anonymisation, or the creation of synthetic data to share instead of sensitive data. Our self-paced tutorials: lmu-osc.github.io/data-anonymi... lmu-osc.github.io/synthetic-da...

lmu-osc.github.io

Welcome to the Data Anonymization Course! – Data Anonymization Course

02013

Reposted by Beth Clarke

Dan Quintana @dsquintana.bsky.social · 19/09/2026

New preprint! 🎉 I analysed 1660 papers from 4 psychology journals and found materials sharing went from 9% of papers in 2015 to 82% in 2025, and these materials *do* get downloaded — a median of 135 times each. BUT shared code is often hard to run. doi.org/10.31234/osf... Let's walk through it 🧵

Two-panel figure. Panel a is a flow diagram tracking 1,611 empirical psychology articles from publication year (545 in 2015, 552 in 2020, 514 in 2025) to repository-link type: 785 link an OSF project, 85 link another platform, and 741 link no repository. Of those with an OSF link, download counts were retrieved for 670 and not retrieved for 115. Panel b is a line chart of the share of empirical papers linking OSF across 2015, 2020 and 2025. The overall rate, shown as a dashed black line, rises from 9% to 57% to 82%. All four journals rise steeply and end close together: Psychological Science 92%, JESP 89%, JML 83%, Cognition 76%, with Psychological Science highest throughout.

Three-panel figure. Panel a: ridgeline plot of downloads per file by material type on a log scale, with the percentage never downloaded labelled for each — archive 16% of 545 files, documents 20% of 2,970, code 12% of 3,471, other 17% of 1,646, data 21% of 10,051, media 35% of 2,120, images 35% of 4,102. Most files cluster between 1 and 10 downloads, with long right tails past 100. Panel b: ridgeline plot of downloads per paper by journal, log scale, with dashed median lines; Psychological Science is highest, then JESP, JML and Cognition. Panel c: stacked bars showing, for documents, data and code separately, the share of papers by download band (0, 1–10, 11–100, more than 100) in 2015, 2020 and 2025. The share exceeding 100 downloads falls sharply over time in all three types, from roughly two-thirds in 2015 to a quarter or less in 2025, as the 1–10 band grows.

Four-panel figure. Panel a: statistical languages detected among 333 papers with retrievable code — R 88%, SPSS 12%, Stata 4%, SAS 1%. Panel b: code red flags among those 333 papers — 34% hard-code an absolute path, 40% reference a missing file — above documentation among 672 OSF-linked papers — 21% have a README, 30% are documented by README, description or wiki. Panel c: among 562 Elsevier papers with no repository link, 44% (245) host at least one journal supplementary file but only 14% (77) host data, code or an archive. Panel d: composition of those 448 hosted files — documents 52%, data 21%, media 9%, other 7%, archive 6%, code 3%, images 1%. The code panels are green, the journal-supplement panels blue.

Coefficient plot (download predictors)

Dot-and-whisker plot of three standardised predictors of OSF download volume, each with a 95% confidence interval. Repository size (number of files) has the largest effect at about 0.76, citations about 0.38, and altmetric attention about 0.12. All three intervals sit entirely above zero, so each predicts more downloads, with repository size roughly twice the effect of citations and six times that of attention. X-axis: standardised effect, −0.2 to 1.0.

4264111

Reposted by Beth Clarke

Center for Open Science @cos.io · 10/09/2026

🎉 COS has established an independent subsidiary organization in Brussels! While the Belgian organization is legally independent from COS in the US, it will not operate separately—it's part of one integrated, global COS organization with a shared mission, strategy, & brand

cos.io

A New Chapter for COS in Europe

The Center for Open Science (COS) has officially established an independent subsidiary organization in Brussels, Belgium. This presence gives COS flexibility to engage with European institutions, organizations, funders, and communities.

02815

Reposted by Beth Clarke

Julia M. Rohrer @dingdingpeng.the100.ci · 01/09/2026

I most definitely didn’t expect this to get covered by 2P4B, yet here we are. Very nice episode, can recommend!

0134

Reposted by Beth Clarke

Sabrina Norwood @sabrinanorwood.bsky.social · 02/09/2026

🚨 New preprint: In this paper we make the case for measuring social media use at the level of naturally occurring sessions (i.e., beginning when the app/site is opened and ending when it is closed). Across 7 days and 161 participants this gave us nearly 4,000 paired sessions of use 🧵

Depicts the data collection process. 1) participant opens TikTok, 2) open survey is prompted, 3) participant uses TikTok as normal, 4) participant closes TikTok, 5) close survey is prompted

25916

Reposted by Beth Clarke

Brian Nosek @briannosek.bsky.social · 03/09/2026

For the Replicability Project: Health Behavior we need some editors and reviewers of analysis plans for secondary data replications, especially for complex designs including multilevel, weighting, clustering, missing data. Earns coauthorship on the summary paper. Interested? replications@cos.io

01514

Reposted by Beth Clarke

simine vazire @simine.com · 02/09/2026

Psych Science has retracted Ariely & Wertenbroch (2002). The second author requested the retraction. Both authors agreed to it. journals.sagepub.com/doi/full/10.... So grateful to @datacolada.bsky.social for these blog posts and the work behind them: datacolada.org/138 and datacolada.org/139 1/2

journals.sagepub.com

Sage Journals: Discover world-class research

Subscription and open access journals from Sage, the world's leading independent academic publisher.

426794

Beth Clarke @bethclarke.bsky.social · 02/09/2026

Really enjoyed chatting with Randy! I highly recommend checking out his podcast if you haven’t already @metasciencematters.bsky.social

0156

Reposted by Beth Clarke

Matt Makel @mattmakel.bsky.social · 31/08/2026

I made a mistake. And because of that mistake, I no longer have confidence that results that I reported in several research papers are an accurate reflection of replication rates. 1/

19430

Reposted by Beth Clarke

Tom Hardwicke @tomhardwicke.bsky.social · 27/08/2026

Send your best work to Psychological Science! Four special issue calls: 1. Descriptive Research in Psychological Science www.psychologicalscience.org/publications... 2. Advancing Psychological Science Using Large Language Models www.psychologicalscience.org/publications...

12316

Reposted by Beth Clarke

Julia M. Rohrer @dingdingpeng.the100.ci · 27/08/2026

Psychological Science special issue call 📣 Ever had your research denigrated bc it's "only descriptive", "what's the mechanism though?" and "but what are the theoretical implications?" Now has come your time to shine. Send your best descriptive work! www.psychologicalscience.org/publications...

Psychological Science invites submissions that advance psychological science through careful description of psychological phenomena. Psychological research often focuses on explaining and predicting phenomena before we have a sufficiently detailed understanding of them. It can be difficult to build strong theories on incomplete empirical foundations of the phenomena themselves. Careful descriptive research helps establish shared empirical reference points developed around well-characterized phenomena. As such, descriptive research contributes to psychological science both by improving our understanding of the phenomena themselves and by providing a stronger foundation for future theory-building, explanation, and prediction.

We are interested in manuscripts that:

Deepen our understanding of psychological phenomena, including what they look like, how they vary, and how they unfold;
Draw on a variety of sources of evidence and methods, including qualitative, quantitative, and mixed-methods approaches; research conducted in naturalistic settings; intensive, longitudinal, or small-sample designs; and open or large-scale datasets;
Provide necessary context for interpreting what is being described, including who is represented in the data, the settings and circumstances in which phenomena occur, and the broader social contexts in which they are situated; and/or
Make a substantive contribution to psychological science through the quality, depth, or significance of the description provided.
The deadline for submitting regular manuscripts is April 15, 2027. Registered Reports will also be considered. The deadline for submitting Stage 1 Registered Reports is November 15, 2026. Authors should indicate in the “Comments to Editor” box during submission that the manuscript is intended for the “Descriptive Research in Psychological Science” special issue.

7244128

Reposted by Beth Clarke

Daniel Lakens @lakens.bsky.social · 15/08/2026

New Blog post: Which Data Repository Should you Use? In light of OSF closing down, I compare Zenodo, Dataverse, ResearchBox, PsychArchive, and local repositories on six important dimensions. If you want to know which to pick: It depends! daniellakens.blogspot.com/2026/08/whic...

daniellakens.blogspot.com

Which Data Repository Should You Use?

The Center for Open Science has announced that from November 16, 2026, no new projects can be created on the Open Science Framework. After F...

4197111

Reposted by Beth Clarke

ReproducibiliTea @reproducibilitea.org · 26/08/2026

🎉 ReproducibiliTea 2026 Conference | 25 September 2026 “A decade on & decades ahead” ☕ Session 1 | 10:50–11:50 👉 Register for the ReproducibiliTea 2026 Conference and discover the full program, speakers, and session details on our website: 🔗 reproducibilitea.org/conference2026

32213

Beth Clarke @bethclarke.bsky.social · 21/08/2026

I’m hiring a PhD student to work with me on metascience in psychology at @zpid.bsky.social! The position is very open - could cover a wide range of topics/themes 🤸🏻‍♀️✨ If you have questions, please reach out! Applications are open until October 1st. leibniz-psychology.onlyfy.jobs/en/job/fyjwt...

leibniz-psychology.onlyfy.jobs

PhD in Psychological Meta-Science (m/f/d)

Become part of the open science movement The Leibniz Institute for Psychology Information (ZPID) in Trier (Germany) is an internationally recognized research-based psychology service center located in...

36157

Reposted by Beth Clarke

Society for the Improvement of Psychological Science (SIPS) @improvingpsych.org · 17/08/2026

Congratulations to the project “RegCheck,” which received🏆2026 SIPS commendation! RegCheck is a tool that makes it easier and quicker for researchers to compare published papers with their associated study registrations. regcheck.app

regcheck.app

RegCheck

RegCheck is an AI tool to compare preregistrations with papers instantly.

13010

Reposted by Beth Clarke

Daniel Lakens @lakens.bsky.social · 13/08/2026

My favorite Metascience conference will land in Copenhagen next year. The 9th (!) edition of the Perspectives on Science Error conference will be from January 27 to 29. Block your calendar, and see you there! errorsin.science

errorsin.science

Perspectives on Scientific Error 2027 · PSE9

Johanna Einsiedler, University of Copenhagen & University of Basel, johanna.einsiedler@sodas.ku.dk

12815

Reposted by Beth Clarke

simine vazire @simine.com · 12/08/2026

It’s amazing what Brian and OSF have done for science. I can imagine how hard the folks at COS must’ve worked to avoid this outcome. I’m extremely grateful to them for creating the reality we live in now. The fact that we’ll miss these services so acutely is a testament to how much they shaped us.

09224

Reposted by Beth Clarke

Brian Nosek @briannosek.bsky.social · 11/08/2026

Over the next several months, we will phase out some popular OSF features. These changes do not affect current public content, which remains safe and accessible. We have prepared support material to help users adapt. I am very sorry for the disruption to your work. Please read this post for details.

cos.io

OSF Changes | Center for Open Science

We are preparing substantial changes to OSF that will reduce its functionality, focus OSF on its unique strengths, and move toward an integrated model with complementary services. As part of that shif...

10120113

Reposted by Beth Clarke

Sabrina Norwood @sabrinanorwood.bsky.social · 05/08/2026

Are you interested in smartphone interventions?📱 We are too. Specifically we were interested in increasing retention in a digital friction intervention. Let me tell you about our new preprint (1/n) with @dgruning.bsky.social @frederik.riedel.wtf @malte.the100.ci using one sec

12712

Reposted by Beth Clarke

Jamie Cummins @jamiecummins.bsky.social · 03/08/2026

Have you built an LLM-based research tool and had to stumble your way through figuring out how to validate it? Me too! So I wrote a guide on how to systematically approach this. Preprint here: osf.io/preprints/ps...

07214

Reposted by Beth Clarke

Julia M. Rohrer @dingdingpeng.the100.ci · 30/07/2026

New blog post! Odds ratios are...a bit weird. Here I explain two problems (interpretation, non-collapsibility) and provide some simple recommendations for improved reporting. www.the100.ci/2026/07/30/r...

the100.ci

Reviewer notes: Odds ratios are really odd

When psychological researchers investigate binary outcomes, they routinely report odds ratios to quantify the strength of an effect or an association. This is quite understandable given that psycholog...

2428779

Reposted by Beth Clarke

Matt Williams @matthewmatix.bsky.social · 30/07/2026

www.aimos2026.org AIMOS 2026 will be in Wellington this year on 30 Nov to 2 Dec. Abstracts due 15 Aug. This is a very fun and very interactive metascience conference. Come along and hang out!

aimos2026.org

AIMOS_2026 | Metascience Conference – Register Today

Join the AIMOS 2026 Conference n Wellington, New Zealand, for three days of interdisciplinary meta-research, keynote speakers, workshops, and networking to improve research practices.

0108

Reposted by Beth Clarke

Michèle Nuijten @michelenuijten.bsky.social · 27/07/2026

Very happy that my project about "gaming" automated peer review tools has been awarded an NWO XS grant 🤩 🤸‍♀️ We know that peer review is overburdened, so could we use automated tools to help out? ... maybe, but one of the things we still don't know much about is the risk of "gaming" these tools.

6485

Reposted by Beth Clarke

Anne Scheel @annemscheel.bsky.social · 23/07/2026

New preprint w/ Leo Tiokhin & @lakens.bsky.social! Registered Reports (RRs) are great for science b/c publication is guaranteed before results are known, reducing publication bias & QRPs. This feature supposedly also makes them great for *scientists*. But is that really true? 1/ tinyurl.com/4sy993rr

tinyurl.com

Career incentives make Registered Reports unattractive under realistic academic conditions

Registered Reports are a publication format designed to reduce publication bias by guaranteeing publication before results are known. This guarantee is considered attractive in the prevailing ‘publish...

15934

Reposted by Beth Clarke

Jamie Cummins @jamiecummins.bsky.social · 21/07/2026

RegCheck ( regcheck.app) has received a Commendation from the Society for Improving Psychological Science! You can check the other awardees below too:

regcheck.app

RegCheck

RegCheck is an AI tool to compare preregistrations with papers instantly.

24710

Reposted by Beth Clarke

Brian Nosek @briannosek.bsky.social · 20/07/2026

Metascience 2027 is scheduled for June 14-16 in Montreal. We are delighted to partner with the Tanenbaum Open Science Institute for this important meeting. Join the mailing list for updates at: metascience.info

metascience.info

Metascience 2027

A global gathering for knowledge sharing, community building, and opportunities to define a roadmap of research and intervention priorities to improve science.

12613

Reposted by Beth Clarke

Julia M. Rohrer @dingdingpeng.the100.ci · 20/07/2026

New paper out now 🥳 When psychologists discuss generalisability, they often refer to vague notions of representativeness. We provide an accessible intro to the total survey error framework as a tool to reason about this more rigorously. w @taymalsalti.bsky.social @ruben.the100.ci >

Thinking Clearly About Sampling and Representation With the Total Survey Error Framework

Collecting a sample that represents the population of interest well constitutes a challenge across the social and behavioural sciences. Psychology in particular frequently relies on convenience samples—most notably students and, increasingly, online participants—with a tendency to either (implicitly) assume representativeness without substantive justification, or to acknowledge a lack of it only in passing. In contrast, researchers rarely engage with the actual implications for their inferences, which undermines the generalisability of psychological findings. Critically, representativeness must be defined with respect to variables relevant to the target of inference, rather than superficial demographic diversity. Here we present the Total Survey Error (TSE) framework as a methodological tool that systematically addresses the multifaceted sources of error—particularly those related to representation—that emerge throughout the research cycle. Although TSE originated in survey research, its principles are broadly applicable to any psychological study seeking inference from sample to population. We offer practical strategies for identifying, preventing, and mitigating representation errors to improve the credibility and generalisability of psychological research.

Illustration of the total survey error framework with the representation strand highlighted. It shows how coverage error, sampling error and non-response error arise during the sampling process.

1027797

Beth Clarke @bethclarke.bsky.social · 15/07/2026

If you had to guess, what proportion of social/personality psych articles include a claim that the findings can be applied in the real world?

53514

Beth Clarke @bethclarke.bsky.social · 15/07/2026

Another metascience assistance prof position! What an exciting time for metascience!

010

Beth Clarke @bethclarke.bsky.social · 14/07/2026

@jamiecummins.bsky.social has made RegCheck even sleeker! Try it out and let us know what you think!

042

Reposted by Beth Clarke

Dan Quintana @dsquintana.bsky.social · 06/07/2026

Our department just announced a new Associate Professor position in quantitative research methodology 🇳🇴 One of the favorable qualifications is experience with open science practices + R/Python experience www.jobbnorge.no/en/available...

jobbnorge.no

Associate Professor in Quantitative Research Methodology (302697) | University of Oslo

Job title: Associate Professor in Quantitative Research Methodology (302697), Employer: University of Oslo, Deadline: Tuesday, September 1, 2026

19278

Beth Clarke @bethclarke.bsky.social · 08/07/2026

A unique opportunity to join the RegCheck team! Wonderful colleagues, important research, and an incredible city to live in. I can’t recommend this phd/ postdoc position enough!

031

Beth Clarke @bethclarke.bsky.social · 08/07/2026

Really excited for this next chapter at @zpid.bsky.social! 🎉

0101

Reposted by Beth Clarke

Jessie Sun @jessiesun.bsky.social · 07/07/2026

Interested in doing a postdoc with me in Auckland, New Zealand? 🇳🇿 See info below on a competitive award opportunity, and please spread the word!

13130

Reposted by Beth Clarke

Beth Clarke @bethclarke.bsky.social · 03/07/2026

The good news is that someone else now gets to join this amazing team! If you're keen to help develop RegCheck, I'd strongly encourage you to apply. Working with @jamiecummins.bsky.social and @malte.the100.ci is reason enough to apply! jobs.unibe.ch/job-vacancie...

jobs.unibe.ch

PhD Student/ Postdoc Position in Meta-Science - Universität Bern

Universität Bern is looking for PhD Student/ Postdoc Position in Meta-Science

12518

Beth Clarke @bethclarke.bsky.social · 03/07/2026

Very excited to announce that I’ll be joining @zpid.bsky.social in Trier, Germany as a tenure-track Jun.-Prof. in Psychological Metascience in November! 🤸🏻‍♀️✨

1812716

Reposted by Beth Clarke

Eiko Fried @eikofried.bsky.social · 30/06/2026

New website is live, including a new blog post :). I respond to the call by @psychscience.bsky.social asking how we can improve APS conferences. eiko-fried.com/blog/in-pers...

eiko-fried.com

In-person conferences in 2026: yay or nay? | Eiko Fried

Some ideas on improving conferences so they are worth the financial, time, and ecological investments.

76516

Reposted by Beth Clarke

Marlene Altenmüller @marlephie.bsky.social · 24/06/2026

🚨JOB ALERT🚨 3 YEAR POSTDOC in #SciComm research at @zpid.bsky.social! @kaisassenberg.bsky.social and me are searching for a postdoc with background in psychology or communication science. Own research ideas are welcome! Focus should be on societies' preparation for future pandemics. Please share!

leibniz-psychology.onlyfy.jobs

Application Process

Apply now

11620

Reposted by Beth Clarke

moin syed @syeducation.bsky.social · 25/06/2026

New post! "Making Sense of Replications (and Some Nonsense about the Replication Crisis)," in which I suggest a journal club reading list of new papers on replication, and push back on claims that the replication crisis is fake. getsyeducated.substack.com/p/making-sen...

getsyeducated.substack.com

Making Sense of Replications (and Some Nonsense about the Replication Crisis)

It’s hard to overstate just how much the culture around replication in science has changed over the past 15 years.

34720

Reposted by Beth Clarke

Malte Elson @malte.the100.ci · 21/06/2026

Our lab loved this paper when it came out as it combined two of our interests, technology effects and schmeasurement. Plus: Registered report, open data. We read it for our journal club and found issues in the Slovak sample that we now posted to PubPeer: pubpeer.com/publications...

pubpeer.com

PubPeer - Confusion in gaming disorder measurement

There are comments on PubPeer for publication: Confusion in gaming disorder measurement (2026)

12115

Reposted by Beth Clarke

Malte Elson @malte.the100.ci · 20/06/2026

🧵 New PubPeer comment. @cskay.bsky.social & Vlasceanu (2026) propose ECLAIR, an item battery to catch AI-driven bots. We read the preprint in our journal club & found it very interesting, but our read raised several concerns that we posted to PubPeer. pubpeer.com/publications...

pubpeer.com

PubPeer - A scale for detecting LLM-generated responses in online surv...

There are comments on PubPeer for publication: A scale for detecting LLM-generated responses in online survey research (2026)

1158

Reposted by Beth Clarke

Malte Elson @malte.the100.ci · 15/06/2026

The paper "The Bots Ruining Social Science Are Not Bots at All" by Jaffe et al. got a lot of attention when it came out in Perspectives on Psychological Science. We read it in our journal club and have a few comments that we now posted to PubPeer pubpeer.com/publications...

pubpeer.com

PubPeer - The Bots Ruining Social Science Are Not Bots at All

There are comments on PubPeer for publication: The Bots Ruining Social Science Are Not Bots at All (2026)

23315