iiinova — where your digital self keeps evolving

Reposted by Institute for Replication

This was my first time leading one of our Replication Games solo and I couldn't have asked for a better place to get my start. :) Great organization, highly motivated participants with a diverse mix of research backgrounds, and a beautiful city to top it all off.

072

Institute for Replication @i4replication.bsky.social · 20h

We had an amazing time at the University of Münster. Our replicators covered papers across psychology, public health and political science! Huge thanks to @bschlipphak.bsky.social, Katrin Schmietendorf, @aufdroeseler.bsky.social and Oliver Kamps for organizing.

0102

Reposted by Institute for Replication

Ali Shiravand @alishiravand.bsky.social · 28/09/2026

Very glad to have contributed to this valuable initiative! 🌊 Together with @isabellehoxha.bsky.social and @nicolasyax.bsky.social, our team reproduced “Synchrony Influences Estimates of Cooperation in a Public-Goods Game” by McEllin and Sabenz (Psychological Science, 2024).

091

Reposted by Institute for Replication

Christoph Kronenberg @ckronenberg.bsky.social · 27/09/2026

Kudos to the journal for collaborating! Psych Science is doing quite a few things right from an outside perspective.

0182

Reposted by Institute for Replication

Jack Wilkinson @jdwilko.bsky.social · 24/09/2026

The integrity of evidence synthesis is threatened by problematic randomised controlled trials. These may be fraudulent, or subject to critical errors. INSPECT-SR is a tool to assess trustworthiness of RCTs - out today: www.bmj.com/content/394/...

bmj.com

INSPECT-SR tool for assessing trustworthiness of randomised controlled trials

The integrity of evidence synthesis is threatened by problematic randomised controlled trials, where there are serious concerns about the trustworthiness of the data or findings. Such concerns could b...

12415

Reposted by Institute for Replication

Nick Brown @steamtraen.eu · 25/09/2026

See also Crüwell et al. (2023) pubmed.ncbi.nlm.nih.gov/36730433/ (full disclosure: I am "last/senior" author on that paper!)

pubmed.ncbi.nlm.nih.gov

Checking your browser - reCAPTCHA

061

Institute for Replication @i4replication.bsky.social · 25/09/2026

Over the past two years, I4R partnered with Psychological Science (@psychscience.bsky.social) on a large reproducibility project. 67 independent teams reproduced 64 articles published in 2024–2025, about 44% of eligible papers. Paper: www.econstor.eu/bitstream/10... Here's what we learned 🧵

18855

Institute for Replication @i4replication.bsky.social · 24/09/2026

Episode 2 from our 1-day I4R workshop is out. @janmarcus.de, @josefinaw.bsky.social & René Bekkers ask: How can we link publications to replications, so anyone reading a paper can instantly see whether its findings have been retested? 🧵

234

Institute for Replication @i4replication.bsky.social · 22/09/2026

Our comment on “Raising Health Awareness in Rural Communities” is finally published in REStat (MIT Press). But the retraction we had been told was coming never happened. Can lawyers derail a retraction? This case raises that uncomfortable question. 🧵

1149

Institute for Replication @i4replication.bsky.social · 19/09/2026

Some of us are having fun today in Germany at the Freiburg Replication Games! Meanwhile, others are in Montreal for a workshop on AI and research integrity that we’re co-organizing. A busy and entertaining weekend for I4R!

051

Reposted by Institute for Replication

Crystal Lewis @cghlewis.bsky.social · 15/09/2026

Issue 62 of #rdmweekly is out! 📬 ➡️ On the Prevalence of Personally Identifiable Information (PII) in the Social Sciences @i4replication.bsky.social ➡️ sdcMicro - #rstats package for anonymization ➡️ @rdapassociation.bsky.social Kaffee Klatsch Meetup and more! rdmweekly.substack.com/p/rdm-weekly...

rdmweekly.substack.com

RDM Weekly - Issue 062

A weekly roundup of Research Data Management resources.

0124

Reposted by Institute for Replication

BITSS @ucbitss.bsky.social · 08/09/2026

2027 BITSS Annual Meeting call for speakers is open until Nov 1! The BITSS AM is a conference that convenes academic researchers, donors, and policymakers to discuss research transparency, rigor, methods, and ethics. 🗓️ Fri, Feb 26, 2027 📍Berkeley, CA Apply: cega.submittable.com/submit/36737...

cega.submittable.com

Center for Effective Global Action - Call for Speakers for the 2027 BITSS Annual Meeting

Call for Speakers for the 2027 BITSS Annual Meeting The Berkeley Initiative for Transparency in the Social Sciences (BITSS) will hold its 15th Annual Meeting on Friday, February 26, 2027 at UC Berkel...

032

Institute for Replication @i4replication.bsky.social · 14/09/2026

It only took us 5 years, but I4R finally has a newsletter. 🎉 We’ll use it to share new studies, Replication Games, research, events, podcasts, and other updates from the Institute for Replication. Subscribe here: www.i4replication.org/newsletter

075

Institute for Replication @i4replication.bsky.social · 11/09/2026

Our new Discussion Paper is covered by @jeffreybrainard.bsky.social in @science.org. We summarize the main results in this thread: bsky.app/profile/i4re...

010

Reposted by Institute for Replication

Jeffrey Brainard @jeffreybrainard.bsky.social · 11/09/2026

Survey participants are often promised anonymity, but researchers studying crime posted a public data set that identified people who confessed to crimes. Without more care, #openscience can conflict with privacy #researchintegrity #academicpublishing @science.org www.science.org/content/arti...

science.org

Social science studies may promise anonymity, but participant identities often lurk in public data

One-fifth of data sets intended to support replication breached privacy standards, study finds

2215

Reposted by Institute for Replication

Golareh Khalilpour @golareh.bsky.social · 10/09/2026

So, uhm, my colleagues from our #OpenScience Office and Research Data Center offer expert advice on the legal and ethical requirements regarding data management and sharing. If you’re a researcher at #UniMannheim and your data includes personal/sensitive info, I do recommend reaching out to them.

064

Reposted by Institute for Replication

Ira Hyman @irahyman.bsky.social · 10/09/2026

Be careful with personally identifiable information in data sets. Limit what information you retain. And don’t put any form of identifiable information on public data sites. You should also not put identifiable data on web storage sites either. Protect privacy of your human participants.

033

Institute for Replication @i4replication.bsky.social · 10/09/2026

This summer, I4R invited 12 researchers in the social sciences for a 1-day workshop on the future of replication. Each researcher chose a topic and led a discussion. We recorded the conversations. We’ll release each one as a podcast + blog. 🧵 open.spotify.com/episode/3qAa...

open.spotify.com

The data-generating model (Nate Breznau)

Allegedly Does Not Replicate · Episode

112

Institute for Replication @i4replication.bsky.social · 09/09/2026

It really did surprise us too :( Why are PII rates so high for packages containing data from participants in low- and lower-middle-income countries? A short 🧵

141

Reposted by Institute for Replication

abigail dym @abigailrd.bsky.social · 08/09/2026

This is so important, especially for folks working with youth data and trying to navigate journal requirements to submit the data. It just isn’t safe a lot of the time, and we all need to be so cautious to protect our participants.

021

Institute for Replication @i4replication.bsky.social · 09/09/2026

Most of the differences across journals are explained by articles, authors and rep packages' characteristics. A short 🧵

100

Reposted by Institute for Replication

Malika Ihle @malikaihle.bsky.social · 09/09/2026

Please anonymise your data before sharing ! At the @lmu-osc.bsky.social we promote responsible data sharing through data anonymisation, or the creation of synthetic data to share instead of sensitive data. Our self-paced tutorials: lmu-osc.github.io/data-anonymi... lmu-osc.github.io/synthetic-da...

lmu-osc.github.io

Welcome to the Data Anonymization Course! – Data Anonymization Course

02013

Reposted by Institute for Replication

Sebastian Karcher @adam42smith.bsky.social · 08/09/2026

I've followed this work (& 'participated' in it as @apsrjournal.bsky.social 's data editor). It's extremely important and carefully done. I wasn't shocked by the results (they asked us what we expected before they started) & we had started checking for PII earlier, but doesn't mean I'm not worried

153

Reposted by Institute for Replication

Brian Nosek @briannosek.bsky.social · 08/09/2026

Incredibly important work surfacing the risks and needs for improving processes for responsible data sharing.

0107

Institute for Replication @i4replication.bsky.social · 08/09/2026

1/ What is the prevalence of personally identifiable information (PII) in author-collected data publicly shared in the social sciences? We audited 327 replication packages from 11 leading journals in economics, political science, and psychology Answer: surprisingly high 🧵

25437

Institute for Replication @i4replication.bsky.social · 04/09/2026

🧵 New DP from I4R co-director Lester Lusher, with Sonia Ale, Md Shafiqui Islam, Huda Osman & Jacob Stenstrom (Pitt): "When Samples Shape Significance." What happens when you re-estimate published results using fresh draws of the same data? Some evidence from Google Trends!

12914

Reposted by Institute for Replication

Hauke Roggenkamp @hroggenkamp.bsky.social · 01/09/2026

Two years ago @mvreiss.bsky.social and I reproduced a paper for @i4replication.bsky.social's mass reproduction project. It reproduced cleanly, and we still came away seeing how fragile these pipelines can be: a hard-coded path, an updated package, an undocumented manual step. Hence this Comment.

1105

Institute for Replication @i4replication.bsky.social · 24/08/2026

The Institute for Replication and University of Freiburg are jointly organizing the Replication Games on Saturday, September 19th. The Games will focus on replicating papers on the causes of political violence.

143

Reposted by Institute for Replication

Jörg Ankel-Peters @jrgptrs.bsky.social · 18/08/2026

EJMR is dead; here is The Economist: “Why the economics profession doesn’t trust Acemoglu.” Trivia: they cite our expert review of Acemoglu et al. (2001). www.economist.com/finance-and-...

economist.com

The world’s most influential economist is oddly unconvincing

Daron Acemoglu is revered. Why?

183

Reposted by Institute for Replication

Jan Marcus @janmarcus.de · 24/07/2026

This year I joined the editorial team of @jcre.bsky.social, the Journal of Comments and Replications in Economics (JCRE) as a Co-Editor. I'm especially happy that the first submission I handled from start to finish has now been published—together with a reply from the original authors.

1164

Reposted by Institute for Replication

Irish Economic Association @irisheconassoc.bsky.social · 24/07/2026

🚨UPCOMING EVENT - REGISTER NOW🚨 We’re delighted to promote a new upcoming event. @i4replication.bsky.social and UCD School of Economics are jointly organising the Replication Games alongside the EEA-ESEM Congress! 📆 Sunday, 16 August 📍 Dublin 👉🏻 More / Register www.iea.ie/2026/07/10/n...

iea.ie

NEWS: Replication Games – EEA-ESEM Congress (Sunday, 16 August 2026) – Irish Economic Association

033

Institute for Replication @i4replication.bsky.social · 23/07/2026

It is indeed the award of 80+ local organizers and 3,000 participants!! Thanks for organizing again this year 😀

020

Reposted by Institute for Replication

Society for the Improvement of Psychological Science (SIPS) @improvingpsych.org · 23/07/2026

Congratulations to the project “Replication Games,” which received🏆2026 SIPS Mission Award! Replication Games builds community and skills for researchers in one-day hackathons to assess the reproducibility and robustness of published research. 🔗https://buff.ly/nXfbAO8

i4replication.org

Institute for Replication (I4R)

The Institute for Replication improves the credibility of science by systematically reproducing and replicating empirical research.

1132

Institute for Replication @i4replication.bsky.social · 14/07/2026

The Institute for Replication (I4R) and UCD School of Economics are jointly organizing the Replication Games (RGs) alongside the EEA-ESEM Congress on 𝐒𝐮𝐧𝐝𝐚𝐲, 𝐀𝐮𝐠𝐮𝐬𝐭 16.

162

Reposted by Institute for Replication

Jörg Ankel-Peters @jrgptrs.bsky.social · 28/06/2026

The debate about Borjas/Breznau's paper on ideological bias in migration research is out now @i4replication.bsky.social. With a comment by Katrin Auspurg & Josef Brüderl: hdl.handle.net/10419/341575 And a reply by the original authors: hdl.handle.net/10419/341576

2158

Reposted by Institute for Replication

Essi Kujansuu @essieconomist.bsky.social · 30/06/2026

@i4replication.bsky.social is doing a great job facilitating *debates* about methodology and scientific practises. One can read the arguments and make up their minds: much of the argumentation is made public (instead of being discussed among the editors or other small circles).

072

Reposted by Institute for Replication

Jack Fitzgerald @jackfitzgerald.bsky.social · 18/06/2026

Happy to have the CBS Replication Games (and my replication research more broadly) featured on the ODISSEI Podcast! Tune in if you're interested in hearing @drtomemery.bsky.social and I nerd out over replication!

062

Reposted by Institute for Replication

Jörg Ankel-Peters @jrgptrs.bsky.social · 13/06/2026

The reply to our comment is now online at AEJ:Applied. The broader takeaway: should we trust an IV if removing coding errors requires a different first stage? www.mollylipscomb.com/_files/ugd/a...

062

Institute for Replication @i4replication.bsky.social · 12/06/2026

📢 Call for Papers! We are partnering with the Journal of Economic Surveys on a special issue: Reproducibility and Meta-Science in Economics. Submission deadline: 1 March 2027. Details in thread 🧵

1811

Institute for Replication @i4replication.bsky.social · 08/06/2026

We're having an amazing time at @mcgilluniversity.bsky.social. Our CAnD3 replication games today are focused on health! Huge thanks to Arianne Rodriguez-Saltron and Amélie Quesnel Vallée for organizing.

010

Reposted by Institute for Replication

Jörg Ankel-Peters @jrgptrs.bsky.social · 05/06/2026

New DP @i4replication.bsky.social : An Empirical Assessment of Computational Reproducibility in Sociology. www.econstor.eu/bitstream/10...

01912

Reposted by Institute for Replication

Erzo F.P. Luttmer @erzoluttmer.bsky.social · 04/06/2026

This is a fantastic and rare (!) example of authors of a published paper and the author of a comment on that paper working together to fix the scientific record. Kudos to all involved. This is not easy, even with good faith all around. @droodman.bsky.social @i4replication.bsky.social #EconSky

0204

Reposted by Institute for Replication

droodman.bsky.social @droodman.bsky.social · 04/06/2026

The authors of the great Star Wars paper and I just posted a 1-page corrigendum. It does not change conclusions. Very fun working with my fellow Jedi meta-scientists. That I checked the work is a measure of the paper's importance. The Force aligned us.

021

Institute for Replication @i4replication.bsky.social · 04/06/2026

🚨 CORRIGENDUM ALERT 🚨 A decade after Star Wars: The Empirics Strike Back was published in AEJ: Applied, we've just published an official corrigendum with the AEA. This is a love story. 🧵

1217

Institute for Replication @i4replication.bsky.social · 04/06/2026

We're having fun replicating papers today. Thanks to everyone participating to the Utrecht Replication Games!

2100

Institute for Replication @i4replication.bsky.social · 31/05/2026

Incentives to reproduce and replicate articles are so bad. Even when your comment leads to the retraction of a PLOS One article, the reward is a (10 days late) email with a thank you at the bottom. Retraction notice: journals.plos.org/plosone/arti.... But we are not complaining about PLOS One 🧵

12412

Institute for Replication @i4replication.bsky.social · 29/05/2026

Ongoing replication games at CERDI, Clermont-Ferrand and games yesterday at the Canadian Economic Association in Vancouver! Thanks to the local organizers (Simone Bertoli and Kevin Schnepel) and everyone one who participates! 2 more games within the next 10 days :)

020

Reposted by Institute for Replication

Joris Frese @fresejoris.bsky.social · 29/05/2026

All the more reason to be excited for the results of the second iteration of AI replication games that were held earlier this month: bsky.app/profile/i4re... (4/4)

061

Reposted by Institute for Replication

Joris Frese @fresejoris.bsky.social · 29/05/2026

This is a great study and (one of?) the first of its kind! A note of caution from a human contributor though: given the slow academic publishing process, the findings should primarily be interpreted as a snapshot of AI capabilities (and the capabilities of researchers using AI) in 2024. (1/4)

13714