iiinova — where your digital self keeps evolving

I have this memory that either JASP or JAMOVI or something like that found the computation of (if I remember) Bayesian RMANOVA or similar were incorrect. Meaning, if you ran those analysis in that program, it was wrong. Anyone else remember this? I can't find evidence this happened. #stats #meta

100

Protzko @protzko.bsky.social · 23/09/2026

So many conferences for international societies just so happen to be in Canada this summer. I wonder why that could be. Maybe a different country is acting foolish regarding people from other countries?

001

Reposted by Protzko

Andrew Gordon @andrewgordon.bsky.social · 22/09/2026

An agent completes a survey, this is not ground breaking news, yet its led to another set of 'online testing is dead' posts. Remember capability ≠ deployment. Just because it can be done doesn't mean it is being done Also, mouse tracking catches it easily. Design studies with this in mind.

021

Reposted by Protzko

Beth Clarke @bethclarke.bsky.social · 22/09/2026

Come work on a PhD in Metascience with me! There’s just a little over one week left to apply!

02522

Reposted by Protzko

Charlotte Walker @charlottewalker.bsky.social · 28/10/2023

Someone sent me this meme about peer reviewer comments and it is 👌🏻 #PhDSky #AcademicSky

3596183

Reposted by Protzko

Alex Holcombe @alexh.bsky.social · 21/09/2026

Let's say that pDoom is actually high. Seems that that means we should be trying to flood the internet with BS and AI slop at an even more rapid rate, so that model collapse might occur prior to model world takeover.

031

Protzko @protzko.bsky.social · 10/09/2026

Do small effects really accumulate to make big effects? Not really. And certainly not when there are other causes on the thing you are looking at. Which, you know, is always. From Berggren & @jkflake.bsky.social journals.sagepub.com/doi/pdf/10.1... #psych

0128

Protzko @protzko.bsky.social · 09/09/2026

Now in press! Kids These Days!...aren't really changing that much; at least, not on child behavior problems since 1980s. Some improvements, some decrements, but In > 418,000 kids from nationally-representative samples, no real change. from Zsofia Takacs & Boglarka Vekety doi.org/10.1007/s105...

021

Protzko @protzko.bsky.social · 06/09/2026

As you get more experienced in publishing research on all sides it's amusing how much easier it is to spot sections or even just sentences in a paper you can tell were put there because of a reviewer.

150

Reposted by Protzko

Society for the Improvement of Psychological Science (SIPS) @improvingpsych.org · 02/09/2026

Congratulations to the project “The Advantage of Big Team Science: Lessons Learned From Cognitive Science,” which received🏆2026 SIPS commendation! It offers a synthesis of strategies for successfully navigating the BTS landscape, including logistical, ethical, and epistemological challenges.

1116

Reposted by Protzko

Sanjay Srivastava @sanjaysrivastava.com · 31/08/2026

I'm old enough to remember when this many fraud accusations against someone with this high a profile would put a field into crisis

2393

Reposted by Protzko

Matt Makel @mattmakel.bsky.social · 31/08/2026

Rakow’s new paper found that “around 90% of articles that discuss replication and over 80% of articles with author-identified replications are missed by searching databases for replicat* because databases hold few details per article”. 8/

1145

Protzko @protzko.bsky.social · 28/08/2026

Maybe about academia, maybe really about the decline of Talenti

020

Protzko @protzko.bsky.social · 27/08/2026

Reading a study right now that's talking about dual processing and includes an experimental treatment*demographic moderation and all I can think is "oh, that's so 2010" . Sure enough, paper was published in 2010.

000

Reposted by Protzko

Amanda Kay Montoya @akmontoya.bsky.social · 24/08/2026

Just a reminder that posting code/materials on your personal website is not a long term solution and not compliant with most sharing standards. I've run into two papers today from the same lab that uses this practice, all the links are broken. Will wait for replies to emails I guess....

2245

Reposted by Protzko

Igor Grossmann, PhD @igi.bsky.social · 25/08/2026

We’re hiring! Wisdom & Culture Lab @uwaterloo.ca seeks a Research Project Manager for a 12+ country project on cultural narratives, economic games & decision-making, via Wise Judgment Consortium. Please apply/share! 👇 uwaterloo.ca/wisdom-and-c... #AcademicJobs #ResearchJobs #CulturalPsychology

uwaterloo.ca

Job Ad! WAC lab is searching for a Research Project Manager | Wisdom and Culture Lab | University of Waterloo

Job Ad! WAC lab is searching for a Research Project Manager for Cultural Narratives, Economic Games, & Decision-making project.

053

Protzko @protzko.bsky.social · 25/08/2026

Far too many interventions never find out how long the effects last. In this new pre-print we explain you should always try & find out how long intervention effects last. Complete with practical how to advice & warnings of unique difficulties. In short, always follow-up. doi.org/10.31234/osf...

doi.org

OSF

0104

Protzko @protzko.bsky.social · 20/08/2026

We use correlation (r) a lot. We use it for test-retest reliability Prediction/memory accuracy Trait stability, But we should not. In a new simulation study, we show r is upwardly biased & doesn't tell you what you want. We show you what does (Table 2). osf.io/preprints/ps... #psych #stats

192

Reposted by Protzko

Sami Yousif @samiyousif.bsky.social · 18/08/2026

The bottom line here is that Prolific hosts very different kind of studies, but I worry that they are all being binned together in a way that is misleading. As a researcher, though, it feels important to me to be aware of what I am actually competing against on the platform.

111

Protzko @protzko.bsky.social · 18/08/2026

There has been a lot of helpful resources on new places to share data and code with the closing of osf. But what about preregistering? Since you can't upload files (like code) to osf post 2/27 it seems we need a new prereg option. What are people planning on moving to?

110

Reposted by Protzko

Priya Silverstein @priyasilverstein.com · 17/08/2026

Should we still use the term "preregistration"? Our take here: osf.io/preprints/ps... tl;dr: we think yes! With @lspitzer.bsky.social, @lukaswallrich.bsky.social, and @josefinaw.bsky.social

osf.io

OSF

02513

Protzko @protzko.bsky.social · 14/08/2026

Gotta love when Zotero sees a paper with dozens of authors and thinks: "well, this is a nice web page with no authors and is definitely not a journal article" so you have to input the dozens of authors by hand...

000

Reposted by Protzko

Angelika Stefan @ephemeralidea.bsky.social · 11/08/2026

I think the OSF project infrastructure contributed more than anything else to increasing transparency in psychology research and we'll have to fight to keep up the same standards!

031

Reposted by Protzko

Lisa DeBruine @debruine.bsky.social · 11/08/2026

The following R script downloads your public projects from the OSF. Set the variable "me" to your OSF user ID, which you can find at osf.io/profile after logging in.

16735

Protzko @protzko.bsky.social · 11/08/2026

What do researchers believe the replication rate of their field is? What do they think is an acceptable %? Lots of debate but not a lot of data; so we asked! 1,826 researchers in 11 fields said they thought ≈56% of studies in their field are replicable, <≈ 60% is a problem. osf.io/preprints/ps...

093

Protzko @protzko.bsky.social · 10/08/2026

Not-a-spoiler-alert: you never see demand effects in online general population studies

040

Reposted by Protzko

Gilad Feldman @giladfeldman.bsky.social · 10/08/2026

Meta Research Symposium 2026, 8-9 October 2026, TU/e Eindhoven paulmeehlschool.github.io/workshops/sy... Seems like a wonderful event for ECRs doing meta-science. I'll give a workshop on "How to use AI tools, agents, LLMs, and automation to improve open science practices" Hope to see you there.

085

Protzko @protzko.bsky.social · 09/08/2026

Hard to beat list right here

020

Reposted by Protzko

Sarah M @lore.house · 05/08/2026

Figma doesn’t mean anything but Sigma is annoying right now and I went to college during the Ligma era.

121

Reposted by Protzko

Wes Bonifay @wesbonifay.bsky.social · 05/08/2026

I'm looking for published papers showcasing creative uses of item response theory, including studies with unusual item types (e.g., audio stimuli) and/or those in contexts beyond ed/psych measurement (e.g., using chemical mixtures as "items" to measure exposure burden; Liu et al. (2022)). Any ideas?

596

Protzko @protzko.bsky.social · 06/08/2026

You shouldn't be able to cite a book; you should have to cite at minimum a chapter. If citing a book for the whole argument it makes, cite the conclusion section. I'm getting tired of reading some interesting claim, trying to see where the data came from, & the only citation is a whole book. #apa

250

Reposted by Protzko

Gilad Feldman @giladfeldman.bsky.social · 05/08/2026

I keep seeing/hearing people say that there aren't any open-science and meta-research events. Collecting and curating these the past month has shown me there is a LOT going on, just maybe difficult to keep track. See screenshots, take your pick. Metaventory can help: metaventory.vercel.app/events

2138

Protzko @protzko.bsky.social · 04/08/2026

Dispositional properties, epistemics vs. metaphysics, even the hint of formative indicators. This piece is as succinct as it gets on why Polygenic Risk scores shouldn't be treated as objective indicators of outcome probability.

000

Protzko @protzko.bsky.social · 03/08/2026

All speaking slots will be given to friends and reviewed un-blind

020

Protzko @protzko.bsky.social · 02/08/2026

I'm frequently amazed at the assumption that you can understand what a course is simply by eyeballing the syllabus. 3 professors with the exact same syllabus & reading list could teach 3 wildly different courses, even opposed to one another. Do we scrape syllabi because that's where the light is?

010

Reposted by Protzko

Sean Mackinnon @seanpmackinnon.bsky.social · 31/07/2026

I have found a great new #stats teaching hack to find new open datasets for teaching. I've been going to the Collabra: Psychology journal website, and typing in an analysis type (e.g., logistic regression) into the search bar. Both quick and high-quality data! online.ucpress.edu/collabra

44821

Protzko @protzko.bsky.social · 28/07/2026

I love that there is a branch of philosophy that reasons about bullshit. I also love seeing subtypes of bullshit, including highfalutin bullshit. Where you try to persuade people by using big and obscure words. From Nikil Mukerji link.springer.com/content/pdf/...

link.springer.com

020

Protzko @protzko.bsky.social · 23/07/2026

The OLS estimator is not the same as Pearl's do-calculus. ASSUME X2 confounds the relationship between X1 and Y. How sure are we that + X2 in a linear regression equation using the OLS estimator is actually doing the same thing as 'closing the back-door path' in a DAG? #stats

110

Protzko @protzko.bsky.social · 16/07/2026

Always love when I can't get my files off osf. Who needs data and code anyway?

111

Protzko @protzko.bsky.social · 15/07/2026

Autobiographical memories cued w/neutral words, ¼ of the time are about moral themes. Those themes revolve around being the actor of morally good acts, good agent memories are thought to have occurred more recently than our failures. From Dorthe Berntsen psycnet.apa.org/fulltext/202... #psych

020

Protzko @protzko.bsky.social · 09/07/2026

Message to all researchers (not calling anyone out) We'll start believing you want people to stop chasing journal Impact Factors As soon as You stop dropping the name of the journal your new article is in when you promote it on social media. Double fault if you only do it when IF is high #phdsky

010

Reposted by Protzko

Jamie Cummins @jamiecummins.bsky.social · 08/07/2026

WE ARE HIRING! Come work with us (me + @malte.the100.ci) on developing and validating RegCheck. PhD or postdoc applications welcome. Folk with backgrounds in meta-science, psychology, (pre)clinical trials, and/or economics are especially invited to apply. jobs.unibe.ch/job-vacancie...

jobs.unibe.ch

PhD Student/ Postdoc Position in Meta-Science - Universität Bern

Universität Bern is looking for PhD Student/ Postdoc Position in Meta-Science

15648

Protzko @protzko.bsky.social · 07/07/2026

Looking for a #SAS user who is interested in computational reproducibility to join a many-analysts-style paper. Run some #stats in SAS, get authorship, contribute to the world of reproducibility. If this is you or you know someone DM or email me (protzko@gmail) #phdsky

011

Protzko @protzko.bsky.social · 06/07/2026

Am I so reliant on Google scholar as a tool to feed Zotero that when it seems to be down today I'm giving up on writing?

020

Reposted by Protzko

Techmeme @techmeme.com · 05/07/2026

AWS says Mechanical Turk will no longer accept new customers and that it is placing the crowdsourcing service in maintenance, signaling its future retirement (Simon Sharwood/The Register) Main Link | Techmeme Permalink

02916