iiinova — where your digital self keeps evolving

JK Flake @jkflake.bsky.social · 18/11/2025

And this is why meta analysis is screwed

JK Flake @jkflake.bsky.social · 11/09/2025

Sorry I gave them so much hell on this one but happy to see some solid discussion about the necessity of qualitative approaches. Bravo.

050

Reposted by JK Flake

Amanda Kay Montoya @akmontoya.bsky.social · 22/08/2025

Our lab has three RRs of simulations underway. It’s a shame to tell my students that our top journal will not consider them for publication. Let’s change that!

2112

JK Flake @jkflake.bsky.social · 21/08/2025

Help us show there is support for offering registered reports at one of Psychology's leading method's journal! chng.it/TwwnVBScVb

chng.it

Adopt Registered Reports at Psychological Methods

Can you spare a minute to help this campaign?

0156

Reposted by JK Flake

Katie Corker @katiecorker.bsky.social · 14/08/2025

"Preregistration" lumps three distinct practices into one: - Study registration - Protocol - Analysis plans (SAPs) To advance open science, it's critical that we distinguish them. 🌟 🌟 Now in-press paper from Evan Mayo-Wilson, @seangrant.bsky.social, David Moher, me: osf.io/preprints/me...

osf.io

OSF

35322

JK Flake @jkflake.bsky.social · 13/08/2025

3 - We will notify authors if they are invited to submit a paper for full review by Oct. Full manuscripts (which could be RRs) would then be sent out for full review after submission.

010

JK Flake @jkflake.bsky.social · 13/08/2025

2- If you look at the proposal survey, you'll see it is just the idea and rationale for a paper, not the level of detail for review of an AA. The proposal will only be reviewed by me (with feedback from AMPPS as needed) for fit to the call.

110

JK Flake @jkflake.bsky.social · 13/08/2025

1 - The call is for a particular area of research that is not typically an emphasis at AMPPS, though one could be submitted through the regular channels and would be considered. The purpose of the call is to inspire and motivate a research emphasis we haven't seen many submissions on.

110

Reposted by JK Flake

Association for Psychological Science @psychscience.bsky.social · 05/08/2025

AMPPS Call for Papers: Replicability and Reproducibility in Methodological Research. Proposals due September 15. @jkflake.bsky.social

psychologicalscience.org

11414

Reposted by JK Flake

moin syed @syeducation.bsky.social · 12/06/2025

Folks, it's time to submit your papers to PCI Psychology. Here is our invitation to you, taken from our editorial osf.io/preprints/ps...

A screenshot from the PCI Psychology editorial

25236

Reposted by JK Flake

David A. Sbarra @dsbarra.bsky.social · 20/06/2025

Check out this awesome new paper about #OpenScience in developing countries! Paper is forthcoming at AMPPS- very proud that we can promote this work. Congrats to the large and international authorship team, and esp @hcp4715.bsky.social for leading the charge. @psychscience.bsky.social

11613

JK Flake @jkflake.bsky.social · 31/07/2025

I see what you are doing here and I support it.

041

Reposted by JK Flake

Brian Nosek @briannosek.bsky.social · 29/07/2025

A new preregistration template for simulation studies is now live on OSF. Thanks to the creators and the preregistration template working group for proposing and shepherding this to make it available to users. See the post if you would like to propose a new template. www.cos.io/blog/introdu...

cos.io

Introducing the Simulation Studies Preregistration Template: Q&A with Björn S. Siepe, František Bartoš, and Samuel Pawel

Initially submitted through COS’s open call for community-designed preregistration templates, the Simulation Studies Template is now part of the expanding collection of preregistration resources avail...

22714

JK Flake @jkflake.bsky.social · 29/07/2025

Thanks for sharing this! Did you see that I'm leading a call for papers at AMPPS to encourage this kind of work? Can forward to you would be great if you could help me share!

010

Reposted by JK Flake

Mike Frank @mcxfrank.bsky.social · 01/07/2025

Experimentology is out today!!! A group of us wrote a free online textbook for experimental methods, available at experimentology.io - the idea was to integrate open science into all aspects of the experimental workflow from planning to design, analysis, and writing.

Experimentology cover: title and curves for distributions.

9535228

Reposted by JK Flake

ManyDogs Project @manydogsproject.bsky.social · 22/07/2025

🚨 Calling all dog behavior & cognition researchers - ManyDogs Project is launching ManyDogs 2! 🔍🐕‍🦺We're studying overimitation: Do dogs copy irrelevant actions just b/c their favorite human does them? Email manydogsproject2@gmail.com to collaborate globally and contribute to reproducible science!

A white and gray dog touches a yellow dot hanging on the wall with his nose. Text says ManyDogs 2 - Join the Team!

06144

Reposted by JK Flake

Björn Siepe @bsiepe.bsky.social · 21/07/2025

I'm very happy to see meta-science on methods research getting more attention in the form of a great new call for papers! I recently gave some talks on the existing literature on the quality and transparency of sim studies & ideas for future improvement. Slides: bsiepe.github.io/talks/2025-0...

bsiepe.github.io

Björn Siepe - Simulation Studies for Methodological Research: State of the Art, Issues, and Potential Solutions

Invited talk at the colloquium of the Methods and Evaluation / Quality Assurance Unit at the Freie Universität Berlin and the colloquium of the Statistics & Psychological Methods Working Unit at the U...

092

JK Flake @jkflake.bsky.social · 21/07/2025

It is stupid because the call clearly says there is a fee waiver. You don't have to knock down people's work for your political tirade. APS isn't for profit, but sage is, it isn't as simple and reposting my call for your political crap is just mean. But like Chris said you're clearly too far gone.

crap.is

210

JK Flake @jkflake.bsky.social · 18/07/2025

Are you working on issues of replication and reproducibility of methodological research in psychology? Consider submitting a proposal to my call for papers, happy to chat about your ideas or answer any questions! www.psychologicalscience.org/publications...

psychologicalscience.org

<em>AMPPS</em> Call for Papers on Replicability and Reproducibility in Methodological Research

Methodological reform has shaped the last decade of psychological research. Researchers have undertaken replication studies, journals and funders have emphasized registration and data sharing, and aut...

06248

JK Flake @jkflake.bsky.social · 18/07/2025

I'm showing how often I log in here! The RB HLM textbook data has this and I think you can access various versions similar from the National Center for Educational Statistics in the US.

020

Reposted by JK Flake

Hu Chuan-Peng is on paternity leave @hcp4715.bsky.social · 19/06/2025

🎉 After 2 years of work, our #OpenScience guide for researchers in developing countries is LIVE! Check out our new preprint: osf.io/preprints/ps... We map the opportunities 🌟 + barriers 🧱 facing Global South researchers. *(1/4)*

17647

Reposted by JK Flake

PCI Psychology @psych.peercommunityin.org · 12/06/2025

PCI Psychology is here!! 🎉🥳 After over a year of hard work by so many people, we are thrilled to announce that we are open for submissions! Join us in making publishing more efficient, equitable, and open: psych.peercommunityin.org #PsychSciSky #scipub

psych.peercommunityin.org

PCI Psychology

Peer Community in Psychology

114199

JK Flake @jkflake.bsky.social · 28/05/2025

I actually didn’t know that! I wonder if it’s just a matter of pitching the idea to the editor.

110

JK Flake @jkflake.bsky.social · 26/05/2025

Robustness analysis is going to be a big part of the future of how we think about evidence synthesis and rigor - exciting new journal where you can turn your blog posts of other ways the analyses could have been done into papers! Excited to see some submissions come in!

1154

JK Flake @jkflake.bsky.social · 23/05/2025

In the workshop we'll follow an example of developing a survey to measuring pickle fanatism for marketing purposes to learn about how to develop and evaluate survey questions for a variety of purposes. The workshop spans qualitative and quantitative methods. Two days of measurement fun!

061

JK Flake @jkflake.bsky.social · 29/04/2025

Ok I'll dig deeper there! It is strange to me because the other page where it says the data are open use let's you download right from there.

are.open

010

JK Flake @jkflake.bsky.social · 28/04/2025

I know! That is what I'm trying to find out, like if it is downloadable through the public use platform, then how and from where?

210

JK Flake @jkflake.bsky.social · 28/04/2025

but that is the point, I need to confirm if it is public use to respect the agreement for my use case -- and I can't, I'm not signing up for a restricted use license, I want to know how to download it through their public platform (my understanding is you can't, as it isn't listed there??)

100

JK Flake @jkflake.bsky.social · 28/04/2025

here: nces.ed.gov/datalab/onli... the high school and beyond study isn't listed. Is this dataset instead from one of these studies? ECLSK? NELS? If so, which variables get you to this common dataset we all know? I found a math score in one of these...is it MATHACH?

nces.ed.gov

DataLab

NCES DataLab offers public access to wealth of data on the condition of American education. This suite of online data analysis tools (PowerStats, TrendStats, and QuickStats) allow users to create tabl...

130

JK Flake @jkflake.bsky.social · 28/04/2025

I thought it came from the high school and beyond study: nces.ed.gov/surveys/hsb/... , but when I go to the data lab to launch this specific study, it wants a log in (this would be restricted use): nces.ed.gov/datalab/ If I go to the area where you can download data without a log in ....

nces.ed.gov

High School & Beyond (HS&B) - Available Data

The HS&B descriptive report describes the educational attainment, employment outcomes, and family formation of the 1980 sophomore class in 1992, ten years after most of the students in that cohort gra...

220

JK Flake @jkflake.bsky.social · 28/04/2025

HELP: Many of you will be familiar with the dataset that is often used to teach multilevel modeling with variable such as "MATHACH" and "SES" -- these data are used in papers, textbooks, and software packages. You may have the dataset on your computer, BUT, is it public use data?

nces.ed.gov

High School & Beyond (HS&B) - Available Data

230

JK Flake @jkflake.bsky.social · 25/04/2025

View while I was at the dentist yesterday

050

Reposted by JK Flake

Anne Scheel @annemscheel.bsky.social · 03/04/2025

Chuffed and excited to announce a new journal section in Cortex: *Methods and Assumptions* is open for submissions starting today! Read the opening editorial here (OA): www.sciencedirect.com/science/arti... 1/

sciencedirect.com

Methods and Assumptions: A new section in Cortex

25329

Reposted by JK Flake

Michael Inzlicht @minzlicht.bsky.social · 06/03/2025

Attention metascience & AI enthusiasts: SSHRC is offering $140K/2yr postdoc fellowships, and I'd be happy to sponsor someone to work in my lab at UofT. If you're interested in how AI might transform scientific practice (for better or worse), apply by April 8. Let's question everything together.

01614

JK Flake @jkflake.bsky.social · 21/03/2025

Wow what a public service, use this in intro stats. 🎖️

060

Reposted by JK Flake

Andrew Heiss @andrew.heiss.phd · 20/03/2025

I’ve long used FiveThirtyEight’s interactive “Hack Your Way To Scientific Glory” to illustrate the idea of p-hacking when I teach statistics. But ABC/Disney killed the site earlier this month :( So I made my own with #rstats and Observable and #QuartoPub ! stats.andrewheiss.com/hack-your-way/

Screenshot of the linked Quarto website, with input checkboxes to change different conditions for a regression model that predicts economic performance based on US political party, with a reported p-value

571468434

JK Flake @jkflake.bsky.social · 18/03/2025

it’s weird that it can be both that older bad methods won’t die and still get used, but then all the methods researchers are developing new things with tiny tweaks that no one uses 😵‍💫

120

JK Flake @jkflake.bsky.social · 18/03/2025

In methods research and journals yes, I don't mean what researchers use. I mean what is valued if your research area is methods/stats. There some research by AL Boulestiex in biostats on this but agree we need meta science in quant psych, it's probably better

120

JK Flake @jkflake.bsky.social · 18/03/2025

Hope to see more papers like this that question the performance and trade-offs of more complicated and newer methods with a sample of datasets (not just simulations that can benefit from cherry picking). Combats the publication bias towards new methods and demonstrates on-going comparative work.

2122

JK Flake @jkflake.bsky.social · 13/03/2025

No no, random psychologists in our depts and on socials know more about test fairness and measurement than we do. They know these tests only measure SES and are unfair because those who study and practice more via test prep get slightly better scores. We should use rec letters and interviews more.

media.tenor.com

spongebob holding a megaphone with the words we need help behind him

ALT: spongebob holding a megaphone with the words we need help behind him

040

JK Flake @jkflake.bsky.social · 13/03/2025

I don't know if we are on the same side of this issue, but resisting the urge to get into the discourse about this is a daily struggle and we need to raise awareness about it. There should be some supports...

140

Reposted by JK Flake

Tobias Dienlin @tobiasdienlin.com · 03/03/2025

I'm hiring! I'm looking for 1️⃣ pre-doc and 2️⃣ post-docs. If you're fascinated by media effects, quantitative methods, and open science, please consider applying 🙂 International applications welcome! Application Pre-doc: jobs.uzh.ch/job-vacancie... Application Post-doc: jobs.uzh.ch/job-vacancie...

About the position
• 3-year Ph.D. position (60%, paid according to cantonal salary scheme)
• Can be extended by another 17 months
• Workplace is Zurich

What will be your main tasks?
• Conduct a Ph.D. thesis in the field of communication, media psychology, and media effects
• Publish in leading academic journals; present at conferences; engage in outreach
• Teach courses on media effects, methods, and statistics at BA and MA levels
• Take part in doctoral training programmes offered by UZH and IKMZ
• Participate in organisational or administrative tasks as required

What should you bring to the team?
• Master’s degree in communication science, psychology, or a related discipline
• Strong interest in research on media effects, including topics such as social media, well-being, privacy, AI, or media effects theory
• Expertise in quantitative research methods
• Proficiency in (or openness to learn) R, open science practices, and advanced statistics
• Proficiency in English; knowledge of German is desirable but not mandatory

What do we offer you?
• Great background and support for high quality research
• Much freedom to develop your own research interest within the topics of the division
• Dynamic and supportive team with a collegial and inspiring working atmosphere
• Excellent track record of the department in academic career development

How to apply
Please send the following documents as a single PDF file using UZH’s job portal (see link in post):
• Letter of motivation (including ideas for your Ph.D. project; max. 2 pages)
• Your CV (including a list of scientific publications and presentations, if applicable)
• MA thesis or equivalent, research publications if already applicable
• Copies of degrees and relevant transcripts

Deadline for applications is March 16, 2025
Applications arriving later will also be considered if no candidate has been selected until then
The position starts in April or by agreement

About the position
• 3-year postdoctoral position (80%, paid according to cantonal salary scheme)
• One position can be extended up to 3 years, the other up to 6 years
• Workplace is Zurich

What will be your main tasks?
• Conduct research in the field of communication, media psychology, and media effects
• Lead your own projects and collaborate in team projects
• Publish in leading academic journals; present at conferences; engage in outreach
• Teach courses on media effects, methods, and statistics at BA, MA, and Ph.D. levels
• Take part in supporting and training predocs at the division
• Engage in third party funding activities
• Participate in organisational or administrative tasks as required

What should you bring to the team?
• Doctoral degree in communication science, psychology, or a related discipline
• Strong interest in research on media effects, including topics such as social media, well-being, privacy, AI, or media effects theory
• Expertise in quantitative research methods
• Proficiency in (or openness to learn) R, open science practices, and advanced statistics
• Proficiency in English; knowledge of German is desirable but not mandatory

What do we offer you?
• Great background and support for high quality research
• Much freedom to develop your own research interest within the topics of the division
• Dynamic and supportive team with a collegial and inspiring working atmosphere

Please send the following documents as a single PDF file using UZH’s job portal (see link in post):
• Letter of motivation (including ideas for future research projects; max. 2 pages)
• Your CV (including a list of scientific publications and conference presentations)
• Full-texts of up to three sample publications & PhD dissertation
• Copies of degrees and relevant transcripts

Deadline for applications is March 16, 2025
Applications arriving later will also be considered if no candidate has been selected until then
The position starts in April or by agreement

06451