Sign in

JK Flake

@jkflake.bsky.social
4.3K followers 593 following 196 posts

Methodology prof in psychology at the University of British Columbia working on Schmeasurement. Into big team science, open science, and latent variables. Flake lab does not study flakes.

PostsRepliesMedia
JK Flake @jkflake.bsky.social · 18/11/2025
And this is why meta analysis is screwed
030
JK Flake @jkflake.bsky.social · 11/09/2025
Sorry I gave them so much hell on this one but happy to see some solid discussion about the necessity of qualitative approaches. Bravo.
050
Reposted by JK Flake
Amanda Kay Montoya @akmontoya.bsky.social · 22/08/2025
Our lab has three RRs of simulations underway. It’s a shame to tell my students that our top journal will not consider them for publication. Let’s change that!
2112
JK Flake @jkflake.bsky.social · 21/08/2025
Help us show there is support for offering registered reports at one of Psychology's leading method's journal! chng.it/TwwnVBScVb
chng.it
Adopt Registered Reports at Psychological Methods
Can you spare a minute to help this campaign?
0156
Reposted by JK Flake
Katie Corker @katiecorker.bsky.social · 14/08/2025
"Preregistration" lumps three distinct practices into one: - Study registration - Protocol - Analysis plans (SAPs) To advance open science, it's critical that we distinguish them. 🌟 🌟 Now in-press paper from Evan Mayo-Wilson, @seangrant.bsky.social, David Moher, me: osf.io/preprints/me...
osf.io
OSF
35322
Reposted by JK Flake
Association for Psychological Science @psychscience.bsky.social · 05/08/2025
AMPPS Call for Papers: Replicability and Reproducibility in Methodological Research. Proposals due September 15. @jkflake.bsky.social 
psychologicalscience.org
11414
Reposted by JK Flake
moin syed @syeducation.bsky.social · 12/06/2025
Folks, it's time to submit your papers to PCI Psychology. Here is our invitation to you, taken from our editorial osf.io/preprints/ps...
A screenshot from the PCI Psychology editorial
25236
Reposted by JK Flake
David A. Sbarra @dsbarra.bsky.social · 20/06/2025
Check out this awesome new paper about #OpenScience in developing countries! Paper is forthcoming at AMPPS- very proud that we can promote this work. Congrats to the large and international authorship team, and esp @hcp4715.bsky.social for leading the charge. @psychscience.bsky.social
11613
Reposted by JK Flake
Brian Nosek @briannosek.bsky.social · 29/07/2025
A new preregistration template for simulation studies is now live on OSF. Thanks to the creators and the preregistration template working group for proposing and shepherding this to make it available to users. See the post if you would like to propose a new template. www.cos.io/blog/introdu...
cos.io
Introducing the Simulation Studies Preregistration Template: Q&A with Björn S. Siepe, František Bartoš, and Samuel Pawel
Initially submitted through COS’s open call for community-designed preregistration templates, the Simulation Studies Template is now part of the expanding collection of preregistration resources avail...
22714
Reposted by JK Flake
Mike Frank @mcxfrank.bsky.social · 01/07/2025
Experimentology is out today!!! A group of us wrote a free online textbook for experimental methods, available at experimentology.io - the idea was to integrate open science into all aspects of the experimental workflow from planning to design, analysis, and writing.
Experimentology cover: title and curves for distributions.
9535228
Reposted by JK Flake
ManyDogs Project @manydogsproject.bsky.social · 22/07/2025
🚨 Calling all dog behavior & cognition researchers - ManyDogs Project is launching ManyDogs 2! 🔍🐕‍🦺We're studying overimitation: Do dogs copy irrelevant actions just b/c their favorite human does them? Email manydogsproject2@gmail.com to collaborate globally and contribute to reproducible science!
A white and gray dog touches a yellow dot hanging on the wall with his nose. Text says ManyDogs 2 - Join the Team!
06144
Reposted by JK Flake
Björn Siepe @bsiepe.bsky.social · 21/07/2025
I'm very happy to see meta-science on methods research getting more attention in the form of a great new call for papers! I recently gave some talks on the existing literature on the quality and transparency of sim studies & ideas for future improvement. Slides: bsiepe.github.io/talks/2025-0...
bsiepe.github.io
Björn Siepe - Simulation Studies for Methodological Research: State of the Art, Issues, and Potential Solutions
Invited talk at the colloquium of the Methods and Evaluation / Quality Assurance Unit at the Freie Universität Berlin and the colloquium of the Statistics & Psychological Methods Working Unit at the U...
092
JK Flake @jkflake.bsky.social · 18/07/2025
Are you working on issues of replication and reproducibility of methodological research in psychology? Consider submitting a proposal to my call for papers, happy to chat about your ideas or answer any questions! www.psychologicalscience.org/publications...
psychologicalscience.org
<em>AMPPS</em> Call for Papers on Replicability and Reproducibility in Methodological Research
Methodological reform has shaped the last decade of psychological research. Researchers have undertaken replication studies, journals and funders have emphasized registration and data sharing, and aut...
06248
Reposted by JK Flake
Hu Chuan-Peng is on paternity leave @hcp4715.bsky.social · 19/06/2025
🎉 After 2 years of work, our #OpenScience guide for researchers in developing countries is LIVE! Check out our new preprint: osf.io/preprints/ps... We map the opportunities 🌟 + barriers 🧱 facing Global South researchers. *(1/4)*
17647
Reposted by JK Flake
PCI Psychology @psych.peercommunityin.org · 12/06/2025
PCI Psychology is here!! 🎉🥳 After over a year of hard work by so many people, we are thrilled to announce that we are open for submissions! Join us in making publishing more efficient, equitable, and open: psych.peercommunityin.org #PsychSciSky #scipub
psych.peercommunityin.org
PCI Psychology
Peer Community in Psychology
114199
JK Flake @jkflake.bsky.social · 26/05/2025
Robustness analysis is going to be a big part of the future of how we think about evidence synthesis and rigor - exciting new journal where you can turn your blog posts of other ways the analyses could have been done into papers! Excited to see some submissions come in!
1154
JK Flake @jkflake.bsky.social · 23/05/2025
In the workshop we'll follow an example of developing a survey to measuring pickle fanatism for marketing purposes to learn about how to develop and evaluate survey questions for a variety of purposes. The workshop spans qualitative and quantitative methods. Two days of measurement fun!
061
JK Flake @jkflake.bsky.social · 28/04/2025
HELP: Many of you will be familiar with the dataset that is often used to teach multilevel modeling with variable such as "MATHACH" and "SES" -- these data are used in papers, textbooks, and software packages. You may have the dataset on your computer, BUT, is it public use data?
nces.ed.gov
High School & Beyond (HS&B) - Available Data
The HS&B descriptive report describes the educational attainment, employment outcomes, and family formation of the 1980 sophomore class in 1992, ten years after most of the students in that cohort gra...
230
Reposted by JK Flake
Anne Scheel @annemscheel.bsky.social · 03/04/2025
Chuffed and excited to announce a new journal section in Cortex: *Methods and Assumptions* is open for submissions starting today! Read the opening editorial here (OA): www.sciencedirect.com/science/arti... 1/
sciencedirect.com
Methods and Assumptions: A new section in Cortex
25329
Reposted by JK Flake
Michael Inzlicht @minzlicht.bsky.social · 06/03/2025
Attention metascience & AI enthusiasts: SSHRC is offering $140K/2yr postdoc fellowships, and I'd be happy to sponsor someone to work in my lab at UofT. If you're interested in how AI might transform scientific practice (for better or worse), apply by April 8. Let's question everything together.
01614
JK Flake @jkflake.bsky.social · 25/03/2025
I have to fix it in my head. This survey validates me.
have.to
have.to - This website is for sale! - Have Resources and Information.
This website is for sale! have.to is your first and best source for all of the information you’re looking for. From general topics to more of what you would expect to find here, have.to has it all. We...
050
Reposted by JK Flake
Andrew Heiss @andrew.heiss.phd · 20/03/2025
I’ve long used FiveThirtyEight’s interactive “Hack Your Way To Scientific Glory” to illustrate the idea of p-hacking when I teach statistics. But ABC/Disney killed the site earlier this month :( So I made my own with #rstats and Observable and #QuartoPub ! stats.andrewheiss.com/hack-your-way/
Screenshot of the linked Quarto website, with input checkboxes to change different conditions for a regression model that predicts economic performance based on US political party, with a reported p-value
571468434
JK Flake @jkflake.bsky.social · 18/03/2025
Hope to see more papers like this that question the performance and trade-offs of more complicated and newer methods with a sample of datasets (not just simulations that can benefit from cherry picking). Combats the publication bias towards new methods and demonstrates on-going comparative work.
2122
Reposted by JK Flake
Tobias Dienlin @tobiasdienlin.com · 03/03/2025
I'm hiring! I'm looking for 1️⃣ pre-doc and 2️⃣ post-docs. If you're fascinated by media effects, quantitative methods, and open science, please consider applying 🙂 International applications welcome! Application Pre-doc: jobs.uzh.ch/job-vacancie... Application Post-doc: jobs.uzh.ch/job-vacancie...
About the position
•	3-year Ph.D. position (60%, paid according to cantonal salary scheme)
•	Can be extended by another 17 months
•	Workplace is Zurich

What will be your main tasks? 
•	Conduct a Ph.D. thesis in the field of communication, media psychology, and media effects
•	Publish in leading academic journals; present at conferences; engage in outreach 
•	Teach courses on media effects, methods, and statistics at BA and MA levels
•	Take part in doctoral training programmes offered by UZH and IKMZ
•	Participate in organisational or administrative tasks as required

What should you bring to the team? 
•	Master’s degree in communication science, psychology, or a related discipline 
•	Strong interest in research on media effects, including topics such as social media, well-being, privacy, AI, or media effects theory
•	Expertise in quantitative research methods
•	Proficiency in (or openness to learn) R, open science practices, and advanced statistics
•	Proficiency in English; knowledge of German is desirable but not mandatory

What do we offer you? 
•	Great background and support for high quality research
•	Much freedom to develop your own research interest within the topics of the division
•	Dynamic and supportive team with a collegial and inspiring working atmosphere
•	Excellent track record of the department in academic career development

How to apply
Please send the following documents as a single PDF file using UZH’s job portal (see link in post):
•	Letter of motivation (including ideas for your Ph.D. project; max. 2 pages)
•	Your CV (including a list of scientific publications and presentations, if applicable)
•	MA thesis or equivalent, research publications if already applicable
•	Copies of degrees and relevant transcripts

Deadline for applications is March 16, 2025
Applications arriving later will also be considered if no candidate has been selected until then
The position starts in April or by agreementAbout the position
•	3-year postdoctoral position (80%, paid according to cantonal salary scheme)
•	One position can be extended up to 3 years, the other up to 6 years
•	Workplace is Zurich

What will be your main tasks? 
•	Conduct research in the field of communication, media psychology, and media effects
•	Lead your own projects and collaborate in team projects
•	Publish in leading academic journals; present at conferences; engage in outreach 
•	Teach courses on media effects, methods, and statistics at BA, MA, and Ph.D. levels
•	Take part in supporting and training predocs at the division
•	Engage in third party funding activities
•	Participate in organisational or administrative tasks as required

What should you bring to the team? 
•	Doctoral degree in communication science, psychology, or a related discipline 
•	Strong interest in research on media effects, including topics such as social media, well-being, privacy, AI, or media effects theory
•	Expertise in quantitative research methods
•	Proficiency in (or openness to learn) R, open science practices, and advanced statistics
•	Proficiency in English; knowledge of German is desirable but not mandatory

What do we offer you? 
•	Great background and support for high quality research
•	Much freedom to develop your own research interest within the topics of the division
•	Dynamic and supportive team with a collegial and inspiring working atmosphere

Please send the following documents as a single PDF file using UZH’s job portal (see link in post):
•	Letter of motivation (including ideas for future research projects; max. 2 pages)
•	Your CV (including a list of scientific publications and conference presentations)
•	Full-texts of up to three sample publications & PhD dissertation
•	Copies of degrees and relevant transcripts

Deadline for applications is March 16, 2025
Applications arriving later will also be considered if no candidate has been selected until then
The position starts in April or by agreement
06451
JK Flake @jkflake.bsky.social · 25/02/2025
👀
061
Reposted by JK Flake
Data Science Renee @becomingdatasci.bsky.social · 25/02/2025
HelioCampus is hiring! We have openings for data scientists and data analysts. www.heliocampus.com/company/care... I'm the hiring manager for the data scientist role, and we're specifically looking for someone with experience working with student data in the higher ed industry.
heliocampus.com
Careers | HelioCampus
Explore our career opportunities and join our diverse team of higher ed experts. Read more.
1127
JK Flake @jkflake.bsky.social · 25/02/2025
The methods and statistics group at @tilburg-university.bsky.social get it.
0331
Reposted by JK Flake
Rebecca Sear @rebeccasear.bsky.social · 22/02/2025
The looks great: “cross-cultural developmental research poses distinct problems for ensuring high construct validity, owing to the nuances of working with children; the standard approach of transporting protocols designed & validated in one population to another risks low construct validity”
cambridge.org
Construct Validity in Cross-Cultural, Developmental Research: Challenges and Strategies for Improvement | Evolutionary Human Sciences | Cambridge Core
Construct Validity in Cross-Cultural, Developmental Research: Challenges and Strategies for Improvement
32715
JK Flake @jkflake.bsky.social · 21/02/2025
😱 'The sheer number of EFA structures that was deemed 'passing' by CFA fit indices made me realize that perfect simple structure is really more of an assumption than a real tested proposition in CFA.'
151
JK Flake @jkflake.bsky.social · 21/02/2025
Where is the hand brake? Hand brake hand schmake @eikofried.bsky.social
2231
JK Flake @jkflake.bsky.social · 21/02/2025
Some stuff I learned while visiting the @psicostat.bsky.social group at the University of Padova. 1. Super old, first psychology department in Italy and one of the first universities in the world 2. Galileo was faculty there and likely lectured from this podium
2241
JK Flake @jkflake.bsky.social · 19/02/2025
Learning about big team science projects with @debruine.bsky.social on day 3 at @psicostat.bsky.social winter school. Good chat about less sexy aspects of working in diverse groups: differences in ethics approval and date formats. Put the year first! 2025-02-19
2233
Reposted by JK Flake
Leon Xiao @leonxiao.com · 18/02/2025
We submitted to Frontiers?! 😱 It's a comment on a Frontiers paper (doi.org/10.3389/fpsy...) purporting to measure “problem gambling.” But they didn't! The scale was edited: “gambling” was changed to “spending money on gacha.” So it no longer measured “problem gambling.” 🤦 doi.org/10.31234/osf...
133
JK Flake @jkflake.bsky.social · 18/02/2025
I didn’t realize I needed a thread with conference highlights, much better than an email or remembering to check a website. So excited to see everyone in Minnesota this summer!
website.so
032
JK Flake @jkflake.bsky.social · 17/02/2025
Great history lesson from @lakens.bsky.social with the @psicostat.bsky.social group at the University of Padova. History is repeating itself, but we also get a little better after each crisis was the positive take away for me.
1309
Reposted by JK Flake
Stephen Want @stephenwant.bsky.social · 24/09/2024
Visual Analogue Scales are often used to measure short-term changes in body dissatisfaction. But how much change (out of 101 points) represents a meaningful change? 20 points? 10? 5? In our new (open access) paper, we try to find out: www.sciencedirect.com/science/arti...
1105
JK Flake @jkflake.bsky.social · 14/02/2025
I'll be at Social and Behavioural Data Science Center at the University of Amsterdam for a couple of weeks. I'm giving a lecture on Monday Feb 24th that anyone is invited to and hope to meet up with some people while I'm in town to talk methods and measurement. sites.google.com/view/mellenb...
sites.google.com
Home
1214
JK Flake @jkflake.bsky.social · 13/02/2025
Re sabbaticals: how do you handle your lab/on-going research? Do you cut out or scale back? Do you work less or does research just fill the time that was teaching/service? If you travel/do research visits/try to learn things, how do you also run your lab? Do you tell people you'll be slower?
684
JK Flake @jkflake.bsky.social · 13/02/2025
I just want to say when I called my lab, "flake lab" it was because I couldn't think of a name for it, and well it is my lab. But now it is routinely referred to as "flake lab" -- I'm sorry for all of those involved. Do we study flakes? No, we do not.
4350
Reposted by JK Flake
Eric Hehman @erichehman.bsky.social · 20/01/2025
We've had a paper reviewed by ERROR, which has concluded we had a "major error that affects a core conclusion" Few comments on the conclusion and the process in general 1/n
420954
JK Flake @jkflake.bsky.social · 20/01/2025
It is an honor for anyone to care enough about your work to check it, so thanks dudes. A mistake I suggest others not make is failing to ensure that all the data, from download, to merge, to analysis is available and each step, not just the final analysis, is reproducible.
15816
Reposted by JK Flake
Jonathan J. Park @jonathanpark.bsky.social · 16/12/2024
My first paper as an Assistant Professor at UC Davis is out in the journal SEM! In the paper, we introduce a continuous-time extension to the GIMME model implemented in OpenMx. It uses iterative tests of modification indices to construct group- and person-specific dynamic networks!
tandfonline.com
Unsupervised Model Construction in Continuous-Time
Many of the advancements reconciling individual- and group-level results have occurred in the context of a discrete-time modeling framework. Discrete-time models are intuitive and offer relatively ...
55813
JK Flake @jkflake.bsky.social · 13/12/2024
I know this is the nice place, but I'm on lists that anyone can see called things like, "harassers", "piss drinkers", "bigoted freaks", and "hate enablers." This appears to be based on accounts I follow or posts I like? Don't recall liking any piss refreshments. Seems like a toxic feature ☹️
5252
Reposted by JK Flake
Josh Grubbs @joshuagrubbsphd.com · 11/12/2024
I’ve received my fair share of bad reviews. I’ve probably written my fair share of bad reviews too. But, on the whole, my final works read better because people volunteered their time to critique my writing, my thinking, and my computational skills.
2303
JK Flake @jkflake.bsky.social · 11/12/2024
The significant mistake I made is waiting until December to invite reviewers on papers. Anyone super keen to review and have expertise in causal inference, mediation, or quant psych stuff in general?
media.tenor.com
a person is standing on a rock with the words send help written above them
ALT: a person is standing on a rock with the words send help written above them
223
JK Flake @jkflake.bsky.social · 10/12/2024
What are your favorite papers that report on experiments designed to understand how people fake responses to surveys? Particularly interested in faking of personality scales, but also in other psychological constructs.
11114
Reposted by JK Flake
Páraic O'Súilleabháin @paraic.bsky.social · 29/11/2024
We have a call open for editor for Psychological Bulletin. Deadline is Monday January 13, 2025. If you know someone or you are interested see the link below. Its a great journal to be involved with. www.apa.org/pubs/journal...
apa.org
Call for editor nominations
Find out which APA-published journals are seeking nominations for new editors or associate editors.
11923
Reposted by JK Flake
Paul Bloom @paulbloomatyale.bsky.social · 04/12/2024
Moral psychology postdoc opportunity at the University of Toronto! Please repost, and pass on to anyone you think might be interested.
16258