Sign in

Anne-Laure Boulesteix

@boulesteixlaure.bsky.social
768 followers 204 following 70 posts

Statistician and metascientist. Professor of biometrics at LMU Munich Medical and Mathematical Faculties, committed to open science, member of the Munich Center of Machine Learning. Opinions are mine.

PostsRepliesMedia
Reposted by Anne-Laure Boulesteix
Georg Heinze @georgheinze.bsky.social · 26/06/2025
Comment by the STRATOS initiative: (including @boulesteixlaure.bsky.social @mhstat.bsky.social) onlinelibrary.wiley.com/doi/10.1002/... (6/8)
onlinelibrary.wiley.com
Commentary: Regression Models—Efforts Are Required to Improve Statistical Practice and Teaching
Click on the article title to read more.
141
Reposted by Anne-Laure Boulesteix
Mark Rubin @markrubin.bsky.social · 23/05/2025
Workshop on “Evidence & Uncertainty in Science: Methodological, Philosophical and Meta-Scientific Issues” 10th & 11th June, Uni of Tübingen, in-person only uni-tuebingen.de/de/281247#c2... ‪With @cruwelli.bsky.social, @boulesteixlaure.bsky.social, @babeheim.bsky.social, & @hendriks.bsky.social ‬
0137
Reposted by Anne-Laure Boulesteix
Florian Naudet @floriannaudet.bsky.social · 20/03/2025
theguardian.com
French scientist denied US entry after phone messages critical of Trump found
France’s research minister said the scientist was traveling to Houston for a conference when his phone was searched
023
Anne-Laure Boulesteix @boulesteixlaure.bsky.social · 12/03/2025
NEW (METASCIENTIFIC) PREPRINT on the exploratory/confirmatory distinction: Title: On "confirmatory" methodological research in statistics and related fields by @iamjulianlange.bsky.social J. Wilcke, @sabinehoffmann11.bsky.social M. Herrmann and myself arxiv.org/abs/2503.08124
arxiv.org
On "confirmatory" methodological research in statistics and related fields
Empirical substantive research, such as in the life or social sciences, is commonly categorized into the two modes exploratory and confirmatory, both of which are essential to scientific progress. The...
161
Anne-Laure Boulesteix @boulesteixlaure.bsky.social · 07/03/2025
NEW METASCIENTIFIC PREPRINT: "The impact of the storytelling fallacy on real data examples in methodological research" by M. Mandl et al: arxiv.org/html/2503.03... or why it is misleading to argue in favor of a method just because one can tell a nice story on the results obtained for n=1 dataset.
arxiv.org
The impact of the storytelling fallacy on real data examples in methodological research
051
Anne-Laure Boulesteix @boulesteixlaure.bsky.social · 05/03/2025
NEW PAPER: Confidence intervals for (e.g., cross-validation) prediction error by H. Schulz-Kümpel, S. Fischer et al. "Constructing confidence Intervals for “the” Generalization Error – a Comprehensive Benchmark Study" openreview.net/pdf?id=x7kCj...
openreview.net
1141
Reposted by Anne-Laure Boulesteix
Alfredo Sánchez-Tójar @asanchez-tojar.bsky.social · 07/02/2025
This Registered Report masterpiece just dropped at BMC Biology, brilliantly led by a great team with the help of 300+ analysts & reviewers Same question, same data: go figure! tl;dr: Substantial heterogeneity among results comes from differences among analytical choices 🔗 doi.org/10.1186/s129...
210351
Reposted by Anne-Laure Boulesteix
Stephen Senn @stephensenn.bsky.social · 25/11/2024
IMO it’s a mistake to give stats to 1st year med students. It’s not why they chose medicine & they resent it. Better to wait until they have developed some curiosity for it. I argued unsuccessfully for this during my time at UCL.
5389
Reposted by Anne-Laure Boulesteix
Miguel Hernan @miguelhernan.org · 26/11/2024
Does #randomization ensures balance of risk factors between groups? Consider this: In Denmark 860 individuals were randomly allocated to either intervention or control. Individuals were unaware of their allocation. No intervention took place. Mortality was higher in the intervention group (p=0.003)
712347
Reposted by Anne-Laure Boulesteix
Malika Ihle @malikaihle.bsky.social · 19/11/2024
So happy to see you all here! As the @lmu-osc.bsky.social coordinator, I just started a new project: coaching individual research groups so members can switch together to #OpenResearch - a tailored pedagogical intervention to maximise chances of sustainable adoption in the group, and a lot of fun! 🧵
2175
Reposted by Anne-Laure Boulesteix
Wolfgang Huber @wkhuber.bsky.social · 19/11/2024
Something that's been bugging me for a while in bioinformatics data analysis is this overreliance on packages, workflows and what's been called "cargo cult science". Can we have more conceptual thinking, more theory? Asking for what we really want to achieve and what we need to do gets us there.
3322134
Anne-Laure Boulesteix @boulesteixlaure.bsky.social · 18/11/2024
Happy to have been involved in this exciting project on the registration, design and reporting of statistical simulation studies, with @bsiepe.bsky.social @timpmorris.bsky.social et al., appeared in Psychological Methods:
062
Reposted by Anne-Laure Boulesteix
Wolfgang Huber @wkhuber.bsky.social · 18/11/2024
AI researchers: hold my beer — Old model performed slightly not worse when data were generated by the new generative AI method I just made up
0143
Reposted by Anne-Laure Boulesteix
Maarten van Smeden @maartenvsmeden.bsky.social · 18/11/2024
I made one for stats papers
A joke about statistics papers
15542148
Reposted by Anne-Laure Boulesteix
Björn Siepe @bsiepe.bsky.social · 18/11/2024
Simulation studies are essential for methods research. How well are they conducted & reported? How can we improve their quality? Out now in Psychological Methods, see 🧵 below. With @fbartos.bsky.social, @timpmorris.bsky.social, @boulesteixlaure.bsky.social, @danielheck.bsky.social & Samuel Pawel
46322
Reposted by Anne-Laure Boulesteix
Richard Riley (R²) @richarddriley.bsky.social · 14/11/2024
MEMTAB 2025 pre-conference courses news! 2 options: - An Introduction to Clinical Prediction Models and Sample Size Calculations for Model Development & Evaluation - Systematic Reviews of Prognosis Studies Just £50 when registering for conference! Details 👇 uobevents.eventsair.com/memtab-2025/...
uobevents.eventsair.com
Pre-conference Courses - MEMTAB 2025
1177
Reposted by Anne-Laure Boulesteix
Pausal Zivference @pausalz.bsky.social · 14/11/2024
We must stand against the arbitrary categorization of continuous variables! ... and that's why I'm proud to announce my support of abolishing time zones in favor of the time gradient
Two maps the the contiguous United States. The first is colored with the 4 time zones. Above that map states "say no to time zones". The bottom is the same map but with a continuous color gradient. Above that map states "say yes to the time gradient"
2627540
Reposted by Anne-Laure Boulesteix
Maarten van Smeden @maartenvsmeden.bsky.social · 11/11/2024
Which reminds me of this Andrew Vickers quote www.nature.com/articles/ncp...
56822
Reposted by Anne-Laure Boulesteix
Wolfgang Huber @wkhuber.bsky.social · 01/11/2024
Independent GroupLeader / PI position in AI in Genome Biology, Multimodal Omics at European Molecular Biology Lab (EMBL), Heidelberg! www.embl.org/jobs/positio... Looking in particular for researchers with quantitative/ methodological background who want to dive into leading edge biology research.
23449
Reposted by Anne-Laure Boulesteix
Wolfgang Huber @wkhuber.bsky.social · 21/10/2024
For all the new followers here: welcome! Here some recent highlights: (1/4) My eclectic and subjective list of scientific writing tips
huber.embl.de
Scientific writing tips – Huber Group @ EMBL
An eclectic and subjective list
55517
Reposted by Anne-Laure Boulesteix
Hugh Shanahan @hughshanahan.bsky.social · 28/10/2024
Bias in the evaluation of female academics is hard to remove www.forbes.com/sites/kimels...
forbes.com
College Professors Tried To Reduce Gender Bias In Evaluations—But Couldn’t
Hamilton College researchers tested strategies to reduce gender bias in student evaluations, but their efforts failed, highlighting how deeply ingrained bias remains.
133
Reposted by Anne-Laure Boulesteix
Maarten van Smeden @maartenvsmeden.bsky.social · 21/10/2024
Created a new group replacing and updating a list I enjoyed following on the bird site. Mostly people posting on medical stats and DS/AI ICYI: go.bsky.app/ArqEz36
go.bsky.app
Medical stats/ds/ai
Join the conversation
76732
Reposted by Anne-Laure Boulesteix
Darren Dahly @statsepi.bsky.social · 24/10/2024
And there, look out! A meteor! In the form of the BMJ that code sharing will become mandatory. We told you this was coming. Scrutiny of your research data practices. And now it's here. www.bmj.com/content/384/...
bmj.com
Mandatory data and code sharing for research published by The BMJ
New policy requires authors to share analytic codes from all studies and data from all trials The case for sharing data from clinical research is strong.12 Clinical study data include all informatio...
2176
Reposted by Anne-Laure Boulesteix
Tim Morris @timpmorris.bsky.social · 22/10/2024
Heinze G, Boulesteix A-L, Kammer M, Morris TP, White IR. ‘Phases of methodological research in biostatistics—Building the evidence base for new methods.’ Proposes a ‘methods-development pipeline’… 10/ doi.org/10.1002/bimj...
doi.org
Phases of methodological research in biostatistics—Building the evidence base for new methods
Although new biostatistical methods are published at a very high rate, many of these developments are not trustworthy enough to be adopted by the scientific community. We propose a framework to think...
122
Reposted by Anne-Laure Boulesteix
Tim Morris @timpmorris.bsky.social · 22/10/2024
Friedrich S, Friede T. ‘On the role of benchmarking data sets and simulations in method comparison studies.’ Nice discussion of simulation studies vs. benchmarking datasets for prediction/classification methodology work. 9/ doi.org/10.1002/bimj...
doi.org
On the role of benchmarking data sets and simulations in method comparison studies
Method comparisons are essential to provide recommendations and guidance for applied researchers, who often have to choose from a plethora of available approaches. While many comparisons exist in the...
101
Reposted by Anne-Laure Boulesteix
Tim Morris @timpmorris.bsky.social · 22/10/2024
Strobl C, Leisch F. ‘Against the “one method fits all data sets” philosophy for comparison studies in methodological research.’ Makes the argument for simulation/comparison studies to ask ‘which methods work well when’ instead of ‘which method is best on average’. 8/ doi.org/10.1002/bimj...
doi.org
Against the “one method fits all data sets” philosophy for comparison studies in methodological research
Many methodological comparison studies aim at identifying a single or a few “best performing” methods over a certain range of data sets. In this paper we take a different viewpoint by asking whether ...
111
Reposted by Anne-Laure Boulesteix
Tim Morris @timpmorris.bsky.social · 22/10/2024
Morris TP, White IR, Cro S, Bartlett JW, Carpenter JR, Pham TM. ‘Comment on Oberman & Vink: Should we fix or simulate the complete data in simulation studies evaluating missing data methods?’ Says when we can fix the complete data and gives many cautions against doing so. 7/ doi.org/10.1002/bimj...
doi.org
Comment on Oberman & Vink: Should we fix or simulate the complete data in simulation studies evaluating missing data methods?
For simulation studies that evaluate methods of handling missing data, we argue that generating partially observed data by fixing the complete data and repeatedly simulating the missingness indicator...
101
Reposted by Anne-Laure Boulesteix
Tim Morris @timpmorris.bsky.social · 22/10/2024
Oberman HI, Vink G. ‘Toward a standardized evaluation of imputation methodology’ Loads of useful and practical advice for simulation studies comparing missing data methods (particular relevance to missing covariate values in observational research). 6/ @oberman.bsky.social doi.org/10.1002/bimj...
doi.org
Toward a standardized evaluation of imputation methodology
Developing new imputation methodology has become a very active field. Unfortunately, there is no consensus on how to perform simulation studies to evaluate the properties of imputation methods. In pa...
112
Reposted by Anne-Laure Boulesteix
Tim Morris @timpmorris.bsky.social · 22/10/2024
Pawel S, Kook L, Reeve K. Pitfalls and potentials in simulation studies: Questionable research practices in comparative simulation studies allow for spurious claims of superiority of any method. Nice table of QRPs, and recommendations to avoid them. 5/ doi.org/10.1002/bimj...
doi.org
Pitfalls and potentials in simulation studies: Questionable research practices in comparative simulation studies allow for spurious claims of superiority of any method
Comparative simulation studies are workhorse tools for benchmarking statistical methods. As with other empirical studies, the success of simulation studies hinges on the quality of their design, exec...
111
Reposted by Anne-Laure Boulesteix
Tim Morris @timpmorris.bsky.social · 22/10/2024
Nießl C, Hoffmann S, Ullmann T, Boulesteix AL. ’Explaining the optimistic performance evaluation of newly proposed methods: A cross-design validation experiment’ Shows how method comparison studies can over-claim and gives some meta-evidence… @boulesteixlaure.bsky.social 3/ doi.org/10.1002/bimj...
doi.org
Explaining the optimistic performance evaluation of newly proposed methods: A cross‐design validation experiment
The constant development of new data analysis methods in many fields of research is accompanied by an increasing awareness that these new methods often perform better in their introductory paper than....
101
Reposted by Anne-Laure Boulesteix
Tim Morris @timpmorris.bsky.social · 22/10/2024
This is hands down my favourite issue (now known as 'collection') of any journal ever. I love the 12 meta-scientific papers. So happy that @boulesteixlaure.bsky.social masterminded it. A thread of some personal highlights 👇 1/ doi.org/10.1002/bimj.202400031
11610
Anne-Laure Boulesteix @boulesteixlaure.bsky.social · 21/10/2024
Glad to see so many people interested in stats here :) I would be happy to discuss "neutral comparison studies in methodological research", see the editorial of our special collection in Biometrical Journal: onlinelibrary.wiley.com/doi/full/10....
onlinelibrary.wiley.com
Editorial for the special collection “Towards neutral comparison studies in methodological research”
Click on the article title to read more.
176
Reposted by Anne-Laure Boulesteix
Raywat Deonandan 🍁🇨🇦 @deonandan.bsky.social · 26/09/2024
1) people don't want to read large docs, so get AI to summarize them 2) people don't want to write large docs, so get AI to expand their summaries 3) We're very close to having AIs writing documents just for each other to read 4) AI #1 to AI #2: "WTF we doing here, man?"
1114
Reposted by Anne-Laure Boulesteix
Jack Wilkinson @jdwilko.bsky.social · 04/09/2024
People often rush to submit an article to a special issue related to their work? Why? What difference does it make if your article is in a themed issue? Do people think it increased chance of acceptance?
411
Reposted by Anne-Laure Boulesteix
Tim Morris @timpmorris.bsky.social · 05/09/2024
For the one I was involved with, it’s now an easy-to-remember place containing a lot of good & relevant papers. I’ll remember the issue where I might not remember every individual paper. onlinelibrary.wiley.com/doi/toc/10.1...
onlinelibrary.wiley.com
Special Collection: “Neutral Comparison Studies in Methodological Research”: Biometrical Journal
The Biometrical Journal publishes papers on statistical methods and their applications to life sciences, encompassing medicine, environmental sciences & agriculture.
142
Reposted by Anne-Laure Boulesteix
Eiko Fried @eikofried.bsky.social · 03/09/2024
"Why Student Ratings of Faculty Are Unethical" Food for thought (curious what others think). #AcademicSky link.springer.com/article/10.1...
link.springer.com
Why Student Ratings of Faculty Are Unethical - Journal of Academic Ethics
For decades, student ratings of university faculty have been used by administrators in high stakes faculty employment decisions such as tenure, promotion, contract renewal and reappointment, and merit...
83014
Anne-Laure Boulesteix @boulesteixlaure.bsky.social · 23/08/2024
PREPRINT: "On the handling of method failure in comparison studies", by M. Wünsch with @timpmorris.bsky.social Imagine we want to compare the performances of methods A and B, and method A fails to produce results for some of the simulation iterations/data sets. What next? arxiv.org/abs/2408.11594
arxiv.org
On the handling of method failure in comparison studies
Comparison studies in methodological research are intended to compare methods in an evidence-based manner, offering guidance to data analysts to select a suitable method for their application. To...
052
Anne-Laure Boulesteix @boulesteixlaure.bsky.social · 01/08/2024
NEW PAPER published in BMC Med Res Meth, by Maximilian Mandl, with S. Hoffmann et al. on the connection between multiple testing adjustment and p-hacking/researchers' degrees of freedom: bmcmedresmethodol.biomedcentral.com/articles/10....
bmcmedresmethodol.biomedcentral.com
Addressing researcher degrees of freedom through minP adjustment - BMC Medical Research Methodology
When different researchers study the same research question using the same dataset they may obtain different and potentially even conflicting results. This is because there is often substantial flexib...
030
Reposted by Anne-Laure Boulesteix
Brian Nosek @briannosek.bsky.social · 17/06/2024
New role for a Project Coordinator at COS. Perfect for an early career researcher passionate about open scholarship and looking to gain research experience, whether to then go to grad school or stay in industry. jobs.lever.co/cos/ce551e5d...
jobs.lever.co
Center For Open Science - Project Coordinator
At the Center for Open Science (COS), we build the tools to make it possible and easy for the research community to make scientific investigations' data, results, and outcomes open, transparent, and r...
02534
Reposted by Anne-Laure Boulesteix
Tom Hardwicke @tomhardwicke.bsky.social · 11/06/2024
New preprint! "Prevalence of transparent research practices in psychology: A cross-sectional study of empirical articles published in 2022" osf.io/preprints/ps... After > decade of new infrastructure, advocacy, & policy, how often are transparent research practices used in empirical psychology?
13918
Reposted by Anne-Laure Boulesteix
Institute for Replication @i4replication.bsky.social · 07/06/2024
We've got a new DP: J. Fitzgerald implements equivalence testing methods in a systematic reproduction of 135 null claims made in 81 articles from top economics journals. econpapers.repec.org/paper/zbwi4r...
034
Reposted by Anne-Laure Boulesteix
Peter Tennant @pwgtennant.bsky.social · 06/06/2024
No. This is not acceptable. The methods section is the single most important part of a scientific paper. If those details are relegated to supplementary materials, then it's not a scientific paper in a scientific journal.
Screenshot of an academic article where it says "materials and methods are available in the online-only supplement".
115013
Reposted by Anne-Laure Boulesteix
Christopher Madan @engra.me · 03/06/2024
"A random half of panelists were shown a CV and only a one-paragraph summary of the proposed research, while the other half were shown a CV and a full proposal. We find that withholding proposal texts from panelists did not detectibly impact their proposal rankings" link.springer.com/article/10.1...
link.springer.com
Do grant proposal texts matter for funding decisions? A field experiment - Scientometrics
Scientists and funding agencies invest considerable resources in writing and evaluating grant proposals. But do grant proposal texts noticeably change panel decisions in single blind review? We report...
47847
Reposted by Anne-Laure Boulesteix
SORTEE @sortee.bsky.social · 23/05/2024
Join our workshop: An introduction to using simulations for study design and pre-registration, by Joel Pick When: 30th May, 10:00 am CEST This workshop is aimed at empiricists from any career stage or discipline. Register at events.humanitix.com/sortee-works... #SORTEEtools
087
Reposted by Anne-Laure Boulesteix
Angelika Stefan @ephemeralidea.bsky.social · 27/05/2024
Happening today at 16:00 (CET)!
021
Reposted by Anne-Laure Boulesteix
Anne Scheel @annemscheel.bsky.social · 15/05/2024
Exciting news: I will be teaching a 4-day summer school on open science this August! The course is for ECRs in the social & behavioural sciences who want to get up to speed with open & reproducible practices and/or learn how to handle specific problems. utrechtsummerschool.nl/courses/data...
utrechtsummerschool.nl
Open Science Bootcamp | Utrecht Summer School
This course offers hands-on training in transparent and reproducible research practices. These include preregistration, analysis blinding, FAIR but safe data sharing, dynamic documents, and version co...
35037
Reposted by Anne-Laure Boulesteix
Wolfgang Huber @wkhuber.bsky.social · 21/05/2024
CSAMA one-week summer school biological data science, in Brixen/Bressanone, South Tyrol, 23-28 June. Register now for one of the last places. Topics include single cell omics, statistical foundations, R/Bioconductor tools, mass spec, interactive workflows csama2024.bioconductor.eu
024
Reposted by Anne-Laure Boulesteix
Michèle Nuijten @michelenuijten.bsky.social · 21/05/2024
We are planning randomized controlled studies to assess a causal effect of #statcheck, specifically. Are you an editor & is your journal interested in collaborating? Let me know! 7/n
455
Anne-Laure Boulesteix @boulesteixlaure.bsky.social · 21/05/2024
Happy to be part of the instructor team at CSAMA in Brixen (Italy), 23 - 28 June 2024. You can still register! csama2024.bioconductor.eu
csama2024.bioconductor.eu
CSAMA 2024
Biological Data Science, 23-28 June 2024, Brixen / Bressanone, Italy
001
Reposted by Anne-Laure Boulesteix
Berna Devezer @devezer.bsky.social · 19/05/2024
Bear with me for tooting my own horn but that's why we wrote this paper and that's why we need a principled, theoretically literate approach to metascience. Fewer heuristics, deeper understanding, measured claims. royalsocietypublishing.org/doi/10.1098/...
royalsocietypublishing.org
The case for formal methodology in scientific reform | Royal Society Open Science
Current attempts at methodological reform in sciences come in response to an overall lack of rigor in methodological and scientific practices in experimental sciences. However, most methodological ref...
2135