Katrin Auspurg @kauspurg.bsky.social · 25/06/2026For a short reply to B&B's reply, see here [osf.io/hndv4/files/ukbqy]. #AcademicSky #Sociology #Economics #OpenScience #IdeologicalBias 060
Katrin Auspurg @kauspurg.bsky.social · 25/06/2026The original authors have published a reply to our comment (www.econstor.eu/bitstream/10...). They applaud us for checking the robustness of social science research, yet at the same time accuse us of acting as the “replication police.” Here is how we see the story in a nutshell: 1194
Katrin Auspurg @kauspurg.bsky.social · 25/06/2026See the results below: bivariate no effect. Only after a sequence of adjustments —excluding valid data points, down-weighting some teams, and switching to a 10% significance level—does the reported ideology effect emerge. 180
Katrin Auspurg @kauspurg.bsky.social · 25/06/2026Our analysis shows that the claimed "ideological bias" doesn't hold up to robustness checks. It is mainly the result of a coding error that removed inconsistent data points. Descriptively, there's no evidence of ideological bias. 1111
Katrin Auspurg @kauspurg.bsky.social · 25/06/2026There’s been a lot of buzz around the Borjas/Breznau (2026) paper (www.science.org/doi/10.1126/...) and potential ideological bias in research. We took a closer look at the data. Could there be a "bias in bias research"? Here is what we found: www.econstor.eu/bitstream/10...econstor.eu 14022
Katrin Auspurg @kauspurg.bsky.social · 16/03/2026Reproductions are time-consuming and often require detective work. Better documentation and archiving could simplify reproductions. We provide recommendations for authors, journals, and data providers. Read more about this (open access): doi.org/10.1098/rsos...doi.orgCode sharing and reproducibility in survey-based social research: evidence from a large-scale auditAbstract. Reproducibility—the ability to obtain original results by reapplying the original analyses to the original data—is an essential component of empi 0183
Katrin Auspurg @kauspurg.bsky.social · 16/03/2026Openness and reproducibility are problematic across disciplines. While some disciplines (e.g. political science) fare better than others, openness and reproducibility are far from perfect across the board. 1121
Katrin Auspurg @kauspurg.bsky.social · 16/03/2026…deviations are usually small and random. Most original and reproduced results are stable in sign and significance, and we find no bias towards exaggerated effect sizes in original research. 1183
Katrin Auspurg @kauspurg.bsky.social · 16/03/2026…reproducibility problems are widespread. Only one in three authors (35%) share code, and even when code is available, only every second main result (51%) is numerically reproducible. 12111
Katrin Auspurg @kauspurg.bsky.social · 16/03/2026Do researchers share their code upon request? Does running their orginal code on the original data produce the original results? We provide evidence in a new Royal Society Open Science publication. Studying more than 1,000 articles which use data from the European Social Survey, we find that... 🧵 210848
Katrin Auspurg @kauspurg.bsky.social · 11/11/2025Billions of regressions ≠ robustness. My new PNAS Letter shows how unjustified models can drown out justified ones — and why thoughtful model selection matters👇 www.pnas.org/doi/10.1073/... 36119
Katrin Auspurg @kauspurg.bsky.social · 26/09/2024This is an extremely relevant and interesting study that shows that behavioral intentions measured in survey experiments should not be mistaken for a measure of actual behavior. And it is a nice example of studies that replicate themselves by using different research designs! 0124
Katrin Auspurg @kauspurg.bsky.social · 06/09/2024If you are interested in why many-analyst studies may overestimate uncertainty, you might want to take a look at our recent open access article: Toward a more credible assessment of the credibility of science by many-analyst studies | PNAS www.pnas.org/doi/10.1073/...pnas.orgToward a more credible assessment of the credibility of science by many-analyst studies | PNASWe discuss a relatively new meta-scientific research design: many-analyst studies that attempt to assess the replicability and credibility of resea... 03117
Katrin Auspurg @kauspurg.bsky.social · 04/09/2024I am happy that my paper with Sabine Düval is now published. We use survey experiments & causal mediation analyses to explore gender ideologies & norms underlying the division of housework. We argue that traditional ideologies may have been overestimated in previous research... 0146
Reposted by Katrin AuspurgArnout van de Rijt @arnoutvanderijt.bsky.social · 03/09/2024Sociology is behind on ** reproducibility ** but we can get together to catch up! Join our 3 sessions at the ECSR conference in Barcelona (ecsr2024.com) on what journals can do. At @sociologicalsci.bsky.social , we require data & code or a good reason. 12314
Reposted by Katrin Auspurgmeta-rep.bsky.social @meta-rep.bsky.social · 24/04/2024This year we host in October the META-REP 2024 an international conference focusing on meta-science and replicability in the cognitive, behavioral, and social sciences. The deadline for submissions is April 30. Contribute to vital discussions on meta-science and replicability. #metarep #openscienceconference2024.meta-rep.uni-muenchen.deMETA-REP Conference 2024 - LMU Munich 01112
Reposted by Katrin AuspurgArnout van de Rijt @arnoutvanderijt.bsky.social · 11/01/2024Sociology is behind on transparency but we can get together to catch up! In Europe, the ECSR conference in Barcelona will host two sessions on reproducibility, with special attention to what journals can do: ecsrnet.eu/other-events/ At Sociological Science, we're now requiring data and code. 02216
Reposted by Katrin AuspurgGerman Longitudinal Environmental Study @glen-study.bsky.social · 23/12/2023The GLEN team sends Season's Greetings to you and your loved ones! Enjoy the holidays! 092
Reposted by Katrin AuspurgGerman Longitudinal Environmental Study @glen-study.bsky.social · 21/12/2023We are happy to announce the new DFG-funded longterm German Longitudinal Environmental Study (GLEN). @glen-study.bsky.social will provide representative, individual level panel data on human-environmental interactions and climate issues. glen-studie.de #sciencenews #Klimawandel #climatechange 56838
Katrin Auspurg @kauspurg.bsky.social · 12/11/2023Ross et al. (Nature, 2022) claim that in most fields women are disadvantaged, but their results show that in only 2 out of 13 fields women are less likely to be granted authorship. For women, it seems that science is not as dismal as reported in the Nature article. 082
Katrin Auspurg @kauspurg.bsky.social · 12/11/2023"If your data contradicts the common wisdom: ignore your data." It seems that Ross et al. followed this advice when they concluded in their recent Nature article that women are credited less likely authorship in "most scientific fields". See our comment: osf.io/preprints/so... 152
Katrin Auspurg @kauspurg.bsky.social · 12/11/2023Thanks to AMCIS for inviting me and organizing a wonderful workshop. It was great to learn that there are so many interesting projects with survey experiments planned and carried out at the UvA! 080
Reposted by Katrin AuspurgEly Strömberg @elystromberg.bsky.social · 10/11/2023Yesterday’s workshop ended with a keynote by @kauspurg.bsky.social on robust design of factorial survey experiments, with proposals for how to incorporate causal inference. We’ve been very fortunate to have Katrin visiting UvA during the last week, giving valuable input to multiple projects. 0133
Katrin Auspurg @kauspurg.bsky.social · 11/10/2023Our study, which uses a longitudinal field experiment during the "European refugee crisis," comes to null- results, see sociologicalscience.com/articles-v10.... Great that we could publish that! 1174
Katrin Auspurg @kauspurg.bsky.social · 11/10/2023 More immigration, more ethnic discrimination? I am happy that the joint article with Renate Lorenz and Andreas Schneck has now appeared open access in Sociological Science. 23515
