Sign in

Item Response Warehouse

@itemrespwarehouse.bsky.social
103 followers 1 following 23 posts

The IRW is a collection of harmonized datasets available for psychometrics research. itemresponsewarehouse.org

PostsRepliesMedia
Item Response Warehouse @itemrespwarehouse.bsky.social · 16/01/2026
Excellent opportunity if you are using data from the IRW or other related resources (examples: itemresponsewarehouse.org/othersites.h...)
itemresponsewarehouse.org
Related data resources and publications – Item Response Warehouse
000
Reposted by Item Response Warehouse
Leonie Vogelsmeier @leonievogelsmeier.bsky.social · 15/01/2026
📢 Call for Papers: We’re excited to announce an upcoming Psychometrika Special Issue on Data Intensive Methods in Psychometrics (think of using many datasets for methodological development), guest edited by @klint.bsky.social, @kyliegorney.bsky.social, @jmbh.bsky.social, Ben Domingue, and me.
psychometricsociety.org
055
Reposted by Item Response Warehouse
Klint Kanopka @klint.bsky.social · 15/01/2026
Excited to share a new call for papers for a special issue in Psychometrika focused on Data Intensive Methods in Psychometrics that I'll be guest editing with @kyliegorney.bsky.social, @jmbh.bsky.social, @leonievogelsmeier.bsky.social, and Ben Domingue: www.psychometricsociety.org/post/call-sp...
psychometricsociety.org
Call for Papers: Psychometrika Special Issue - Psychometric Society
Data Intensive Methods in Psychometrics
0157
Item Response Warehouse @itemrespwarehouse.bsky.social · 12/11/2025
We're also assembling data on item text as well. itemresponsewarehouse.org/itemtext.html
itemresponsewarehouse.org
Item Text – Item Response Warehouse
020
Item Response Warehouse @itemrespwarehouse.bsky.social · 12/11/2025
And an emerging set of data resources for competitions/pairwise preference work. itemresponsewarehouse.org/comps_standa...
itemresponsewarehouse.org
The Competition Data Standard – Item Response Warehouse
110
Item Response Warehouse @itemrespwarehouse.bsky.social · 12/11/2025
New: Much improved filtering of IRW tables on the home page! itemresponsewarehouse.org
itemresponsewarehouse.org
Item Response Warehouse
Open: The data are licensed for reformatting and public reuse. Their provenance is documented and code used to transform original data to meet the IRW data standard is available.Harmonized: The data a...
110
Reposted by Item Response Warehouse
Mike Frank @mcxfrank.bsky.social · 08/09/2025
The Item Response Warehouse is a new data resource for psychometricians interested in developing methods using bigger and more diverse sets of instruments: itemresponsewarehouse.org New paper out now at BRM: doi.org/10.3758/s134...
Abstract of the paper. Title page of the paper.
05313
Item Response Warehouse @itemrespwarehouse.bsky.social · 05/09/2025
Publication describing the IRW now out! link.springer.com/article/10.3... Over 1000 datasets in there with tools for pulling directly from R!
link.springer.com
An introduction to the Item Response Warehouse (IRW): A resource for enhancing data usage in psychometrics - Behavior Research Methods
The Item Response Warehouse (IRW) is a collection and standardization of a large volume of item response datasets in a free and open-source platform for researchers. We describe key elements of the da...
021
Item Response Warehouse @itemrespwarehouse.bsky.social · 23/06/2025
Lots of item-level heterogeneity in treatment sensitivity across a wide-range of RCTs (consistent with the earlier findings from www.tandfonline.com/doi/abs/10.1... that focused on education-based RCTs).
010
Reposted by Item Response Warehouse
Charlie Rahal @crahal.com · 10/06/2025
🔥Coming July 2: 'Metrics and Models'!🔥 A new seminar series on advanced modelling w/ impact across health/society. 🌍 Open to *ALL*! 🕑 Weds 2pm UK alternating weeks (online) 🔗 metrics-and-models.github.io 📬 metrics_and_models-subscribe@maillist.ox.ac.uk Brilliant speakers. *Please share*!
12617
Item Response Warehouse @itemrespwarehouse.bsky.social · 02/06/2025
Analysis of treatment effects on psychological networks using data from the IRW: "Our results show that causal effects on network strength are both common and uncorrelated with effects on network state." New work from @jbgilbert.bsky.social psycnet.apa.org/doiLanding?d...
021
Item Response Warehouse @itemrespwarehouse.bsky.social · 21/05/2025
As the IRW approaches 1000 tables, there is an obvious need for better approaches when querying appropriate tables. We've added more metadata (including human annotation) and improved R-based functionality for doing just that! itemresponsewarehouse.org/metadata.html
itemresponsewarehouse.org
Metadata for IRW tables – Item Response Warehouse
040
Item Response Warehouse @itemrespwarehouse.bsky.social · 12/03/2025
Simulation studies are common in psychometrics. We are trying to make them more relevant to practice by increasing their connection to empirical data. Feedback welcome! osf.io/preprints/ps...
osf.io
OSF
011
Reposted by Item Response Warehouse
jbgilbert.bsky.social @jbgilbert.bsky.social · 06/03/2025
New paper out yesterday in Behavior Research Methods (BRM): link.springer.com/epdf/10.3758... @itemrespwarehouse.bsky.social
link.springer.com
Polytomous explanatory item response models for item discrimination: Assessing negative-framing effects in social-emotional learning surveys
011
Item Response Warehouse @itemrespwarehouse.bsky.social · 03/03/2025
That leader being @sachaepskamp.bsky.social !
010
Item Response Warehouse @itemrespwarehouse.bsky.social · 03/03/2025
For those with psychometric interests: spread the word about this talk on network psychometrics from one of the leaders in that field this coming Wednesday. Details here: ssps.su.domains
ssps.su.domains
Stanford Sporadic Psychometrics Seminar
110
Item Response Warehouse @itemrespwarehouse.bsky.social · 16/12/2024
See also additional description in section 4.4 of the updated IRW preprint. osf.io/preprints/ps...
osf.io
OSF
000
Item Response Warehouse @itemrespwarehouse.bsky.social · 16/12/2024
We're working to make code available to make these kinds of analyses easy for others to do. For the item-level HTE work, see here: github.com/ben-domingue...
github.com
irw/manuscript_src/03_il-hte.R at main · ben-domingue/irw
Code related to data for the Item Response Warehouse - ben-domingue/irw
100
Item Response Warehouse @itemrespwarehouse.bsky.social · 12/12/2024
7/ Many of these data are available for reuse on the IRW! Next week we'll share code to help you start replicating these analyses!
000
Item Response Warehouse @itemrespwarehouse.bsky.social · 12/12/2024
6/ Understanding whether an empirical study is one versus the other may help us refine our understanding of what is really happening in the treatment.
100
Item Response Warehouse @itemrespwarehouse.bsky.social · 12/12/2024
5/ This paper shows that many treatments increase the response averages (ie a conventional treatment effect) while others serve to tighten connections between items (while not changing the overall level of item response).
100
Item Response Warehouse @itemrespwarehouse.bsky.social · 12/12/2024
4/ A separate paper (osf.io/preprints/ps...) pushes further to consider treatment effects from these studies from the perspective of network psychometrics.
osf.io
OSF
100
Item Response Warehouse @itemrespwarehouse.bsky.social · 12/12/2024
3/ It goes further and shows that we may misunderstand uncertainty if we do not account for item-level variation and demonstrates identification challenges associated with the estimation of treatment-by-covariate interaction effects (a big deal given interest in heterogeneous treatment effects).
100
Item Response Warehouse @itemrespwarehouse.bsky.social · 12/12/2024
2/ This study, along with previous work (www.tandfonline.com/doi/abs/10.1...), shows that item-level variation in treatment effects is a real problem in empirical data!
tandfonline.com
Heterogeneity of Item-Treatment Interactions Masks Complexity and Generalizability in Randomized Controlled Trials
Researchers compare aggregate test data across treatment and control group in randomized controlled trials to determine intervention impact on student achievement. We show that item-level data and ...
100
Item Response Warehouse @itemrespwarehouse.bsky.social · 12/12/2024
1/ What might data-rich #psychometrics research look like? As a first example, consider @jbgilbert.bsky.social on heterogeneous treatment effects (HTE). Josh uses #irt to examine item-level HTE, with insights drawn from 75 datasets across 48 randomized trials (arxiv.org/abs/2405.00161).
arxiv.org
Estimating Heterogeneous Treatment Effects with Item-Level Outcome Data: Insights from Item Response Theory
Analyses of heterogeneous treatment effects (HTE) are common in applied causal inference research. However, when outcomes are latent variables assessed via psychometric instruments such as educational...
162
Item Response Warehouse @itemrespwarehouse.bsky.social · 10/12/2024
See website for more details! datapages.github.io/irw/
datapages.github.io
Item Response Warehouse
Open: The data are licensed for reformatting and public reuse. Their provenance is documented and code used to transform original data to meet the IRW data standard is available.Harmonized: The data a...
021
Item Response Warehouse @itemrespwarehouse.bsky.social · 10/12/2024
You can access these datasets straight from R or Python using API calls. Paperwork (citation & license) on the provenance of all inclusions available too.
120
Item Response Warehouse @itemrespwarehouse.bsky.social · 10/12/2024
Do you need educational and psychological item response data to do your research? The IRW has 600 item response datasets (more coming!), distributed in a standardized format and ready for analysis.
23620