Sign in

Dylan Burton

@dylanburton.bsky.social
519 followers 178 following 28 posts

Assistant Professor at Georgia State University. MSU and Lancaster alum. My research focus is on language testing and assessment. Learn more about me here: dylanburton.hcommons.org

PostsRepliesMedia
Dylan Burton @dylanburton.bsky.social · 17/09/2026
Registration is open for ECOLT 2026! Saturday, Nov 7 at Georgia State University, Atlanta. Theme: "Language Assessment, Learning, and Local Context." Plenary by Dr. Xun Yan (UIUC). Two pre-conference workshops on Nov 6. Register: sites.google.com/view/ecolt/e...
sites.google.com
ECOLT - Registration
Registration for ECOLT 2026 REGISTER HERE
000
Dylan Burton @dylanburton.bsky.social · 03/08/2026
If you've ever run a stimulated recall study and wondered what to actually report, or how your approach compares to what's already out there, you might be interested in this paper. onlinelibrary.wiley.com/doi/10.1111/...
onlinelibrary.wiley.com
<em>Language Learning</em> | Language Learning Research Club Journal | Wiley Online Library
A one-page Accessible Summary of this article in nontechnical language will be freely available in the Supporting Information online and at https://oasis-database.org upon publication of this article
111
Dylan Burton @dylanburton.bsky.social · 03/07/2026
Excited to share that Soyoung Lim and I have reviewed the Test of Proficiency in Korean (TOPIK), out now in @langtestjournal.bsky.social. We hope this review is useful for test takers, test score users, and researchers considering TOPIK for their own purposes. journals.sagepub.com/doi/10.1177/...
journals.sagepub.com
Test Review: The Test of Proficiency in Korean - So-Young Lim, John Dylan Burton, 2026
As a nationally accredited test, the Test of Proficiency in Korean (TOPIK) assesses general Korean proficiency as a foreign language for various high-stakes pur...
020
Reposted by Dylan Burton
michaelgoodine.bsky.social @michaelgoodine.bsky.social · 02/07/2026
Check it out. "Language Testing" published a review of the TOPIK. journals.sagepub.com/doi/10.1177/...
journals.sagepub.com
Sage Journals: Discover world-class research
Subscription and open access journals from Sage, the world's leading independent academic publisher.
001
Reposted by Dylan Burton
Michael Okun @michael-okun.bsky.social · 10/06/2026
I’ve officially resigned as Associate Editor for Frontiers in Systems Neuroscience. It used to be a reputable journal, but became a case study in how forced automation destroys academic integrity. 👇
5435871430
Reposted by Dylan Burton
Prof. Nicole Holliday @mixedlinguist.bsky.social · 09/06/2026
Out now in International Journal of Applied Linguistics, my new paper, "Unrealistic Feedback in Socially Prescriptive Speech Technologies". tl;dr LLMs are terrible at evaluating speech, and you should not use them unless you'd like a class-action lawsuit. onlinelibrary.wiley.com/doi/epdf/10....
onlinelibrary.wiley.com
Unrealistic Feedback in Socially Prescriptive Speech Technologies
Reader environment loaded
24717
Dylan Burton @dylanburton.bsky.social · 20/04/2026
The call for papers for the East Coast Organization of Language Testers (ECOLT) 2026 is now live, and we are proud to be hosting it at Georgia State University on November 6, 2026. Check out the call and join us here in Atlanta later this year! sites.google.com/view/ecolt
sites.google.com
ECOLT
We are proud to announce that ECOLT 2026 will take place at Georgia State University on November 6, 2026 Click here to Call for Proposals
010
Reposted by Dylan Burton
Language Testing @langtestjournal.bsky.social · 08/04/2026
Language Testing Volume 43 Issue 2 is now available! In this issue: 2 original articles, 2 systematic reviews, 1 brief report, and 2 book reviews. Check out our spotlight on the systematic reviews in this thread ⬇️. Full issue is available here: journals.sagepub.com/toc/ltja/43/2
134
Reposted by Dylan Burton
Dan Isbell @danielrisbell.bsky.social · 26/02/2026
Journal of Psycholinguistic Research is doing some major shaping up; Brysbaert and Folk outline new editorial guidelines to promote robust, reproducible quantitative research with strong conceptual foundations: link.springer.com/article/10.1...
link.springer.com
Editorial Journal of Psycholinguistic Research - Journal of Psycholinguistic Research
Journal of Psycholinguistic Research -
143
Dylan Burton @dylanburton.bsky.social · 13/02/2026
Check out my new article! Here I look at nonverbal behaviors that listeners mention most often when listening to L2 speech and how they perceive their function in communication. onlinelibrary.wiley.com/doi/10.1002/...
onlinelibrary.wiley.com
The Salience and Function of Nonverbal Behavior in L2 Speech Evaluations
Language educators often focus on the linguistic features of second language (L2) speech for teaching and assessment, but research has found that listeners also attend to a range of evidence, includi...
010
Reposted by Dylan Burton
Language Testing @langtestjournal.bsky.social · 18/12/2025
Check out Lynda Taylor's piece in #LanguageTesting on what it means to be a member of a professional association in our field. doi.org/10.1177/0265... (1/2)
132
Reposted by Dylan Burton
Language Testing @langtestjournal.bsky.social · 18/12/2025
This pioneering Virtual Special Issue by Salomé Villa Larenas on the #GlobalSouth is consequential in bringing to light regional disparities in our journal and field and in shifting the focus to underrepresented contexts. doi.org/10.1177/0265... (1/4)
122
Reposted by Dylan Burton
Saloni @scientificdiscovery.dev · 09/12/2025
Big new blogpost! My guide to data visualization, which includes a very long table of contents, tons of charts, and more. --> Why data visualization matters and how to make charts more effective, clear, transparent, and sometimes, beautiful. www.scientificdiscovery.dev/p/salonis-gu...
screenshot of my post
28805313
Reposted by Dylan Burton
Prof. Nicole Holliday @mixedlinguist.bsky.social · 03/12/2025
Do you know Zoom & other companies are encouraging discrimination against employees for things like "pausing too long" or not sounding sufficiently "charismatic"? Read all about our dystopian present in my new paper, out today in JASA! (Seriously, read it. It's important) doi.org/10.1121/10.0...
doi.org
Socially prescriptive speech technologies: Linguistic, technical, and ethical issues
Speech technology tools can be powerful and transformative for individuals, businesses, and governments. Socially prescriptive speech technology (SPST) systems
419672
Dylan Burton @dylanburton.bsky.social · 11/11/2025
How do untrained listeners report using nonverbal behavior in their perceptions and judgements of L2 ability? I explore this topic and more in my latest article just out in The Modern Language Journal. Read more here: onlinelibrary.wiley.com/doi/10.1111/...
onlinelibrary.wiley.com
<em>The Modern Language Journal</em> | NFMLTA Journal | Wiley Online Library
This study investigated linguistic laypersons’ use of nonverbal behavior when formulating judgments of second language (L2) ability. Eighty-three first language (L1) English-speaking participants wat...
030
Reposted by Dylan Burton
Talia Isaacs @taliaisaacs.bsky.social · 28/10/2025
Congrats to guest editors Eunice Jang, Yasuyo Sawski & all authors on this blockbuster issue of #LanguageTesting on the AI revolution! It’s a hefty issue with 7 articles, an opening Editorial & an insightful post-script by @lukeharding.bsky.social. Now out here: journals.sagepub.com/toc/LTJ/curr...
journals.sagepub.com
Language Testing - Volume 42, Number 4
Table of contents for Language Testing, 42, 4
052
Reposted by Dylan Burton
Dan Isbell @danielrisbell.bsky.social · 17/10/2025
We recruited a large number of layperson listeners to complete transcriptions (one utterance at a time) and comprehensibility ratings of archived Aptis responses and compared those listener-based measures to official scores. Methodologically this is one of my favorite projects!
001
Reposted by Dylan Burton
Dan Isbell @danielrisbell.bsky.social · 17/10/2025
Our new study on intelligibility and comprehensibility in the @britishcouncil.bsky.social Aptis General exam is out now in SiLA. Intelligibility distinguishes A1/above A1, but it's generally comprehensibility that is associated with higher levels of performance. www.altaanz.org/7_sila_14_1_...
altaanz.org
7._sila_14_1__Isbell et al.
Intelligibility and comprehensibility across Aptis Speaking tasks
121
Reposted by Dylan Burton
Prof. Nicole Holliday @mixedlinguist.bsky.social · 17/10/2025
Sycophantic LLMs rob us of the chance to practice what makes us human: thought, revision, interaction, introspection. I’m much more worried about everyone losing those skills than I am about a Terminator-style end of the world.
28028
Reposted by Dylan Burton
Kristina Šekrst @epiphenomenal.bsky.social · 11/10/2025
Accurate. #academia #academy #philsky #philosophysky #philosophy #science
439986
Reposted by Dylan Burton
Pauliina Peltonen @pauliinapeltonen.com · 08/10/2025
Happy to announce that our article (w/ Sandra Götz & @pekkalintunen.bsky.social) exploring L1 & L2 speech #fluency in monologue + dialogue is now out in SSLA (OA)! Part of the recently completed #FDF2 project (funded by the Research Council of Finland). #FlowLangGroup @utu.fi doi.org/10.1017/S027...
doi.org
The Impact of L1 Speaking Style, Task Mode, and L2 Proficiency on L2 Fluency: A Within-subject Study of Monologic and Dialogic Speech | Studies in Second Language Acquisition | Cambridge Core
The Impact of L1 Speaking Style, Task Mode, and L2 Proficiency on L2 Fluency: A Within-subject Study of Monologic and Dialogic Speech
1122
Reposted by Dylan Burton
Garrick Aden-Buie @grrrck.xyz · 11/09/2025
ggplot2 4.0.0 is out and the new `paper`, `ink`, `accent` theme variables look super cool! Just pick 2-3 colors 🎨 to make your plots look great! I'm excited to hook this up to brand.yml 😉
A ggplot2 plot showing a classic `mpg` scatter plot. The code uses `theme_gray()` with `paper = "cornstalk"` for a light yellow background, `ink = "navy"` for navy blue text and points, and `accent = "tomato"` which is applied to the smoothing line created with `geom_smooth()`
17118
Reposted by Dylan Burton
Julia M. Rohrer @dingdingpeng.the100.ci · 25/08/2025
Ever stared at a table of regression coefficients & wondered what you're doing with your life? Very excited to share this gentle introduction to another way of making sense of statistical models (w @vincentab.bsky.social) Preprint: doi.org/10.31234/osf... Website: j-rohrer.github.io/marginal-psy...
Models as Prediction Machines: How to Convert Confusing Coefficients into Clear Quantities

Abstract
Psychological researchers usually make sense of regression models by interpreting coefficient estimates directly. This works well enough for simple linear models, but is more challenging for more complex models with, for example, categorical variables, interactions, non-linearities, and hierarchical structures. Here, we introduce an alternative approach to making sense of statistical models. The central idea is to abstract away from the mechanics of estimation, and to treat models as “counterfactual prediction machines,” which are subsequently queried to estimate quantities and conduct tests that matter substantively. This workflow is model-agnostic; it can be applied in a consistent fashion to draw causal or descriptive inference from a wide range of models. We illustrate how to implement this workflow with the marginaleffects package, which supports over 100 different classes of models in R and Python, and present two worked examples. These examples show how the workflow can be applied across designs (e.g., observational study, randomized experiment) to answer different research questions (e.g., associations, causal effects, effect heterogeneity) while facing various challenges (e.g., controlling for confounders in a flexible manner, modelling ordinal outcomes, and interpreting non-linear models).
Figure illustrating model predictions. On the X-axis the predictor, annual gross income in Euro. On the Y-axis the outcome, predicted life satisfaction. A solid line marks the curve of predictions on which individual data points are marked as model-implied outcomes at incomes of interest. Comparing two such predictions gives us a comparison. We can also fit a tangent to the line of predictions, which illustrates the slope at any given point of the curve.A figure illustrating various ways to include age as a predictor in a model. On the x-axis age (predictor), on the y-axis the outcome (model-implied importance of friends, including confidence intervals).

Illustrated are 
1. age as a categorical predictor, resultings in the predictions bouncing around a lot with wide confidence intervals
2. age as a linear predictor, which forces a straight line through the data points that has a very tight confidence band and
3. age splines, which lies somewhere in between as it smoothly follows the data but has more uncertainty than the straight line.
461001285
Reposted by Dylan Burton
Cambridge University Press - Linguistics @cambup-linguistics.cambridge.org · 22/08/2025
New issue of Studies in Second Language Acquisition now available 📚 cup.org/47eF6ql #SSLA #appliedlinguistics #LangSky
cover of the journal Studies in Second Language Acquisition
032
Reposted by Dylan Burton
Jessi Grieser @jessgrieser.com · 21/08/2025
While I'm dispensing computer advice, to any new graduate students: Save all your article PDFs using the same template. I like LASTNAME YEAR SHORT TITLE/DESCRIPTION, like Labov 1963 Marthas Vineyard Save them all in just one giant folder, not piecemeal by class. Thank me when you're tenured.
1211
Reposted by Dylan Burton
Ryan Bowles @ryanpbowles.bsky.social · 21/08/2025
The new Cracker Barrel logo is the visual version of a 50 year old saying skibidi.
011
Reposted by Dylan Burton
Vincent Arel-Bundock @vincentab.bsky.social · 19/08/2025
{tinytable} 0.13.0 for #RStats can now draw interactive tables with sorting, filtering & pages! And the 📦 is still an ultra-simple, powerful, and 0-dep way to create beautiful tables in basically any format: tex, typ, docx, pdf, png, md, etc Gallery & Docs: vincentarelbundock.github.io/tinytable/
614338
Reposted by Dylan Burton
Darren Dahly @statsepi.bsky.social · 11/08/2025
Papers often conclude "more research is needed" without explanation. This is a missed opportunity. You are the expert. This is your time to shine. Explain what the remaining uncertainties are, and give justified recommendations on what the research needed to resolve them should look like.
1315830
Reposted by Dylan Burton
Julia M. Rohrer @dingdingpeng.the100.ci · 07/08/2025
I've said it before, and I will say it again: It's astonishing how emotionally aversive revisions are, even in the best possible case (reviewers are positive and have very actionable remarks). Or at least that's how I work; if anybody has some good recommendations for coping, do let me know 😂
1411110
Reposted by Dylan Burton
Prof. Nicole Holliday @mixedlinguist.bsky.social · 07/08/2025
I shouldn't wade into this discourse, but LANGUAGE CHANGES and old people always hate what kids are doing. This is fine, especially if the author intends it to be euphemistic. Language policing always ends in systematic discrimination against marginalized people. We don't want to go down this road!
710518
Reposted by Dylan Burton
Language Testing @langtestjournal.bsky.social · 05/08/2025
Now available in OnlineFirst, Shungo Suzuki and colleagues propose a new approach to weakness identification for L2 speaking skills in diagnostic language assessment (DLA), with an AI-driven DLA program that uses contextualized diagnostic feedback to improve lexical use. doi.org/10.1177/0265...
011
Reposted by Dylan Burton
Julia M. Rohrer @dingdingpeng.the100.ci · 16/07/2025
At this point, I might as well -- Here's an infographic showing different ways to include age as a predictor. The top shows two extremes, just as a plain old numerical predictor (imposes linear trajectory) vs. categorical predictor (imposes nothing whatsoever). And then three solutions in between!
Infographic illustrating different ways to model age.
First panel shows two "extreme" cases; including age as a linear numerical predictor (df = 1) or including age as a categorical predictor (df = number of years of age minus 1).
Second panel shows an intermediate solution in which age is categorized into broader bins (df = number of categories minus 1, here 5 - 1 = 4).
Third panel shows an intermediate solution in which age is included with a polynomial (df = degrees of freedom of the polynomial, here 4).
Fourth panel shows an intermediate solution in which age is modeled with the help of splines (df = degrees of freedom of the splines, here 4).
2221147
Reposted by Dylan Burton
Language Testing @langtestjournal.bsky.social · 08/07/2025
Call for Special Issue abstracts is now open! The Language Testing Special Issue theme of 2027 is “Language Assessment and Policy”. Abstract submission deadline: October 1, 2025. journals.sagepub.com/page/ltj/spe...
023
Reposted by Dylan Burton
Dan Isbell @danielrisbell.bsky.social · 09/07/2025
Our study of English proficiency tests in US R1 university admissions circa late 2023 has been published in #LanguageTesting. Some highlights: - TOEFL, IELTS, DET, PTE are most widely used - Most institutions accept around 5 different tests - Some mismatches in cut scores across tests ...
journals.sagepub.com
A survey of English language proficiency tests in international student admissions at US research-intensive universities - Nicholas Coney, Daniel R. Isbell, 2025
Over one million international students are enrolled in US higher education institutions. To be admitted into one of these degree-granting institutions, interna...
151
Reposted by Dylan Burton
Julia M. Rohrer @dingdingpeng.the100.ci · 08/07/2025
Let's say you want to include age as a predictor in your model. How do you do that? Here's an illustration of three options -- it's for a paper I'm working on (so if you feel like anything could be tweaked...).
Plot that depicts the average importance people in my data assign to their friendships (y-axis, on a scale from 1 to 5, depicted with 95% confidence intervals) by their age (x-axis, from 18 to 60).

Depicted are 3 different ways to model importance of friends as a function of age.
Using age as a linear predictor: this imposes a linear trajectory which comes with very tight confidence intervals (i.e., uncertainty is low).
Using age as a categorical predictor: this imposes no trajectory whatsoever but instead simply reproduces the means by age. The confidence intervals are very wide, in particular for those ages not well represented in the data (i.e., uncertainty is high).
Age splines: This results in a smooth trajectory that follows some of the bumps in the data, but not all of them. The confidence intervals are somewhere between the linear and the categorical case (i.e., uncertainty is medium)
3215629
Reposted by Dylan Burton
Language Testing @langtestjournal.bsky.social · 01/07/2025
Now available in Online First, Michael Suhan and Mikyung Kim Wolf compare the performance of GPT-4, human ratings, and an existing automated writing evaluation model in scoring the writing responses of young EFL learners on the TOEFL Junior Writing rest. journals.sagepub.com/doi/10.1177/...
032
Reposted by Dylan Burton
Julia M. Rohrer @dingdingpeng.the100.ci · 30/05/2025
Kowall et al. published a multi-analyst epi study on the effect of marital status on cardiovascular disease (link.springer.com/article/10.1...). What can be learned from this effort? Check out our new commentary! link.springer.com/article/10.1... with @mendelrandom.bsky.social & Marcus Munafò
What can be learned when multiple analysts arrive at different estimates

Kowall et al. (2025) have brought the multi-analyst approach to epidemiology, with instructive results. With this approach, multiple researchers analyze the same data set to answer the same research question. Or, at least, what appears to be the same research question. In fact, the very first paper that popularized this approach [1] has been criticized for using a vague research question (“Are soccer referees more likely to give red cards to players with dark skin tone than light skin tone?”), which apparently led the analysts to try to answer quite different questions—from a simple question about a bivariate statistical association to much more complex causal questions about racial bias [2].

In contrast, the research question passed on to analysts in Kowall et al. (2025) seems less ambiguous: Does marital status influence the incidence of cardiovascular disease? But less ambiguous does not equal unambiguous. Considerable...
59931
Dylan Burton @dylanburton.bsky.social · 26/05/2025
Waking up in Salzburg ready for the kickoff of #EALTA2025! Karen Dunn and I are starting our workshop today on modeling clustered and repeated language assessment data in R.
060
Reposted by Dylan Burton
Dan Isbell @danielrisbell.bsky.social · 19/05/2025
Luke Plonsky has put together a directory of Applied Linguistics graduate programs in the US (in progress! get in touch if you have any others to add) over at Applied Linguistics Press. Great resource for prospective grad students and those interested in taking stock of the field.
appliedlinguisticspress.org
Grad Programs
This page serves as a directory of graduate-level programs in applied linguistics. Its main purpose is to help prospective students find PhD/EdD programs that might match their scholarly interests as ...
072
Reposted by Dylan Burton
Julia M. Rohrer @dingdingpeng.the100.ci · 11/05/2025
Thanks to everybody who chimed in! I arrived at the conclusion that (1) there's a lot of interesting stuff about interactions and (2) the figure I was looking for does not exist. So, I made it myself! Here's a simple illustration of how to control for confounding in interactions:>
651124273
Reposted by Dylan Burton
Betsy Sneller @betsysneller.bsky.social · 28/04/2025
✨ ATTN Education and Sociolinguistics friends! ✨ I'm hiring a postdoc, to work with the MI Diaries Project! This position is renewable for up to 3 years total. Please share widely! careers.msu.edu/jobs/researc...
careers.msu.edu
Research Associate-Fixed Term - East Lansing, Michigan, United States
Working/Functional Title Linguistics; Postdoctoral Research Associate Position Summary The successful applicant will join the MI Diaries project, which is collecting sociolinguistic data from Michigan...
12220
Reposted by Dylan Burton
Dylan Burton @dylanburton.bsky.social · 14/04/2025
The deadline for ECOLT proposals has been extended to April 27th! We look forward to seeing you at Georgetown University in September.
011
Dylan Burton @dylanburton.bsky.social · 14/04/2025
The deadline for ECOLT proposals has been extended to April 27th! We look forward to seeing you at Georgetown University in September.
011
Dylan Burton @dylanburton.bsky.social · 01/04/2025
Remember to submit your proposals for the East Coast Organization of Language Testers conference, which will be held at Georgetown University on September 26, 2025! The deadline is April 20th. sites.google.com/view/ecolt/e...
sites.google.com
ECOLT - Call for Proposals
The ECOLT 2025 Call for Proposals is now open Submit here today!
000
Dylan Burton @dylanburton.bsky.social · 29/03/2025
Join Karen Dunn and me for a pre-conference workshop at EALTA (in beautiful Salzburg!) where we will discuss linear mixed-models and generalized linear mixed models for the analysis of language testing data. ealta-annual-conference.org/registration/
ealta-annual-conference.org
Registration - EALTA Annual Conference
141
Reposted by Dylan Burton
Julia M. Rohrer @dingdingpeng.the100.ci · 25/03/2025
I asked DeepSeek to develop a scale to measure addiction to addiction scale development and of course it delivered.
1816747
Reposted by Dylan Burton
Prof. Nicole Holliday @mixedlinguist.bsky.social · 13/03/2025
My ongoing research shows AI programs that claim to evaluate speech during a meeting do so in ways that are (1) not rooted in any real data about how humans talk to each other and (2) discriminatory against people not represented in training data! I'm glad journalists are now reporting on these!
16722
Reposted by Dylan Burton
Charlene Polio @charlenep.bsky.social · 13/03/2025
We are looking are a remote ASL instructor this summer. Please share with any networks that you may have. careers.msu.edu/jobs/ast-ins...
careers.msu.edu
Ast Inst/Inst/Ast Prof - Fixed Term - East Lansing, Michigan, United States
Working/Functional Title ASL Ast Inst/Inst/Ast Prof - Fixed Term Position Summary The Department of Linguistics, Languages, and Cultures at Michigan State University seeks one part-time Fixed-Term Ame...
001
Reposted by Dylan Burton
Pauliina Peltonen @pauliinapeltonen.com · 28/02/2025
The 2nd article of our forthcoming special issue on #fluency for IRAL (eds Peltonen & Wright) is now available ahead of print! A highly welcome addition to the growing body of research on affective factors and fluency by Magdalena Szyszka & @pekkalintunen.bsky.social, based on #FDF2 project data.
031