Sign in

Charlie Pugh

@cwjpugh.bsky.social
266 followers 1.2K following 12 posts

PhD candidate - Machine Learning and Genomics @CRG.eu with @jonnyfrazer.bsky.social and @MafaldaFigDias

PostsRepliesMedia
Reposted by Charlie Pugh
Ezequiel Galpern @eag91.bsky.social · 25/09/2026
🧬 What do deep-learning models for proteins actually learn? Our new review looks at how model predictions relate to fitness, folding stability and function. With @cwjpugh.bsky.social, Mafalda Dias & @jonnyfrazer.bsky.social 🔗 chemrxiv.org/doi/full/10....
chemrxiv.org
From sequences and structures to fitness, folding and function: challenges in the age of AI | ChemRxiv
Deep-learning models have transformed our ability to predict the phenotypic effects of sequence perturbations. Protein language models (pLMs) score the evolutionary propensity of any amino-acid substi...
177
Charlie Pugh @cwjpugh.bsky.social · 05/08/2026
We show how to improve protein stability prediction by blending complementary deep learning and physics based models. This is really exciting as it allows us to better separate functional from folding constraints on proteins. Check out the thread for more details! 2/2
020
Charlie Pugh @cwjpugh.bsky.social · 05/08/2026
It was great to contribute to this new work from our group led by @eag91.bsky.social 1/2
130
Reposted by Charlie Pugh
Ezequiel Galpern @eag91.bsky.social · 05/08/2026
1/ New preprint! with @solersanchisx.bsky.social @cwjpugh.bsky.social @federicobilleci.bsky.social @jonnyfrazer.bsky.social and Mafalda Dias, we introduce a scalable framework to improve stability prediction and separate folding from functional constraints. www.biorxiv.org/content/10.6...
biorxiv.org
Blending physics-based and inverse folding models to disentangle variant effects on stability and function
Protein sequences are constrained not only by the need to fold into stable structures, but also by specific functional requirements imposed by natural selection. Yet predictions of how amino-acid chan...
1139
Reposted by Charlie Pugh
Centre de Regulació Genòmica (CRG) @crg.eu · 15/06/2026
Mafalda Dias es finalista del premio Vanguardia de la Ciencia. Su línea de investigación está ayudando agilizar el diagnóstico de enfermedades raras, ofreciendo una evidencia adicional para médicos que ya tienen sospechas sobre ciertos genes implicados según los síntomas. ¡Vota ahora!
lavanguardia.com
“Diagnosticamos enfermedades raras analizando millones de años de evolución”
Vota a las finalistas del premio Vanguardia de la Ciencia
075
Reposted by Charlie Pugh
Jonathan Frazer @jonnyfrazer.bsky.social · 23/10/2025
Applications are open for the @crg_eu PhD Programme! 20 fully funded positions — including one in our group through the Evolutionary Medical Genomics ITN. Join us to develop deep generative models of cross-species data to tackle open questions in disease genetics. www.crg.eu/en/content/t...
0119
Charlie Pugh @cwjpugh.bsky.social · 26/05/2025
We also made some improvements with genomic language model, Evo 2, but in this case the interpretation was less clear. See the preprint for more details. Code for using LFB will made available shortly. 10/10
020
Charlie Pugh @cwjpugh.bsky.social · 26/05/2025
This provides evidence that better fitness estimation can be achieved at negligible computational cost by bridging the gap between likelihood and fitness at inference time. 9/n
120
Charlie Pugh @cwjpugh.bsky.social · 26/05/2025
This trend held across DMS assay types and mutational depth, and also on prediction of clinical variants. 8/n
We show a scatterplot of ROC-AUCs for each gene, calculated separating benign and pathogenic labelled variants with either usual or LFB fitness estimation
110
Charlie Pugh @cwjpugh.bsky.social · 26/05/2025
On ProteinGym, LFB provided significant improvements across model classes and sizes and we saw that larger better fit models provided better predictions in general. proteingym.org 7/n
We show a plot of Model Size vs Mean Spearman Correlation across the DMS datasets from ProteinGym for ESM-2 and ProGen2 model families both with and without the LFB estimation.
120
Charlie Pugh @cwjpugh.bsky.social · 26/05/2025
We found under an Ornstein–Uhlenbeck model of evolution that our LFB should be lower variance than the standard estimate by marginalising the effect of drift. 6/n
120
Charlie Pugh @cwjpugh.bsky.social · 26/05/2025
We tried a simple strategy — averaging predictions over sequences under similar selective pressures to effectively reduce the impact of unwanted non-fitness related correlations — likelihood fitness bridging (LFB). 5/n
We show a schematic of the LFB estimate where by averaging over predictions for a variant applied to other related sequences, we produce an score which should be closer to the true change in fitness.
110
Charlie Pugh @cwjpugh.bsky.social · 26/05/2025
We wondered whether we might be able to improve predictions from existing models without any further training. 4/n
110
Charlie Pugh @cwjpugh.bsky.social · 26/05/2025
Weinstein et al show that better fit sequence models can perform worse at fitness estimation due to phylogenetic structure: openreview.net/forum?id=CwG... And in practice we are seeing that pLMs don’t improve with lower perplexities: openreview.net/forum?id=UvP... www.biorxiv.org/content/10.1... 3/n
openreview.net
Non-identifiability and the Blessings of Misspecification in Models...
Misspecification is a blessing, not a curse, when estimating protein fitness from evolutionary sequence data using generative models.
110
Charlie Pugh @cwjpugh.bsky.social · 26/05/2025
Protein language models are showing promise in variant effect prediction - but there’s emerging evidence likelihood based zero shot fitness estimation is breaking down. See this excellent summary from @pascalnotin.bsky.social: pascalnotin.substack.com/p/have-we-hi... 2/n
pascalnotin.substack.com
Have We Hit the Scaling Wall for Protein Language Models?
Beyond Scaling: What Truly Works in Protein Fitness Prediction
150
Charlie Pugh @cwjpugh.bsky.social · 26/05/2025
New preprint in collaboration with @paulinanunezv.bsky.social supervised by @jonnyfrazer.bsky.social and Mafalda Dias – we propose a simple approach to improving zero-shot variant effect prediction in pre-existing protein and genome language models: 🧶 1/n www.biorxiv.org/content/10.1...
biorxiv.org
From Likelihood to Fitness: Improving Variant Effect Prediction in Protein and Genome Language Models
Generative models trained on natural sequences are increasingly used to predict the effects of genetic variation, enabling progress in therapeutic design, disease risk prediction, and synthetic biolog...
17523
Reposted by Charlie Pugh
Isabelle Zane @isabellease.bsky.social · 22/05/2025
@cwjpugh.bsky.social at #VariantEffect25
0198
Reposted by Charlie Pugh
Kevin K. Yang 楊凱筌 @kevinkaichuang.bsky.social · 03/12/2024
Three BioML starter packs now! Pack 1: go.bsky.app/2VWBcCd Pack 2: go.bsky.app/Bw84Hmc Pack 3: go.bsky.app/NAKYUok DM if you want to be included (or nominate people who should be!)
1615258
Reposted by Charlie Pugh
iseultleahy.bsky.social @iseultleahy.bsky.social · 28/11/2024
Thanks Charlie for opening the PhD Symposium! Many thanks to everyone involved in its organisation. #CRGPhDSymp2024
064