Reposted by Ben Strober
Happy to share that Flashzoi is now published!
We enhanced Borzoi with RoPE & FlashAttention for >3x faster training/inference & 2.4x reduction in memory usage.
This brings large-scale genomic analysis and fine-tuning within reach of academic budgets.
📄: doi.org/10.1093/bioi...
doi.org
Flashzoi: an enhanced Borzoi for accelerated genomic analysis
AbstractMotivation. Accurately predicting how DNA sequence drives gene regulation and how genetic variants alter gene expression is a central challenge in