With his program, Vipsania, Richard Krieg has shown, that it is possible to do unsupervised deep gene finding with masked language modeling
The trick: use an HMM in the middle of the deep-learning architecture that knows the grammar of gene structures.
preprint: www.biorxiv.org/content/10.6...