iiinova — where your digital self keeps evolving

James Gardner @jadgardner.bsky.social · 03/12/2025

We are releasing the benchmark (TAPVid360-10k), code, and models. Come say hi at Poster Session 5 (Fri 11:00-14:00)! 📄 Paper: arxiv.org/pdf/2511.21946 💻 Code: github.com/finlay-hudso... 🤗 Dataset: huggingface.co/datasets/fhu... 🌐 Project Page: finlay-hudson.github.io/tapvid360/

arxiv.org

000

James Gardner @jadgardner.bsky.social · 03/12/2025

@fhudson.bsky.social and I are both at #NeurIPS! Come chat to us about TAPVid-360, how we adapted CoTracker3 to maintain object permanence even when things vanish completely from view, allocentric world models or other neat data gen tricks!

100

James Gardner @jadgardner.bsky.social · 03/12/2025

All 2D point tracking methods break as objects leave their FoV, and dynamic object 3D point tracks are intractable to obtain. In TAPVid-360, we exploit 360 videos for supervision, resampling them into narrow field-of-view videos while computing ground truth point directions across the full panorama.

100

James Gardner @jadgardner.bsky.social · 03/12/2025

This was so much fun to work on! I love finding new sources of supervision and 360 video data has so many applications.

110

James Gardner @jadgardner.bsky.social · 01/04/2025

This is an incredible collaboration between @willsmithvision.bsky.social, @willrowan.bsky.social and myself. The whole YorkVGL team is now switching all our research code over to Neuralatex and seeing massive productivity gains because of it!

070

James Gardner @jadgardner.bsky.social · 01/04/2025

You can check out the source code (and paper!) right now on arxiv: arxiv.org/abs/2503.24187 There is so much work to do! We want this running on GPUs by summer, taping out custom Neuralatex silicon by autumn and starting the run of Neuralatex GPT by the end of the year!

arxiv.org

NeuRaLaTeX: A machine learning library written in pure LaTeX

In this paper, we introduce NeuRaLaTeX, which we believe to be the first deep learning library written entirely in LaTeX. As part of your LaTeX document you can specify the architecture of a neural ne...

160

James Gardner @jadgardner.bsky.social · 01/04/2025

We demonstrate how powerful our library is by training an MLP to 86% accuracy on the spiral dataset with only a moderate 48-hour document compile time!

270

James Gardner @jadgardner.bsky.social · 01/04/2025

And the Source code of the Method in the Source Code of the Paper (SCOMISCOP) metric is the proportion of the source code of a method that is contained within the source code of the paper.

180

James Gardner @jadgardner.bsky.social · 01/04/2025

We get state-of-the-art performance in both of our own brand new metrics! The Written in Latex (WIL) metric is the proportion of the source code of a machine learning library written in LaTeX.

1110

James Gardner @jadgardner.bsky.social · 01/04/2025

Now, as part of your latex document, you can specify the architecture of a neural network, generate or load training data and define hyperparameters and loss functions. When the document is compiled, the latex compiler will train the network, run experiments and create figures.

140

James Gardner @jadgardner.bsky.social · 01/04/2025

This is a fully functional scalar-based auto-grad library, similar to Andrej Karpathy's micrograd but in pure Latex! Simply import our engine.tex and nn.tex files and start training models straight away!

170

James Gardner @jadgardner.bsky.social · 01/04/2025

Are you tired of context-switching between coding models in @pytorch.org and paper writing on @overleaf.com? Well, I’ve got the fix for you, Neuralatex! An ML library written in pure Latex! neuralatex.com To appear in Sigbovik (subject to rigorous review process)

neuralatex.com

Neuralatex: A machine learning library written in pure LATEX

28318

Reposted by James Gardner

Will Smith @willsmithvision.bsky.social · 20/11/2024

As we approach the one year anniversary of a T-PAMI submission still waiting for first reviews, I imagine "With Associate Editor" to mean they sit in a lotus position atop a Himalayan peak, our paper and the reviews in their hand as they meditate (indefinitely) on what recommendation to make.

3192