Sign in

Toby Penner

@tobypenner.com
43 followers 301 following 7 posts

CS at Middlebury, ML for self-driving at comma.ai this summer. Recently, I've taught robots to play tag and visualized all of Wikipedia. tobypenner.com

PostsRepliesMedia
Toby Penner @tobypenner.com · 02/06/2026
Happy to answer any questions and please give suggestions on UI improvements!
050
Toby Penner @tobypenner.com · 02/06/2026
Everything is hosted on Cloudflare. Tiles are stored on R2 with a worker in front for caching. Search and shortest-path finding are served through that same worker and backed by Cloudflare Containers. @cloudflare.social @cloudflare-dev.bsky.social
140
Toby Penner @tobypenner.com · 02/06/2026
Search and shortest-path finding are driven from a Rust axum backend. Search uses Tantivy over articles' titles and their redirects + PageRank. Shortest-path finding is a bidirectional BFS. @fulmicoton.bsky.social @carllerche.com
130
Toby Penner @tobypenner.com · 02/06/2026
The frontend is React + deck.gl. Many web mapping libraries are built so specifically for the Earth and Web Mercator that it's difficult to use them for (simpler) visualizations like this. deck.gl handles cartesian coordinates natively and was really nice to use here. @openjsf.org
deck.gl
Home | deck.gl
deck.gl
130
Toby Penner @tobypenner.com · 02/06/2026
I rendered 12 zoom levels of 1024 pixel square raster tiles using Skia and matching JSON metadata tiles with page names, statistics, links, etc. Tiles were packed into the awesome PMTiles format. @protomaps.com @bdon.org
130
Toby Penner @tobypenner.com · 02/06/2026
I extracted 221 million links from the 24.5 GB compressed May 2026 English Wikipedia dump. On this directed graph, I ran cuGraph's ForceAtlas2, PageRank, and Leiden clustering algorithms to find page nodes' position, size, and color. @wikipedia.org @jameslamb.bsky.social @jacomyma.bsky.social
140
Toby Penner @tobypenner.com · 02/06/2026
Any two of the 7.1 million English Wikipedia pages are only a few clicks apart. I created Wikigraph, an interactive map of all of English Wikipedia. You can explore, search, and find the shortest path between any two articles. tobypenner.com/wikigraph #dataviz #wikipedia #webdev
2176