Sign in

Dewey Dunnington

@paleolimbot.bsky.social
268 followers 97 following 98 posts

Scaling spatial computing at Wherobots, Inc. ApacheArrow PMC, #gischat, #rstats, ex Voltron Data.

PostsRepliesMedia
Reposted by Dewey Dunnington
Joris Van den Bossche @jorisvandenbossche.bsky.social · 16h
New #Shapely 2.2.0 feature release! 🎉 Shapely is a Python package to work with geometry objects (wrapping GEOS). The new release comes with Python 3.15 support, performance improvements, and several new functions -> shapely.readthedocs.io/en/stable/re... #python #geopython #geospatial
shapely.readthedocs.io
042
Reposted by Dewey Dunnington
Linda Stevens @lindastevens.bsky.social · 06/10/2026
Cloud Native Geo folks!!! Check out the great talks happening at FOSS4G NA! #CNG #GISchat #EO
032
Reposted by Dewey Dunnington
Yutani @yutannihilation-en.bsky.social · 27/08/2026
FOSS4G Hiroshima 2026 is only a few days away! I'll talk about SedonaDB. 📅 Sep 1st, 14:00–14:30 🚪 Room4 talks.osgeo.org/foss4g-2026/...
083
Dewey Dunnington @paleolimbot.bsky.social · 01/10/2026
Manitoba is now a recent addition to the timezone database! Looking forward to seeing how many incorrect times computers give us in the next month or so (I am guessing many tzdbs aren't updated at a month's notice!) www.iana.org/time-zones/r...
iana.org
Time Zone Database Release 2026e
140
Dewey Dunnington @paleolimbot.bsky.social · 30/09/2026
Excited to be talking SedonaDB at Cloud-Native Geospatial Forum (CNG) forum next week, and even more excited to connect with the spatial community in person for the first time in a while. If you're attending let me know and make sure we connect!
041
Reposted by Dewey Dunnington
Josiah @josiah.rs · 24/09/2026
I cannot emphasize enough how excited I am about {geoarrowwidget} and {deckglgeoarrow}. 3.2 **million** points in 4 seconds. #rspatial #rstats
4519
Dewey Dunnington @paleolimbot.bsky.social · 22/09/2026
Excited to be teaching again! Sign up for the Monday SedonaDB workshop to mostly learn about how query engines/databases can make large(r) data in Python less awkward!
0115
Reposted by Dewey Dunnington
Kyle Barron @kylebarron.dev · 22/09/2026
Published deck.gl-raster v0.8! - Initial globe view support - New icechunk example - Improved request latency for MosaicLayer - Fixed reprojection for images extending beyond ±85° latitude - Improved rendering precision at high zooms - Improved performance developmentseed.org/deck.gl-rast...
093
Dewey Dunnington @paleolimbot.bsky.social · 17/09/2026
Whoops, GB. Feels like MB some days though!
120
Dewey Dunnington @paleolimbot.bsky.social · 17/09/2026
+1000. I have like four datafusion-based projects and a 256 MB disk and this is constantly an issue.
120
Dewey Dunnington @paleolimbot.bsky.social · 14/09/2026
Yep! (Like PostGIS, BigQuery, Snowflake, Redshift, and soon Databricks if they don't do that already).
120
Dewey Dunnington @paleolimbot.bsky.social · 13/09/2026
SedonaDB! (But also: ibis, duckdb, polars, datafusion, narwhals all have great features).
121
Dewey Dunnington @paleolimbot.bsky.social · 12/09/2026
Yeah the documentation for Geography is not great, but we have ~big query capability. ST_ToGeography is the way to start, and any functions that list a Geography overload (e.g., ST_DWithin).
120
Dewey Dunnington @paleolimbot.bsky.social · 12/09/2026
Cool! Asking for a friend...how does our geodesic mode (geography join) compare!?
110
Reposted by Dewey Dunnington
Josiah @josiah.rs · 12/09/2026
It looks like {geoarrowrs} is even competitive with {sedonadb}?! Do we got a new fast spatial contender! #rstats josiahparry.github.io/geoarrowrs/a...
Graph of bench marks for geoarrow-rs vs duckspatial and sedonda-db
2231
Reposted by Dewey Dunnington
Yutani @yutannihilation-en.bsky.social · 01/09/2026
Today, I talked about 🐘🪿⛰️, or more precisely, about PostGIS, DuckDB and Apache SedonaDB at FOSS4G Hiroshima 2026. Here's my slides. Guess which one I chose to recommend after this roulette?? 🎰 SedonaDB: Why Yet Another Geospatial Database Engine? github.com/yutannihilat...
082
Dewey Dunnington @paleolimbot.bsky.social · 30/06/2026
Definitely. My oldest daughter's first word was "duck" (followed by "fire hydrant" several months later 🤷)
110
Dewey Dunnington @paleolimbot.bsky.social · 26/06/2026
All of these formats are internally lists of tiles...why not meet them where they're at! (At least, that's the theory!)
101
Dewey Dunnington @paleolimbot.bsky.social · 25/06/2026
For the full story, check out our release post! sedona.apache.org/latest/blog/...
sedona.apache.org
SedonaDB 0.4.0 Release - Apache Sedona
Apache Sedona is a cluster computing system for processing large-scale spatial data. Sedona extends existing cluster computing systems, such as Apache Spark, Apache Flink, and Snowflake, with a set of...
063
Dewey Dunnington @paleolimbot.bsky.social · 25/06/2026
Finally, we've laid a foundation for raster, Zarr, and ND-array functionality primarily by GDAL! SedonaDB 0.4.0 includes basic metadata and load operations, and we're exited to build on this with the community for our next release.
232
Dewey Dunnington @paleolimbot.bsky.social · 25/06/2026
This release features an accelerated join by Liang Geng, productionizing his research using RT cores on GPUs to accelerate spatial joins. Compute-intensive joins can be many times faster when SedonaDB is built with this feature enabled!
111
Dewey Dunnington @paleolimbot.bsky.social · 25/06/2026
While we had some intial support from our first release, in 0.4.0 we rewrote the geography implementation to ensure full support, including Parquet pruning, and spatial joins. Buffers, dwithin joins, and interpolation of points along the shortest geographical path should now be easy and performant!
111
Dewey Dunnington @paleolimbot.bsky.social · 25/06/2026
...and, of course, we didn't leave out #rstats. The 0.4.0 release features the sdplyr R package, which provides a dplyr interface covering the basic subset of transformations (including spatial joins!). Like Python, our ST_ and RS_ functions have inline docs via the generated sedonafns package.
1123
Dewey Dunnington @paleolimbot.bsky.social · 25/06/2026
After writing the last releast post, I mentioned to my colleagues that it would be the last one where I show off the amazing capabilities of our engine with clunky SQL. I'm proud to share that we made this happen! You can now .select, .filter, .group_by, .agg, and .sort your Python DataFrames!
111
Dewey Dunnington @paleolimbot.bsky.social · 25/06/2026
...or maybe not that hard, since you'll have to install it to get going. We're excited to have a contributed conda-forge package to make it easier for conda users to integrate SedonaDB into their workflows.
111
Dewey Dunnington @paleolimbot.bsky.social · 25/06/2026
We're excited to announce a new release of SedonaDB, and this one is a big one! Between native DataFrame APIs in Python and R, a brand new Geography implementation, GPU accelerated joins, and a raster/ND-array foundation, it's hard to know where to start.
12711
Reposted by Dewey Dunnington
Thomas Lin Pedersen @thomasp85.com · 23/06/2026
Do you love maps? Of course you do! With the latest release of #ggsql we now support spatial plotting directly from your database. As a cherry on top, the release also provides powerful in-layer aggregation. Read all about it on the blog
opensource.posit.co
ggsql 0.4.1: Spatial plotting and in-layer aggregation
ggsql 0.4.1 adds support for spatial plotting and data aggregation within layers. Read all about the new features in this release post.
08122
Reposted by Dewey Dunnington
Hadley Wickham @hadley.nz · 17/06/2026
dbplyr 2.6.0 is here! This release leaned on Claude Code to clear a TON of smaller issues, freeing up time for the big stuff: brand-new ADBC and JDBC backends, new translations, and a new sql_dialect() to cleanly decouple connection from SQL dialect. Read more: opensource.posit.co/blog/2026-06...
opensource.posit.co
dbplyr 2.6.0
dbplyr 2.6.0 is now on CRAN, with new ADBC and JDBC backends, IBM DB2 support, more translations, and a bunch of minor fixes and improvements.
05918
Dewey Dunnington @paleolimbot.bsky.social · 15/06/2026
Still quite a few holes, but apache.r-universe.dev/sdplyr is in the works!
apache.r-universe.dev
sdplyr: Apache SedonaDB 'dplyr' Interface
Provides a 'dplyr' backend implemented using 'SedonaDB'.
042
Reposted by Dewey Dunnington
Mara Averick @dataandme.bsky.social · 08/06/2026
I'm alive *AND* I wrote a blog post?! Unheard of! Much 💖 to @abbycabs.dev, and @grafana.bsky.social's David Allen and Amanda Wagner whose FOSDEM talk's were a huge source of inspo!
87210
Dewey Dunnington @paleolimbot.bsky.social · 03/06/2026
I cancelled my travel there...the website is down and others seem to have also cancelled based on this thread www.reddit.com/r/gis/commen...
reddit.com
From the gis community on Reddit
Explore this post and more from the gis community
100
Reposted by Dewey Dunnington
Columnar @columnar.tech · 02/06/2026
📣 Introducing databow: one command-line tool to query them all, built with Rust and ADBC. Query any SQL source that has an ADBC driver (30+ and counting) right from your terminal with one simple CLI. To install 👉 uv tool install databow More details at columnar.tech/blog/databow-cli
columnar.tech
Introducing databow
One command-line tool to query them all, built with Rust and ADBC
283
Reposted by Dewey Dunnington
Jakub Nowosad @nowosad.fosstodon.org.ap.brid.gy · 29/05/2026
⏰️ Reminder: submission deadline for the Spatial Data Science Award is soon (May 31). If you’re planning to nominate people contributing to geospatial open science, OSS development, and community building, now is the time to submit […] [Original post on fosstodon.org]
013
Dewey Dunnington @paleolimbot.bsky.social · 20/05/2026
apache.r-universe.dev/sedonadb exposes much of DataFusion (function registration via FFI is in there somewhere too). I haven't quite gotten executing R code from within DataFusion functions wired up but it's theoretically possible!
apache.r-universe.dev
sedonadb: Bindings for Apache SedonaDB
Provides bindings for Apache SedonaDB, a lightweight query engine optimized for spatial workflows.
010
Dewey Dunnington @paleolimbot.bsky.social · 29/04/2026
If any of you all will be at GeoPython this year I'll be there too!
100
Reposted by Dewey Dunnington
Jakub Nowosad @nowosad.fosstodon.org.ap.brid.gy · 29/04/2026
Looking for geospatial conferences in 2026? Here’s a growing community-maintained list: github.com/Nowosad/conferences_2026 🗺️ Add missing events via PR. #gischat #GIS #geocomputation
274
Reposted by Dewey Dunnington
Lawrence Vulis @lvulis.bsky.social · 24/04/2026
Modern geospatial SQL means you can skip the parallelization etc that we try to do to actually get these types of runs to complete.
032
Dewey Dunnington @paleolimbot.bsky.social · 24/04/2026
In 2024 I spent days trying to optimize a point-in-polygon join with ~130 million points against all U.S. zipcodes and the best I could come up with was a few minutes. In 2026, both SedonaDB and @duckdb.org spatial can both do it in seconds 🤯. More in the post! dewey.dunnington.ca/post/2026/wr...
1236
Dewey Dunnington @paleolimbot.bsky.social · 17/04/2026
I haven't had issues in SedonaDB with savvy doing excessive rebuilds but I have no idea what the difference is (perhaps a less aggressive clean stragety?)
110
Reposted by Dewey Dunnington
Posit @posit.co · 08/04/2026
We are thrilled to announce that Positron Server is now available for academic use via JupyterHub! This gives students a robust #RStats & #Python data science IDE without needing a local install or new infrastructure. Learn more: positron.posit.co/blog/posts/2...
Positron plus JupyterHub logo, with the Posit logo in the corner.
25623
Dewey Dunnington @paleolimbot.bsky.social · 07/04/2026
Pretty sure you have to wrap it and duplicate the methods you want exposed (struct Wrapper { inner: Original }) but it's been a while!
110
Dewey Dunnington @paleolimbot.bsky.social · 01/04/2026
That would be ST_2️⃣() (the PR has a full list 😀)
010
Reposted by Dewey Dunnington
Columnar @columnar.tech · 01/04/2026
We heard you: ADBC is great, but you need it on mainframes. Introducing ADBC for COBOL. The same connectors that work with Python, Rust, and Go now work with a language originally designed for punch cards. columnar.tech/blog/adbc-co...
columnar.tech
We built an ADBC interface for COBOL
Modern database connectivity meets 1959. It fits better than it should.
274
Dewey Dunnington @paleolimbot.bsky.social · 01/04/2026
Full implementation for community feedback: github.com/apache/sedon...
github.com
feat(rust/sedona-functions): Add emoji shorthand for common ST_ functions by paleolimbot · Pull Request #748 · apache/sedona-db
As part of our ongoing attempt to innovate on spatial SQL, this PR adds emoji shorthand for most functions which (1) improve expressiveness, (2) helps more SQL fit on one line and (3) reduces the n...
020
Dewey Dunnington @paleolimbot.bsky.social · 01/04/2026
Can your current spatial SQL engine ST_💩()? We didn't think so! As part of our ongoing attempt to innovate on spatial SQL in Apache Sedona, this we're proposing emoji shorthands for most functions which (1) improve expressiveness and (2) helps more SQL fit on one line.
251
Reposted by Dewey Dunnington
Max kuhn @topepo.bsky.social · 21/03/2026
Our list of 2026 #rstats and #python summer internships has been posted. We can't wait to work with you and make great things! tidyverse.org/blog/2026/03...
tidyverse.org
2026 Posit Internships
Posit is sponsoring four summer internship positions in 2026.
12618
Reposted by Dewey Dunnington
Hadley Wickham @hadley.nz · 20/03/2026
We have summer internships y'all! Come work at Posit on the PyData, tidymodels, shiny, or Connect teams: grnh.se/tigz810a3us. You will have an awesome time, learn a ton, and help advance our open source and pro tools 🧰 #rstats #pydata
Kermit the frog screaming with excitement
27245
Reposted by Dewey Dunnington
Kyle Walker @kylewalker.bsky.social · 18/03/2026
I tend to be a CRAN-appreciator. But wow, R-Universe is such a useful project. As a developer, I can: - Experiment with new and creative approaches that would never get accepted on CRAN; - Have cross-platform binaries for my packages built within an hour (usually) of a GitHub push
3345
Reposted by Dewey Dunnington
Columnar @columnar.tech · 15/03/2026
The fastest operation is the one you don’t have to do. When a database natively supports @arrow.apache.org, ADBC can speed up fetching and ingestion by eliminating costly row/column conversions. How much faster is it in practice? We ran some benchmarks to find out. Link below 👇
An abstract hyperspace warp image inspired by the comedic "going plaid" effect from the 1980s cult film "Spaceballs".
172
Reposted by Dewey Dunnington
Bryce @brycemecum.com · 12/03/2026
Arctos Alliance (arctosalliance.org) is now officially launched! "If your organization depends on Arrow or Parquet or you’re interested in helping sustain these critical data technologies, we would welcome a conversation about how to get involved."
arctosalliance.org
Arctos Alliance - Open Collective
Support the committers powering the world’s open data infrastructure.
042