Sign in

Yohan

@yohan.so
275 followers 60 following 901 posts

Sharing insights from the intersection of geospatial data science and economics | PhD in Economic Geography from LSE | Data Scientist at ADB. Views are my own. Newsletter: spatialedge.co

PostsRepliesMedia
Yohan @yohan.so · 29/04/2025
Interested in getting a short overview of the latest geospatial papers and datasets each week? Subscribe to the Spatial Edge newsletter: yohan.so
010
Yohan @yohan.so · 29/04/2025
𝘁𝗹;𝗱𝗿 1. nightlights can capture certain elements of consumption and production 2. the level of granularity when using nightlights really matters
110
Yohan @yohan.so · 29/04/2025
𝗧𝗵𝗲 𝗸𝗲𝘆 𝘁𝗮𝗸𝗲𝗮𝘄𝗮𝘆: The more you zoom in, the bigger these spatial mismatches between daytime and nighttime economic activity become.
100
Yohan @yohan.so · 29/04/2025
This underrepresentation occurs even if: • these areas generate a lot more economic activity (e.g. financial districts), compared to • areas bustling with bars and restaurants These nightlife areas tend to be overestimated in nightlights data.
100
Yohan @yohan.so · 29/04/2025
As a result, it's likely that I: • work during the day in one 500m2 pixel and • spend money in a different pixel at night. This implies that pixels with higher daytime economic activity will be systematically underrepresented in nightlights data.
100
Yohan @yohan.so · 29/04/2025
This creates a discrepancy between areas where economic activity is generated during the day (London) vs at night (Essex). With nightlights we can zoom into areas as small as 500m2.
100
Yohan @yohan.so · 29/04/2025
In this example, the economic activity from my job in London doesn't get picked up by nightlights. However, the places where I spend money at night in Essex, like restaurants, do light up and are visible from space.
100
Yohan @yohan.so · 29/04/2025
2. Spatial Mismatches Imagine I work in London but live in Essex, an hour away. My work (i.e. production) contributes to London's economy. But when I spend time in Essex, like eating out at night, that's where my consumption mainly happens.
100
Yohan @yohan.so · 29/04/2025
The bottom line: Nightlights can capture certain elements of consumption AND production. So when doing an analysis using nightlights, we need to know the composition of production and consumption. This is important to avoid double counting.
100
Yohan @yohan.so · 29/04/2025
See this image of the Pilbara region in Australia Here we see: 1. lights generated from mines being lit up at night (i.e. production-based economic activity), AND 2. lights generated by mining staff who are eating out at night (e.g. consumption-based economic activity).
100
Yohan @yohan.so · 29/04/2025
But the reality is a bit more complex. Nightlights can capture some production-related activities. E.g. nighttime construction and nighttime mining.
100
Yohan @yohan.so · 29/04/2025
However, we need to be careful about double counting. E.g. combining production values with income and consumption figures without accounting for overlaps could distort things. Henderson et al., essentially view nightlights as a measure of nighttime consumption:
100
Yohan @yohan.so · 29/04/2025
However, GDP is typically measured in three ways: 1. Adding up all of the consumption in an economy 2. Adding up all of the income earned in an economy 3. Adding up the value of all things produced in an economy For an entire country, these should equal one another.
100
Yohan @yohan.so · 29/04/2025
1. Economic Activity It’s vague to say nightlights capture ‘economic activity’. What 𝙚𝙭𝙖𝙘𝙩𝙡𝙮 do we mean by economic activity? The most popular paper on nightlights and economic activity is Henderson et al. (2012). It uses nightlights as a proxy for real GDP growth.
100
Yohan @yohan.so · 29/04/2025
If you're using nightlights you need to know about two things: 1. What 𝙩𝙮𝙥𝙚 of economic activity it captures, and 2. 𝙎𝙥𝙖𝙩𝙞𝙖𝙡 𝙢𝙞𝙨𝙢𝙖𝙩𝙘𝙝𝙚𝙨 Here's the breakdown (in simple terms):
141
Yohan @yohan.so · 28/04/2025
Interested in getting a short overview of the latest geospatial papers and datasets each week? Subscribe to the Spatial Edge newsletter: yohan.so
000
Yohan @yohan.so · 28/04/2025
So: while AI is clearly going to play a massive role in geospatial analysis going forward, could it actually be overhyped?
100
Yohan @yohan.so · 28/04/2025
𝗪𝗵𝘆 𝘁𝗵𝗶𝘀 𝗮𝗹𝗹 𝗺𝗮𝘁𝘁𝗲𝗿𝘀 At the end of the day, autonomous GIS could make spatial analysis: • More accessible to non-experts. • Faster and more scalable. • Capable of generating new insights. It also forces GIScience to rethink education, ethics, and what it means to “know” geography
100
Yohan @yohan.so · 28/04/2025
• Modeling: Automating complex analysis like disease spread or flood risk still requires human judgment. • Trust and ethics: Who is responsible if a model makes a bad call? How do we ensure fairness?
100
Yohan @yohan.so · 28/04/2025
However, several big hurdles remain: • LLMs lack of GIS-specific knowledge (e.g., projections, spatial joins). • Skills gap: LLMs don’t always know what tools to use or how to handle large files. • Continuous learning: Most models can’t improve themselves after deployment.
100
Yohan @yohan.so · 28/04/2025
• 𝗟𝗟𝗠-𝗖𝗮𝘁: Makes maps iteratively and improves them based on its own visual critique. • 𝗚𝗜𝗦 𝗖𝗼𝗽𝗶𝗹𝗼𝘁: Helps QGIS users do analysis more efficiently.
100
Yohan @yohan.so · 28/04/2025
𝗪𝗵𝗮𝘁 𝗖𝗮𝗻 𝗜𝘁 𝗗𝗼 𝗧𝗼𝗱𝗮𝘆? The authors provide working examples: • 𝗟𝗟𝗠-𝗙𝗶𝗻𝗱: Automatically finds and downloads the right geospatial data. • 𝗟𝗟𝗠-𝗚𝗲𝗼: Runs a complete spatial analysis—e.g., walkability around schools—by creating code and visualizing results.
100
Yohan @yohan.so · 28/04/2025
𝗦𝗰𝗮𝗹𝗲𝘀 𝗼𝗳 𝗢𝗽𝗲𝗿𝗮𝘁𝗶𝗼𝗻 There are three technical scales: 1. Local: Runs on a single machine 2. Centralized: Uses cloud computing to handle larger tasks. 3. Infrastructure-scale: Distributed systems for massive analysis, possibly run by governments or research institutions.
100
Yohan @yohan.so · 28/04/2025
𝗛𝗼𝘄 𝗜𝘀 𝗜𝘁 𝗕𝗲𝗶𝗻𝗴 𝗕𝘂𝗶𝗹𝘁? The core of an autonomous GIS is the “decision core”. This is typically an LLM that: • Reads your question. • Plans a solution. • Finds and cleans the data. • Runs the analysis (e.g., in Python or GIS software). • Presents results (maps, stats, reports).
100
Yohan @yohan.so · 28/04/2025
Most current prototypes are at Level 2. I.e. they can follow instructions, create workflows, and run them, but need help getting the right data or interpreting results.
100
Yohan @yohan.so · 28/04/2025
𝗟𝗲𝘃𝗲𝗹 𝟮: Generates and runs workflows, but still needs human-provided data. 𝗟𝗲𝘃𝗲𝗹 𝟯: Selects and prepares its own data. 𝗟𝗲𝘃𝗲𝗹 𝟰: Understands and refines results without help. 𝗟𝗲𝘃𝗲𝗹 𝟱: Fully independent, learns from experience, and adapts over time.
100
Yohan @yohan.so · 28/04/2025
𝗟𝗲𝘃𝗲𝗹𝘀 𝗼𝗳 𝗔𝘂𝘁𝗼𝗻𝗼𝗺𝘆 Autonomous GIS can be built gradually. The authors define five levels: 𝗟𝗲𝘃𝗲𝗹 𝟬: Everything is manual – traditional GIS. 𝗟𝗲𝘃𝗲𝗹 𝟭: Automates repetitive tasks, but a human sets them up.
100
Yohan @yohan.so · 28/04/2025
𝟯. 𝗦𝗲𝗹𝗳-𝘃𝗲𝗿𝗶𝗳𝘆𝗶𝗻𝗴 – It checks its own work step by step and ensures results are reasonable. 𝟰. 𝗦𝗲𝗹𝗳-𝗼𝗿𝗴𝗮𝗻𝗶𝘇𝗶𝗻𝗴 – It manages time, data, compute power, and even collaborates with other agents. 𝟱. 𝗦𝗲𝗹𝗳-𝗴𝗿𝗼𝘄𝗶𝗻𝗴 – It learns from experience and gets better.
100
Yohan @yohan.so · 28/04/2025
There are 5 goals for autonomous GIS: 𝟭. 𝗦𝗲𝗹𝗳-𝗴𝗲𝗻𝗲𝗿𝗮𝘁𝗶𝗻𝗴 – It creates ideas, workflows, code, and insights on its own. 𝟮. 𝗦𝗲𝗹𝗳-𝗲𝘅𝗲𝗰𝘂𝘁𝗶𝗻𝗴 – It can run the tasks (e.g., calculating distances, drawing maps).
100
Yohan @yohan.so · 28/04/2025
The emergence of LLMs, has made this possible. These models can: • Interpret instructions in natural language. • Generate workflows and code. • Work iteratively to refine outputs. This opens the door to GIS reasons and adapts.
100
Yohan @yohan.so · 28/04/2025
Autonomous GIS is a vision where GIS systems can work like a human analyst. It can: • Understand a geospatial problem described in natural language. • Decide what data and tools are needed. • Carry out the analysis. • Check if the result makes sense. • Learn from its mistakes to improve over time.
100
Yohan @yohan.so · 28/04/2025
A new paper has set out a roadmap towards Autonomous GIS. The breakdown is as follows:
100
Yohan @yohan.so · 28/04/2025
How far off are we from Autonomous GIS? A new paper provides the roadmap. Here's the key info you should know about:
110
Yohan @yohan.so · 25/04/2025
Interested in getting a short overview of the latest geospatial papers and datasets each week? Subscribe to the Spatial Edge newsletter: yohan.so
000
Yohan @yohan.so · 25/04/2025
And that's it. If you know any other traffic and mobility datasets, please drop them below to help out the community.
110
Yohan @yohan.so · 25/04/2025
7. GPS data Finally, you can also purchase raw GPS data from mobile phones. This is available from companies such as: • Huq • Factori • Veraset • Quadrant • Foursquare
100
Yohan @yohan.so · 25/04/2025
6. Here's Traffic Data They provide real-time data on: • traffic flows (i.e. speed and congestion) • incidents (e.g. road closures) This is also a paid dataset. Link: here.com/platform/tra...
110
Yohan @yohan.so · 25/04/2025
5. @mapbox.com 's Traffic Data This covers live data for 30 billion road segments across the world. They also provide 'typical' traffic data. This is also a paid product. Link: mapbox.com/traffic-data
100
Yohan @yohan.so · 25/04/2025
4. TomTom's Traffic Stats This a paid product that provides granular data on traffic. It's available via API or web portal. You can get limited access through the 30-day free trial of the Move platform. Link: tomtom.com/products/tra...
100
Yohan @yohan.so · 25/04/2025
3. Meta's Movement Distribution data This shows shows the range of movement of people away from the area where they live on a daily basis. It's useful for measuring transportation, tourism, and displacement. This data is updated monthly and is available globally. Link: buff.ly/dxmAEPm
100
Yohan @yohan.so · 25/04/2025
2. UTD19 This is the largest open-source traffic dataset. It covers 40 cities (mainly in Europe), but its getting a bit out of date now.
100
Yohan @yohan.so · 25/04/2025
1. Google's Traffic Layer Google's Maps API allows you to access traffic data. Link: developers.google.com/maps/documen...
100
Yohan @yohan.so · 25/04/2025
By far, the data I'm asked most about is related to traffic and mobility. It's for good reason. This data is insanely hard to come by. So I've compiled a comprehensive list of datasets. These cover both paid and free options:
120
Yohan @yohan.so · 24/04/2025
Interested in getting a short overview of the latest geospatial papers and datasets each week? Subscribe to the Spatial Edge newsletter: yohan.so
000
Yohan @yohan.so · 24/04/2025
Please help out the community and drop other interesting datasets below.
100
Yohan @yohan.so · 24/04/2025
7. Land use We can use land-use data to measure things like: • urban sprawl • deforestation • depletion of water • growth of agriculture My favourite two are: • Google's Dynamic World • ESRI's Living Atlas Links: • developers.google.com/earth-engine... • livingatlas.arcgis.com/en/home/
100
Yohan @yohan.so · 24/04/2025
6. Climate projections I've previously used climate projection data for temperature, precipitation and wind. These provide 𝙙𝙖𝙞𝙡𝙮 geospatial forecasts until 31 Dec 2100. They use Global Circulation Models (GCMs) for various scenarios. Link: data.isimip.org/datasets/24c...
100
Yohan @yohan.so · 24/04/2025
5. Flooding I've had experience with 3 flooding datasets: • Fathom • JBA Flood maps • The Global Flood Database N.b. the first 2 are commercial datasets. Link: developers.google.com/earth-engine...
100
Yohan @yohan.so · 24/04/2025
4. Temperature and precipitation There are many datasets that provide temperature data like MOD11A1 and GCOM-C. But my go-to resource is ERA5's Climate Reanalysis Dataset. It provides daily global data on: • wind • temp • precipitation Link: developers.google.com/earth-engine...
100
Yohan @yohan.so · 24/04/2025
3. Pollutants Sentinel-5p is the go-to resource for geospatial data on various pollutants such as: • Ozone • Methane • Sulfur dioxide • Nitrogen dioxide • Carbon monoxide Link: developers.google.com/earth-engine...
201