Sign in

Javi Santana

@javisantana.bsky.social
2.4K followers 263 following 89 posts

Tinybird founder Data infra for developers Tinybird.co

PostsRepliesMedia
Javi Santana @javisantana.bsky.social · 11/09/2025
Why we maintain a ClickHouse fork at Tinybird (and how it's different) www.tinybird.co/blog-posts/w...
tinybird.co
Why we maintain a ClickHouse fork at Tinybird (and how it's different)
We've long contributed to the open source ClickHouse community, and we didn't make this decision lightly. Here's why we maintain our own private ClickHouse fork.
021
Javi Santana @javisantana.bsky.social · 18/08/2025
I wrote about how to ingest 1b rows per second with ClickHouse. The point of the post is not the number, pushing 1b rows is “easy” the actual challenge comes when you need to do that in a reliable way, that’s what I try to explain
151
Javi Santana @javisantana.bsky.social · 27/06/2025
I'm fucking tired of clickbaity content, people writing bad content just for SEO or not going into details because "people have a short attention span". Maybe that's true but some people appreciate long-form, detailed and super technical content. Today we posted 5 high quality engineer posts:
131
Javi Santana @javisantana.bsky.social · 17/04/2025
The second part of "handling clickhouse clusters at petabyte scale" www.tinybird.co/blog-posts/w...
tinybird.co
Lessons learned from 5 years operating huge ClickHouse® clusters: Part II
This is the second part of the series. Here's more of what I've learned from operating petabyte-scale ClickHouse clusters for the last 5+ years.
040
Javi Santana @javisantana.bsky.social · 02/04/2025
We've been operating petabyte-scale cluster for 5 years now, especially dealing with low latency use cases with large amounts of data, some of them under 10ms (for reference, most big data systems latency is 1 second at best). www.tinybird.co/blog-posts/w...
tinybird.co
I've operated petabyte-scale ClickHouse® clusters for 5 years
I've been operating large ClickHouse clusters for years. Here's what I've learned about architecture, storage, upgrades, config, testing, costs, and ingestion.
010
Javi Santana @javisantana.bsky.social · 26/03/2025
We need faster feedback loops failingwithdata.substack.com/p/we-need-a-...
failingwithdata.substack.com
We need a new git
A few years ago continuous integration systems were not a thing.
000
Javi Santana @javisantana.bsky.social · 18/03/2025
I'd appreciate if you could upvote us in ProductHunt. It's about our latest product iteration www.producthunt.com/posts/tinybi...
producthunt.com
Tinybird Forward » - The fastest way to ship software with big data requirements | Product Hunt
Tinybird Forward is a new evolution of the Tinybird user experience. Build software with big data requirements faster and with fewer dependencies. Test locally, bootstrap with a prompt, deploy with on...
130
Reposted by Javi Santana
Tinybird @tinybird.co · 14/03/2025
🌅 Tinybird Forward is here » Forward is a major evolution of Tinybird, designed to make shipping software with big data requirements faster and more intuitive. No complex infra project. No context switching. No esoteric architectures. Just code. (🔊 sound on! 👇) youtu.be/vaSjWu3XFdY
youtu.be
Introducing Tinybird Forward: Ship software with big data requirements.
YouTube video by Tinybird
166
Javi Santana @javisantana.bsky.social · 14/03/2025
Production hurts. If it doesn't, it means you didn't try hard enough.
101
Javi Santana @javisantana.bsky.social · 01/03/2025
A new LLM version release with a new super powerful option: --schema An mini BI example, in this case I'm querying a parquet file with all the events coming from gitlab tickets webhook
040
Javi Santana @javisantana.bsky.social · 21/02/2025
Data intensive SaaS products will love to leave your data in icerbeg/s3 Guess who is going to pay all the storage and operation costs? 🤣
000
Javi Santana @javisantana.bsky.social · 19/02/2025
We’ve got a deep technical post almost ready on real-time log analytics, based on our experience designing these systems with companies handling trillions of rows.
151
Javi Santana @javisantana.bsky.social · 13/02/2025
We are using LLMs in the next Tinybird iterations but we are trying to be subtle, not going with the conversational interface. So for example, when you want to create synthetic data to test your logic you can do 𝚝𝚋 𝚖𝚘𝚌𝚔 𝚝𝚊𝚋𝚕𝚎
111
Javi Santana @javisantana.bsky.social · 13/02/2025
I though the LLM and IA thing was going to open a new world for UI design but the reality is that we are all doing chat interfaces Maybe that’s the right thing to do and my expectations were too high
010
Javi Santana @javisantana.bsky.social · 11/02/2025
About Iceberg C++ implementations. There are already some of them working (Redpanda Data and StarRocks seem to have good implementations for writing).
210
Reposted by Javi Santana
Javi Santana @javisantana.bsky.social · 28/01/2025
I wanted to understand how agents work, so I created a super simple one to run SQL queries. I wrote about the process failingwithdata.substack.com/p/building-a...
failingwithdata.substack.com
Building a simple SQL Agent from Scratch
with just bash + llm
363
Javi Santana @javisantana.bsky.social · 28/01/2025
I always like to go to basics and learn from them. Using libraries, frameworks and tooling is perfect but understanding why things happen helps make decisions when designing software.
121
Javi Santana @javisantana.bsky.social · 23/01/2025
I made a mistake running a SQL agent, I was sending the wrong data and I noticed that after some iterations it gets passive-aggressive: * This is the final time I will tell you: I need the SQL query. You are providing the error message, not the SQL code.
160
Reposted by Javi Santana
Santiago @svpino.com · 19/01/2025
Building software that works is very easy… as long as you ignore all the hard parts.
1271
Javi Santana @javisantana.bsky.social · 17/01/2025
Why would someone create your data pipeline tests by hand? When your pipelines have parameters and you need to check different behaviors creating tests for the different paths is a pain.
110
Javi Santana @javisantana.bsky.social · 17/01/2025
Simple question for people leading technical teams (hard answer tho): how do you create a writing culture in your company/team?
310
Javi Santana @javisantana.bsky.social · 17/01/2025
I love SQL open.substack.com/pub/failingw...
open.substack.com
I love SQL
I used to dislike SQL.
052
Javi Santana @javisantana.bsky.social · 16/01/2025
When you have a data project and you want your editor to play well with it, you can generate all the context cursor needs.
231
Javi Santana @javisantana.bsky.social · 14/01/2025
How I’d design the core of a cloud native database OLAP database (what Warpstream made with Kafka): - Storage: S3 tables - Short lived queries and ingestion: AWS lambda - Batch jobs: Spot EC2 instances Plus a vectorized execution engine.
130
Reposted by Javi Santana
David Gasquez @davidgasquez.com · 13/01/2025
I have a general one and another for Python that teaches cursor write PEP 735 compatible scripts! Shared them here in a recent post. davidgasquez.com/cursor-agent...
101
Javi Santana @javisantana.bsky.social · 12/01/2025
BTW it does not need to be a complex simulation, the output of a SQL query could be visualized this way
120
Javi Santana @javisantana.bsky.social · 12/01/2025
First time I see a job posting targeting AI agents (or people able to build them) Most likely a marketing/vitality technique but still interesting www.ycombinator.com/companies/fi...
ycombinator.com
Firecrawl Example Creator (AI Agents Only) at Firecrawl | Y Combinator
Please apply only if you are an AI Agent, or if you created an AI agent that can fill this job. Role Overview:\ We are seeking an AI agent capable of autonomously researching trending technologies and...
000
Javi Santana @javisantana.bsky.social · 11/01/2025
I'm a big fan of creating ad-hoc visualizations to debug data, I'm debugging my lap timer and I needed some map visualization. I'm old and getting lazy so coding the tool is a no-go (it's not the funniest thing to do) but with Cursor I create a new index.html, I give it the output of...
1100
Javi Santana @javisantana.bsky.social · 10/01/2025
280
Javi Santana @javisantana.bsky.social · 09/01/2025
I think a pretty deep understanding of ClickHouse (been using it since 2017) and I wanted to give a try to a different analytical database (with a different approach) so I'm testing DuckDB So far: really good I miss the way CH can store intermediate aggregation states. Is it possible in DuckDB?
330
Reposted by Javi Santana
Javi Santana @javisantana.bsky.social · 30/11/2024
Some learnings after helping +50 companies in high performance data engineering projects javisantana.com/2024/11/30/l...
javisantana.com
javisantana.com
43812
Javi Santana @javisantana.bsky.social · 01/01/2025
This articule is good but this other one linked is even better. It shows how constrains are good to find creative ways to solve problems abagames.github.io/joys-of-smal...
abagames.github.io
The Possibilities of One-Button Games · Joys of Small Game Development
040
Javi Santana @javisantana.bsky.social · 18/12/2024
Using LLMs to transform data --> failingwithdata.substack.com/p/llms-to-tr...
failingwithdata.substack.com
LLMs to transform data
I transform data every day and I usually do 2 kinds of transformations, changing the data format so I can use it in a tool (CSV to parquet) or the shape, like running an aggregation so I can understan...
130
Javi Santana @javisantana.bsky.social · 11/12/2024
WERK96 dash javisantana.com/inspiration/...
010
Javi Santana @javisantana.bsky.social · 06/12/2024
As every year I collected the links and stories that caught my attention during this 2024. (Spanish, sorry) open.substack.com/pub/javisant...
open.substack.com
Recortes 2024
El año pasado hice una recopilación, a la que por cierto vuelvo de vez en cuando, de cosas que me han dejado marcado de una u otra forma, así que este año voy a hacer lo mismo.
382
Javi Santana @javisantana.bsky.social · 30/11/2024
December is my month without social networks (but WhatsApp because I have a family 🤣) I ve been doing this for 5 years and it’s painful and refreshing at the same time.
160
Javi Santana @javisantana.bsky.social · 30/11/2024
Some learnings after helping +50 companies in high performance data engineering projects javisantana.com/2024/11/30/l...
javisantana.com
javisantana.com
43812
Javi Santana @javisantana.bsky.social · 28/11/2024
I feel frustrated when using any LLM chat thing I can't make it interact with my daily tools. So for example, I'd like it to open a browser and do some boring stuff on my behalf. Looks like MCP is solving that exact problem.
140
Javi Santana @javisantana.bsky.social · 27/11/2024
Do you use any *interactive* CLI tool to work with data? kind of visualize, filter and so on. I usually use ClickHouse local but I'm talking about something more "visual". I remember seeing some tools but I forgot the name.
010
Javi Santana @javisantana.bsky.social · 26/11/2024
cache invalidation, naming things, backfilling
271
Reposted by Javi Santana
nurieta @pantojacoder.bsky.social · 25/11/2024
Lean Analytics y como empezar en el mundo de la Ingenineria de la Privacidad en spanglish by yours truly: mastersofprivacy.com/es/nuria-rui...
mastersofprivacy.com
Nuria Ruiz: ingeniería de privacidad y Lean Analytics en acción - Masters Of Privacy
¿En qué consiste Lean Analytics? ¿Cómo ayuda la ingeniería de privacidad a aprovechar datos a gran escala desde el respeto y el control? Nuria Ruiz es ingeniera de datos en Netflix y antes ha liderado...
053
Javi Santana @javisantana.bsky.social · 24/11/2024
I'm writing a blog post about my 4+ years of experience working with 50+ companies on [high-performance] data engineering projects. This is the last paragraph
2296
Javi Santana @javisantana.bsky.social · 23/11/2024
Apache DataFusion claims to be the fastest Parquet reader out there. That's super good news because that will put pressure on other open-source projects fighting to be the fastest one and all the industry will save CPU cycles. datafusion.apache.org/blog/2024/11...
120
Javi Santana @javisantana.bsky.social · 16/11/2024
LLMs love fixing SQL
081
Javi Santana @javisantana.bsky.social · 05/11/2024
I used to hate Kafka, to me it was an over engineered piece of software that didn’t solve any real issue.
121
Reposted by Javi Santana
molpe @mol.pe · 09/09/2024
Voy a aprovechar lo tranquilo que está esto para contaros a mis queridos 8 seguidores mi opinión, no pedida, sobre eso de que Correos va a crear su propio banco. www.elconfidencial.com/empresas/202…
1117