Sign in

Crunchy Data

@crunchydata.com
2.1K followers 269 following 96 posts

Just Postgres www.crunchydata.com

PostsRepliesMedia
Crunchy Data @crunchydata.com · 22/04/2025
Today we're announcing the availability of logical replication from Postgres to Iceberg with Crunchy Data Warehouse. Now you can seamlessly move data and stream changes from your operational database into an analytical system. www.crunchydata.com/blog/logical...
crunchydata.com
Logical replication from Postgres to Iceberg | Crunchy Data Blog
We've launched native logical replication from Postgres tables in any Postgres server to Iceberg tables managed by Crunchy Data Warehouse.
1131
Crunchy Data @crunchydata.com · 17/04/2025
How long has it been since you checked your cache hit ratio? Ideally most of your frequently queried data is in the buffer cache. We recommend 98-99% in the cache for transactional workloads - analytical workloads are lower.
150
Crunchy Data @crunchydata.com · 16/04/2025
Postgres + Iceberg side-by-side next to the same query with a Postgres HEAP table. Half a millisecond for the optimized 🔥 . 10 seconds for the long method. www.crunchydata.com/products/war...
050
Crunchy Data @crunchydata.com · 16/04/2025
psql tip: find your config parameters that are not default with \dconfig. List of non-default configuration parameters:
140
Crunchy Data @crunchydata.com · 16/04/2025
Postgres does a good job of keeping internal statistics of your which are used to plan how queries are executed. But Postgres doesn't always know how columns are related. In this deep dive we look at hacking the statistics for improved performance
crunchydata.com
Hacking the Postgres Statistics Tables for Faster Queries | Crunchy Data Blog
Adding extended statistics can add information about how columns are related. Louise has some real life example queries and tips for working with extended table stats that can dramatically improve…
070
Crunchy Data @crunchydata.com · 15/04/2025
Miss our webinar on running Crunchy Data Warehouse on-premises? We cover an overview, hands on walk through with live querying our data lake to full Iceberg creation, and highlight of popular use cases for it. If you missed it don't worry we got you covered. www.youtube.com/watch?v=Vojg...
youtube.com
Crunchy Data Warehouse: Postgres + Iceberg for Your On-premises Data Lake
YouTube video by Crunchy Data
010
Crunchy Data @crunchydata.com · 15/04/2025
We all love pg_stat_statements but that data collects forever and can get a little stale. When should you reset it? Here are some tips from our support team.
110
Crunchy Data @crunchydata.com · 01/04/2025
Excited to announce Crunchy Data Warehouse is now available for Kubernetes and On-premises. Need faster analytics from Postgres? Want a native Postgres data lake experience? Learn more about how it works: www.crunchydata.com/blog/crunchy...
crunchydata.com
Crunchy Data Warehouse: Postgres with Iceberg Available for Kubernetes and On-premises | Crunchy Data Blog
Crunchy Data brings Postgres-native Apache Iceberg to Kubernetes and on-prem workloads.
051
Crunchy Data @crunchydata.com · 31/03/2025
Working with psql directly in Postgres? These tips will help turn you into a psql power user -
buff.ly
Postgres Tips from the Experts at Crunchy Data
Advanced ideas and tricks on how to use Postgres to its best.
010
Crunchy Data @crunchydata.com · 27/03/2025
Need to get data to or from Postgres and into Parquet? pg_parquet is an open source extension that makes this easy, no need for complicated ETL processes -
buff.ly
pg_parquet: An Extension to Connect Postgres and Parquet | Crunchy Data Blog
Crunchy Data is excited to release a new extension so you can write Postgres data to Parquet and or pull data from Parquet to Postgres. Craig has the details and sample code.
050
Crunchy Data @crunchydata.com · 26/03/2025
We talk with users every week about whether Citus is a good fit for them. While Citus is a very powerful Postgres extension it has very specific use cases where it does fit, here we break down the cases where Citus is a fit as well as when it's not -
buff.ly
Citus: The Misunderstood Postgres Extension | Crunchy Data Blog
What applications and use cases make the most sense for Citus.
011
Crunchy Data @crunchydata.com · 25/03/2025
When it comes to developer tools everyone has their favorite tips and tricks. And because we love Postgres we worked to capture many of our favorite tips and tricks for Postgres here in this collection -
buff.ly
Postgres Tips from the Experts at Crunchy Data
Advanced ideas and tricks on how to use Postgres to its best.
050
Crunchy Data @crunchydata.com · 20/03/2025
Excited to announce built-in maintenance for Iceberg via Postgres. Now within Crunchy Data Warehouse we will automatically vacuum and continuously optimize your Iceberg data by compacting and cleaning up files. Dig into the details of how this works www.crunchydata.com/blog/automat...
crunchydata.com
Automatic Iceberg Maintenance Within Postgres | Crunchy Data Blog
Iceberg can create orphan files during snapshot changes or transaction rollbacks. Crunchy Data Warehouse automatically cleans up the orphan files using a new autovacuum feature.
0123
Crunchy Data @crunchydata.com · 18/03/2025
Citus is a Postgres extension that turns it into a sharded, distributed, horizontally scalable database. With all these buzzwords, it attracts a lot of people thinking it can solve all their problems. We dig into when it is a good fit and when it isn't - www.crunchydata.com/blog/citus-t...
crunchydata.com
Citus: The Misunderstood Postgres Extension | Crunchy Data Blog
What applications and use cases make the most sense for Citus.
031
Crunchy Data @crunchydata.com · 14/03/2025
Happy pi day! 🥧 Postgres has a pi function: pi(); This can be used to calculate circular sizes and areas. @pwramsey.bsky.social looks at pi in PostGIS today with a blog post on circular forms on PostGIS with a proof for the CIRCLELINESTRING shape. www.crunchydata.com/blog/postgis...
crunchydata.com
Pi Day PostGIS Circles | Crunchy Data Blog
For a proper Pi Day celebration in Postgres, Paul shows off a proof for CIRCULARSTRING.
042
Crunchy Data @crunchydata.com · 21/01/2025
SQL output can be messy. Psql options for formatting output. A handy option is \pset border 2 This will add top and bottom borders with double lines (╔, ╚, ╤, ╧, etc.). A Header row bordered with a double-line separator . Each row is separated by single lines. Each column is clearly separated.
0140
Crunchy Data @crunchydata.com · 14/01/2025
Congratulations to the Postgres community on PostgreSQL once again being named the DBMS of the year in 2024, for the second year in a row. db-engines.com/en/blog_post...
db-engines.com
PostgreSQL is the Database Management System of the Year 2024
0274
Reposted by Crunchy Data
Kit Macleod @kitmacleod.bsky.social · 02/01/2025
Great to see this ability for "creating processing pipelines for append-only streams of data...We believe it is a foundational building block for building IoT applications on PostgreSQL that should be available to everyone, similar to pg_cron, pg_parquet, and pg_partman."
0142
Reposted by Crunchy Data
Marco Slot @marcoslot.com · 17/12/2024
There are many incremental processing solutions, but they seem to never quite do what I need. I decided to build an extension that just keeps running the same command in Postgres with different parameters to do fast, reliable incremental data processing. That's pg_incremental. 1/n
1123
Crunchy Data @crunchydata.com · 17/12/2024
We’re excited to release pg_incremental today - a new extension for automated incremental updates. pg_incremental is like a supercharged pg_cron that runs data pipelines, data syncs, rollups, imports and exports. www.crunchydata.com/blog/pg_incr...
crunchydata.com
pg_incremental: Incremental Data Processing in Postgres | Crunchy Data Blog
We are excited to release a new open source extension called pg_incremental. pg_incremental works with pg_cron to do incremental batch processing for data aggregations, data transformations, or import...
2213
Crunchy Data @crunchydata.com · 06/12/2024
Many big Postgres databases today use partitioning. Do you have a default partition? If not, you probably should. Default partitions are super important because they let you catch inconsistent data or bugs in your application code. www.crunchydata.com/blog/postgre...
crunchydata.com
Postgres Partitioning with a Default Partition | Crunchy Data Blog
Keith discusses the importance of having a default partition, how to monitor the default, and how to move rows to new child tables.
073
Crunchy Data @crunchydata.com · 03/12/2024
We have been talking to customers a lot about the medallion architecture with data. This is a pattern we see for data lakehouses.
161
Reposted by Crunchy Data
Nate Vick @natevick.bsky.social · 01/12/2024
@crunchydata.com is up to more cool things with Postgres www.crunchydata.com/blog/crunchy...
crunchydata.com
Crunchy Data Warehouse: Postgres with Iceberg for High Performance Analytics | Crunchy Data Blog
We are excited to release Crunchy Data Warehouse, a modern data warehouse for Postgres. Crunchy Data Warehouse combines Postgres with Iceberg, Parquet, and data lake formats for fast analytics queries...
0123
Crunchy Data @crunchydata.com · 27/11/2024
Did you miss PostGIS day this year? If you did don't worry, you don't have to entirely miss out, we've got your recap and the videos for you here - www.crunchydata.com/blog/postgis...
crunchydata.com
PostGIS Day 2024 Summary | Crunchy Data Blog
Crunchy Data hosted an online event for PostGIS on November 21st, 2024. Paul has a wrap up post discussing the highlights and themes throughout the day.
0156
Crunchy Data @crunchydata.com · 27/11/2024
Running queries on data that have nulls in them? Make your data more clear by specifying a special character for null with psql: \pset null 👻
080
Crunchy Data @crunchydata.com · 26/11/2024
It's not the new year, but these tips from @craigkerstiens.com may help your database to be in better shape well ahead of end of the year -
crunchydata.com
Five Tips For a Healthier Postgres Database in the New Year | Crunchy Data Blog
Craig's year end wrap-up of 5 things you can do for a healthier Postgres database next year.
095
Crunchy Data @crunchydata.com · 26/11/2024
The pg_parquet extension benefits Postgres users who work with large or complex databases: Why is parquet so great? Two main reasons:
161
Crunchy Data @crunchydata.com · 25/11/2024
Know which queries consume the most time against your Postgres database? Pg_stat_statements will tell you if you don't already know: SELECT total_exec_time, mean_exec_time as avg_ms, calls, query FROM pg_stat_statements ORDER BY mean_exec_time DESC LIMIT 10; #dataBS
1261
Crunchy Data @crunchydata.com · 25/11/2024
Do your kids have a break this week and need something to keep them entertained? How about teaching them a little about Postgres. We've got a Postgres playground tutorial designed just for kids -
crunchydata.com
PostgreSQL - Just for Kids | Tutorials | Crunchy Data
Intro to SQL tutorial for kids. This is a hands on tutorial using an existing Postgres database running in a web browser.
081
Crunchy Data @crunchydata.com · 22/11/2024
When working with psql in Postgres you can edit queries using \e \e will open your default editor thats been defined with $EDITOR What's your $EDITOR set to?
2100
Reposted by Crunchy Data
Marco Slot @marcoslot.com · 22/11/2024
The promise of Apache Iceberg. It's like pong for databases. #databs
0204
Crunchy Data @crunchydata.com · 21/11/2024
Did you know you can automatically log all slow queries that take over a certain period of time with log_min_duration_statement? What time you set can vary based on your needs. Whats your recommended setting for logging on your Postgres database? #dataBS www.crunchydata.com/postgres-tip...
crunchydata.com
Postgres Tips from the Experts at Crunchy Data
Advanced ideas and tricks on how to use Postgres to its best.
091
Reposted by Crunchy Data
Fabien Nicollet @fnicollet.bsky.social · 21/11/2024
watching "PostGIS day" sessions, presented by @pwramsey.bsky.social and @crunchydata.com , loving it 🐘 www.crunchydata.com/community/ev...
092
Crunchy Data @crunchydata.com · 20/11/2024
Announcing Crunchy Data Warehouse! A next-generation Postgres-native data warehouse that provides full Iceberg support for fast analytical queries and transactions.Read more in our announcement. www.crunchydata.com/blog/crunchy...
crunchydata.com
Crunchy Data Warehouse: Postgres with Iceberg for High Performance Analytics | Crunchy Data Blog
We are excited to release Crunchy Data Warehouse, a modern data warehouse for Postgres. Crunchy Data Warehouse combines Postgres with Iceberg, Parquet, and data lake formats for fast analytics queries...
1338
Crunchy Data @crunchydata.com · 19/11/2024
We recently made a tweak to our blog to instead of showing random/topical images in our social images to showing the post itself. After all don't we all want to see more code? Would love to hear what you think - www.crunchydata.com/blog/pg_parq...
crunchydata.com
pg_parquet: An Extension to Connect Postgres and Parquet | Crunchy Data Blog
Crunchy Data is excited to release a new extension so you can write Postgres data to Parquet and or pull data from Parquet to Postgres. Craig has the details and sample code.
020
Reposted by Crunchy Data
Craig @craigkerstiens.com · 19/11/2024
CREATE TABLE taxi_trips() with (load_from = 'd37ci6vzurychx.cloudfront.net/trip-…'); SELECT count(*) FROM taxi_trips;
063
Reposted by Crunchy Data
Craig @craigkerstiens.com · 19/11/2024
One piece of this is always the performance, the other is how easy or hard it is. On Crunchy Bridge for Analytics it's literally two lines. @marcoslot.com and the entire team really nailed it on this one with developer experience.
132
Reposted by Crunchy Data
Craig @craigkerstiens.com · 19/11/2024
Multiple times a week I'm having conversations with people that have built overly complex data pipelines. What used to just work is now a team of people gluing and duct taping solutions together with the latest shiny data engineering tools.
2153
Reposted by Crunchy Data
Craig @craigkerstiens.com · 18/11/2024
Always love a blog post that highlights some near learning in Postgres, this time rollup and cube by @sqlliz.bsky.social www.crunchydata.com/blog/easy-to...
crunchydata.com
Easy Totals and Subtotals in Postgres with Rollup and Cube | Crunchy Data Blog
Learn about easy subtotals with the GROUP BY ROLLUP and CUBE to get totals and subtotals across categories and date bins.
0193
Reposted by Crunchy Data
Marco Slot @marcoslot.com · 14/11/2024
Playing with @pwramsey.bsky.social 's OpenAI extension on Crunchy Bridge 🤯
133
Crunchy Data @crunchydata.com · 15/11/2024
A change to RelResultInfo - A Near Miss with Postgres 17.1 www.crunchydata.com/blog/a-chang...
crunchydata.com
A change to RelResultInfo - A Near Miss with Postgres 17.1 | Crunchy Data Blog
A new point version was released on Nov 14th for 17.1, 16.5, 15.9, and others. This included an update to the Postgres ABI potentially breaking extensions. Craig digs into the change and what you need...
073
Crunchy Data @crunchydata.com · 13/11/2024
We've got several team members out at #Kubecon this week. If you're there we'd love to say hi, stop by and grab an activity book or other swag from our booth.
000
Crunchy Data @crunchydata.com · 13/11/2024
Accessing large language models from Postgres www.crunchydata.com/blog/accessi...
crunchydata.com
Accessing Large Language Models from PostgreSQL | Crunchy Data Blog
Paul shows you how to use a new OpenAI API extension for working with LLMs in Postgres.
050
Crunchy Data @crunchydata.com · 12/11/2024
Want to write better analytical queries @winsletts.bsky.social has you covered with a breakdown of 8 great tips and walkthroughs for writing better SQL - www.crunchydata.com/blog/8-steps...
crunchydata.com
8 Steps in Writing Analytical SQL Queries | Crunchy Data Blog
Chris breaks down his approach to building out complex SQL step by step.
041
Reposted by Crunchy Data
Craig @craigkerstiens.com · 12/11/2024
But how does Google docs come into play? Google docs has this handy =importdata("url.csv") function that will auto-import data. So you can: * Write a query, click save * Share it, copy the url * Import into google docs * Chart/manipulate to your hearts content. All literally in under a minute.
191
Crunchy Data @crunchydata.com · 04/11/2024
Did you know when using psql \e will open your default $EDITOR to edit the last run query? Save and close and it'll execute that query.
040
Crunchy Data @crunchydata.com · 01/11/2024
You may have heard that we launched a data analytics engine with a combination of Postgres 🐘 and DuckDB 🦆. >> Why did we fuse DuckB with Postgres?
2102
Crunchy Data @crunchydata.com · 31/10/2024
A couple weeks ago we released pg_parquet. With pg_parquet you can easily: * Export tables or queries from Postgres to Parquet files * Ingest data from Parquet files to Postgres * Inspect the schema and metadata of existing Parquet files Want to learn more?
buff.ly
pg_parquet: An Extension to Connect Postgres and Parquet | Crunchy Data Blog
Crunchy Data is excited to release a new extension so you can write Postgres data to Parquet and or pull data from Parquet to Postgres. Craig has the details and sample code.
184
Crunchy Data @crunchydata.com · 30/10/2024
Backups are out and snapshots are in! Brian breaks down everything you need to know for how to use pgBackRest with snapshots in a Kubernetes environment.
crunchydata.com
PostgreSQL Snapshots and Backups with pgBackRest in Kubernetes | Crunchy Data Blog
Backups are out and snapshots are in! Brian breaks down everything you need to know for how to use pgBackRest with snapshots in a Kubernetes environment.
031
Crunchy Data @crunchydata.com · 29/10/2024
Data pipelines for IoT applications often involve multiple different systems and while a lot of interesting engineering goes into these systems, things are much simpler if you can do everything in Postgres.
110