iiinova — where your digital self keeps evolving

This is a sample from a list "testing-sql-databases" I have. It's more drafty, most likely missing a ton from big tech, startups and academia alike and not published.

Reposted by Andrey Satarin

Good old Microsoft published some work: - "Deploying a Steered Query Optimizer in Production at Microsoft" dl.acm.org/doi/abs/10.1... - This great talk "The Cascades Framework for Query Optimization at Microsoft" touches on correctness youtu.be/pQe1LQJiXN0

Deploying a Steered Query Optimizer in Production at Microsoft | Proceedings of the 2022 International Conference on Management of Data

You will be notified whenever a record that you have chosen has been cited.

121

Reposted by Andrey Satarin

Work on correctness of optimizers from Greenplum - "Automatic capture of minimal, portable, and executable bug repros using AMPERe" dl.acm.org/doi/10.1145/... - "Testing the accuracy of query optimizers" dl.acm.org/doi/10.1145/...

Automatic capture of minimal, portable, and executable bug repros using AMPERe | Proceedings of the Fifth International Workshop on Testing Database Systems

You will be notified whenever a record that you have chosen has been cited.

121

Reposted by Andrey Satarin

Similar work from Databricks: - "SparkFuzz: searching correctness regressions in modern query engines" dl.acm.org/doi/abs/10.1... - "Correctness and Performance of Apache Spark SQL" youtu.be/fddBOZxdUKI

SparkFuzz | Proceedings of the workshop on Testing Database Systems

Reposted by Andrey Satarin

You already mentioned "Snowtrail: Testing with Production Queries on a Cloud Database" from Snowflake dl.acm.org/doi/10.1145/...

Snowtrail | Proceedings of the Workshop on Testing Database Systems

Reposted by Andrey Satarin

MongoDB team did great work on performance: - "Creating a Virtuous Cycle in Performance Testing at MongoDB" dl.acm.org/doi/10.1145/... - "The Use of Change Point Detection ..." dl.acm.org/doi/abs/10.1... - "Fair Benchmarking Considered Difficult" mytherin.github.io/papers/2018-...

Creating a Virtuous Cycle in Performance Testing at MongoDB | Proceedings of the ACM/SPEC International Conference on Performance Engineering

Reposted by Andrey Satarin

Randomized Testing of Cloud Spanner

To counter balance your argument some big tech work on correctness of (SQL) database in a thread below. Spanner has incredibly sophisticated random generated checks internally, this just scratches the surface: - "Randomized Testing of Cloud Spanner" medium.com/@jcorbett_26...

medium.com

One of the secrets behind Cloud Spanner quality is randomized testing. SQL databases like Cloud Spanner have complex APIs. Complete unit…

151

Reposted by Andrey Satarin

Testing Distributed Systems

Get your point, but to be fair, this list is not targeting correctness of databases (SQL or otherwise). It almost entirely excludes anything single node or targeting single threaded execution (like a fuzzer), with some late additions in asatarin.github.io/testing-dist...

asatarin.github.io

Curated list of resources on testing distributed systems