Dipankar Mazumdar @dipankartnt.bsky.social · 21/11/2024Each of these formats shines in specific use cases depending on its unique features! And so based on your use case & technical fit (in your data architecture), you should be free to use anything without being married to just one. 100
Dipankar Mazumdar @dipankartnt.bsky.social · 21/11/2024On the query engine-side (warehouse, lake compute), more & more vendors are now looking at integrating with these open formats. In reality, it is tough to have robust support for every single format. By robust I mean - full write support, schema evolution, compaction. 100
Dipankar Mazumdar @dipankartnt.bsky.social · 21/11/2024And even if they do work with multiple formats, it is practically tough to build optimization capabilities for each of these formats. So, to summarize, I see XTable having 2 major applications: ✅ On the compute-side with vendors using XTable as the interoperability layer 100
