Peter Deffebach @macrodev.bsky.social · 20/12/2024I'm still not sure I understand the benefits. Is it that the WHERE commands are so intuitive in SQL? I could do a similar query very easily in dplyr. Is it the size of the data? I could use feather in R or just work on the cluster. 100
Peter Deffebach @macrodev.bsky.social · 20/12/2024The main problem I have is that our workflow is having a big Dropbox folder holding the data, and a separate git repo with all the code. That is, the data is local. The main drawback to me is that an SQL database, when local, is just some big binary blog on your hard drive? Seems kind of opaque. 100
Peter Deffebach @macrodev.bsky.social · 20/12/2024So aside from data integrity things (ensuring a structure, matches work seamlessly), it's not obvious how a SQL workflow is good when data is local. 100
