Programming

13376 readers

1 users here now

All things programming and coding related. Subcommunity of Technology.

This community's icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.

founded 1 year ago

MODERATORS

remington

alyaza

Hexorg

Is SQL a good language for data transformations? (discuss.tchncs.de)

submitted 1 year ago by Mattol@discuss.tchncs.de to c/programming

5 comments fedilink hide all child comments

I always wish I wouldn't have to pull in python/pandas to do simple data transformations on smaller local datasets/csv files and stick with sqlite. But then I tend to quickly hit a problem that seems to require dynamic SQL. Anything in between SQL and a general programming language that is made for transforming tabular data?

you are viewing a single comment's thread
view the rest of the comments

[–] ElmiHalt@sopuli.xyz 3 points 1 year ago* (last edited 1 year ago)

It depends on the data you have to work with but SQL is quite capable in itself. Yet SQL might be tricky for some specific tasks (like unwrapping dimensions from a plain table when you have to partially rotatate the table, building multidimensional datasets) and for those cases more traditional approaches tend to he far easier to grasp and use.

Like... Can you use it? Yes. Should you? If you're highly skilled and proficient in SQL then sure, why not... But would've you asked the question in the first place if that was the case?

I don't have to do such tasks often enough (once in a month or two) to be bothered and when I need to I'll just smack my head against the table (ha-ha) until I make it (remember that part about being skilled in SQL - I'm not skilled enough lol)... Maybe I'll polish the result with some script or a bit of Go. But that's not an approach I'd recommend to use on regular basis.