SchwertImStein@lemmy.dbzer0.com to Programmer Humor@programming.devEnglish · 1 年前muskrat's data eng expert's hard drive overheats while processing 60k rowslemmy.dbzer0.comimagemessage-square289linkfedilinkarrow-up1985arrow-down114
arrow-up1971arrow-down1imagemuskrat's data eng expert's hard drive overheats while processing 60k rowslemmy.dbzer0.comSchwertImStein@lemmy.dbzer0.com to Programmer Humor@programming.devEnglish · 1 年前message-square289linkfedilink
minus-squareeasily3667@lemmus.orgdeleted by creatorlinkfedilinkEnglisharrow-up143·edit-21 年前deleted by creator
minus-squarenaught@sh.itjust.workslinkfedilinkarrow-up58·1 年前i mean its even excel sized depending on how many columns. This is seriously sad and alarming
minus-squareeasily3667@lemmus.orgdeleted by creatorlinkfedilinkEnglisharrow-up11·edit-21 年前deleted by creator
minus-squarewise_pancake@lemmy.cadeleted by creatorlinkfedilinkarrow-up3·1 年前Holy shit if this ids lm issue that’s too funny
minus-squaremorrowind@lemmy.mllinkfedilinkarrow-up50·1 年前Sqlite can easily handle millions of rows. Don’t sell it short
minus-squareThe_Decryptor@aussie.zonelinkfedilinkEnglisharrow-up9·1 年前How about a 6.4TB sqlite database? https://boyter.org/posts/searchcode-bigger-sqlite-than-you/
minus-squareKorhaka@sopuli.xyzlinkfedilinkEnglisharrow-up4·1 年前I have an sqlite db that is a few GB in size, game saves using the format. Sadly almost all blob data, would love to play with it if it was a bit more readable
minus-squareeasily3667@lemmus.orgdeleted by creatorlinkfedilinkEnglisharrow-up1·edit-21 年前deleted by creator
deleted by creator
i mean its even excel sized depending on how many columns. This is seriously sad and alarming
deleted by creator
Holy shit if this ids lm issue that’s too funny
Sqlite can easily handle millions of rows. Don’t sell it short
How about a 6.4TB sqlite database?
https://boyter.org/posts/searchcode-bigger-sqlite-than-you/
Should be enough to hold 60k rows
I have an sqlite db that is a few GB in size, game saves using the format. Sadly almost all blob data, would love to play with it if it was a bit more readable
deleted by creator
60k is single json file