this post was submitted on 29 Nov 2023
1 points (100.0% liked)

Data Hoarder

11 readers
1 users here now

We are digital librarians. Among us are represented the various reasons to keep data -- legal requirements, competitive requirements, uncertainty of permanence of cloud services, distaste for transmitting your data externally (e.g. government or corporate espionage), cultural and familial archivists, internet collapse preppers, and people who do it themselves so they're sure it's done right. Everyone has their reasons for curating the data they have decided to keep (either forever or For A Damn Long Time (tm) ). Along the way we have sought out like-minded individuals to exchange strategies, war stories, and cautionary tales of failures.

founded 1 year ago
MODERATORS
 

Currently I hold a collection of everything related to my whole family and our history because I'm the only one who know fuckall about computers. The collection is a massive shitload of multiple decades worth of photographs and videos.I want make multiple copies of collection on multiple drives and store them at different sites so nothing in lost in case of fire or flood, and in case of my death I want my family to be able to open it.

I am a full time gnu-linux user but everyone else uses either Windows or OSX. So naturally I was looking for a format for these drives that would be readable by all OS's, and found that recently EXFAT had it's patent expire or something so now it's natively readable by gnu-linux, and I own another 1TB drive that came preformatted as EXFAT so I sorta knew it existed, but when I looked on this sub I found this thread https://www.reddit.com/r/DataHoarder/comments/12sfbwt/is_formatting_a_hard_drive_to_exfat_32_safe/ plus other things which basically told me

  • EXFAT is not good for drives that are multiple TBs, as it ends up with fragmentation issues. This issue gets worse if your working with a lot of files or big files. (I'm working with both.)

  • EXFAT has an issue with corruption, which can be extra bad if a cable is bumped while in use or there is a power issue, where you can get the whole filesystem corrupted. And it gets worse if you're working with a lot of files or big files. (And again, that's exactly what I'm doing.)

So it seems like instead of being exactly what would be the solution to my problem, EXFAT is actually a pretty terrible format for my situation. What are my other options here? I am kinda stumped.

If only Apple and MS would adopt EXT4...

you are viewing a single comment's thread
view the rest of the comments
[–] HobartTasmania@alien.top 1 points 11 months ago

Consider UDFS as Windows can format partitions/disks using the UDF file system but you can only do it via the command line, you can then read and write to it as you would to a normal disk, I believe Linux and Mac's can access it just as easily as long as you don't set the version too high and it is common to all three OS's.

e.g.

FORMAT volume [/FS:file-system] [/V:label] [/Q] [/A:size] [/C] [/X] [/P:passes] [/S:state] /FS:filesystem Specifies the type of the file system (FAT, FAT32, exFAT, NTFS, or UDF).

/R:revision UDF only: Forces the format to a specific UDF version (1.02, 1.50, 2.00, 2.01, 2.50). The default revision is 2.01.

/D UDF 2.50 only: Metadata will be duplicated.