@cccc@aussie.zone The privacy friendly (and cheap) option is DIY with Ceph. Managing 100s of petabytes across multiple clusters with it and it's (mostly) smooth sailing.

[–] lowleveldata@programming.dev 4 points 1 year ago (1 children)

What is the running cost for 100PB?

[–] mattes@lemmy.kussi.me 6 points 1 year ago (1 children)

No way to tell as it depends on all kinds of factors, like workload and IO requirements. For example you could spin up a very cheap spinning rust Ceph cluster for archival use cases or you could have a very fast NVMe/PMEM cluster for compute workloads.

I am managing all kinds of installations.

And before somebody ask no, not piracy related lmao.

(Replying with my lemmy account as my other account apparently isn’t federating with programming.dev)

[–] lowleveldata@programming.dev 1 points 1 year ago (1 children)

Unrelated but you can't reply to people from instance that's not federating? That's quite unintuitive

[–] mattes@lemmy.kussi.me 2 points 1 year ago

I could not even see your reply on the other account so no way to reply either. I only saw it by navigating to this instance.

[–] cccc@aussie.zone 1 points 1 year ago (2 children)

I understand your comment but may need an ELI5 after looking at their site.

[–] Faceman2K23@discuss.tchncs.de 3 points 1 year ago

Ceph can be run on multiple machines and tied together into one big singular storage cluster that can be used for basically anything.

It's not exactly a beginner friendly solution though as you have to do all the work.

It's not a "cloud service" that you can just sign up for and push data to.

[–] mattes@kussi.me 3 points 1 year ago

Basically it allows you to buy or rent your own physical servers and then use the free and open source software Ceph to setup your own cloud storage on top of them.

Depending on the scale you need, it's much cheaper than cloud storage providers, but obviously comes with the caveat that you need to manage everything yourself.