this post was submitted on 23 Nov 2023
3 points (100.0% liked)

Data Hoarder

11 readers
1 users here now

We are digital librarians. Among us are represented the various reasons to keep data -- legal requirements, competitive requirements, uncertainty of permanence of cloud services, distaste for transmitting your data externally (e.g. government or corporate espionage), cultural and familial archivists, internet collapse preppers, and people who do it themselves so they're sure it's done right. Everyone has their reasons for curating the data they have decided to keep (either forever or For A Damn Long Time (tm) ). Along the way we have sought out like-minded individuals to exchange strategies, war stories, and cautionary tales of failures.

founded 1 year ago
MODERATORS
communick@selfhosted.forum
3
It is time keep hoarding AI models as Chinese censorship hits NYC based Huggingface the biggest AI library (www.404media.co)
submitted 11 months ago by ihmoguy@alien.top to c/datahoarder@selfhosted.forum
4 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] Masark@alien.top 2 points 11 months ago

  1. You simply download the file and keep it. We're talking about stuff you can run on your own computer, not services like chatgpt or such.

  2. Highly variable. Depends on model size and format. For LLMs, range would be from under 1GB up to a current maximum of ~240GB.

  3. It's a big file of numbers ("weights" or "parameters") either integers or floating point depending on format.