this post was submitted on 16 Nov 2023
304 points (100.0% liked)

Piracy: ꜱᴀɪʟ ᴛʜᴇ ʜɪɢʜ ꜱᴇᴀꜱ

1440 readers
43 users here now

⚓ Dedicated to the discussion of digital piracy, including ethical problems and legal advancements.

Rules • Full Version

1. Posts must be related to the discussion of digital piracy

2. Don't request invites, trade, sell, or self-promote

3. Don't request or link to specific pirated titles, including DMs

4. Don't submit low-quality posts, be entitled, or harass others



Loot, Pillage, & Plunder


💰 Please help cover server costs.

Ko-FiLiberapay


founded 1 year ago
MODERATORS
 

These are all the torrents currently managed and released by Anna’s Archive. For more information, see “Our projects” on the Datasets page. For Library Genesis and Sci-Hub torrents, the Libgen.li torrents page maintains an overview.

These torrents are not meant for downloading individual books. They are meant for long-term preservation.

Torrents with “aac” in the filename use the Anna’s Archive Containers format. Torrents that are crossed out have been superseded by newer torrents, for example because newer metadata has become available. Some torrents that have messages in their filename are “adopted torrents”, which is a perk of our top tier “Amazing Archivist” membership.

You can help out enormously by seeding torrents that are low on seeders. If everyone who reads this chips in, we can preserve these collections forever. This is the current breakdown:

Status Torrents Size Seeders
🔴 54 154.0TB <4
🟡 183 92.5TB 4–10
🟢 111 17.2TB >10

IMPORTANT: If you seed large amounts of our collection (50TB or more), please contact us at AnnaArchivist@proton.me so we can let you know when we deprecate any large torrents.

top 44 comments
sorted by: hot top controversial new old
[–] adam@doomscroll.n8e.dev 53 points 10 months ago (2 children)

It seems the majority of the torrents with poor seeder count are in the 1.5TB+ range. I just simply don't have the storage for that. Most everything in the 0-300GB range is pretty well covered.

[–] Appoxo@lemmy.dbzer0.com 23 points 10 months ago (3 children)

Agreed. I'd like to share a bit of disk storage but I only have 2 TB and I need that for my own consumption.
Give us smaller torrents (e.g. 50GB parts) instead.

[–] MachineFab812@discuss.tchncs.de 9 points 10 months ago (3 children)

You can easilly select those files from a given torrent which you would like to download and seed.

[–] interdimensionalmeme@lemmy.ml 7 points 10 months ago (1 children)

How do you make the torrent software automatically rotate which content it preserves based on the files with the fewest copies in the Swarm ? I don't want to manage this manually or have to select files by hand.

[–] MachineFab812@discuss.tchncs.de 1 points 10 months ago

That's an answer I don't have. I would just focus on grabbing what has the fewest copies for the snap-shot in time when I am downloading the files. Other archivers will grab what needs more copies at the time they download, just as you and I are basing our downloads of what has the fewest existing copies weighed against what others have seeded before us.

Its a churn of archivers "rotating" the content we each choose to preserve(almost entirely without regard for WHAT the specific content is).

If enough people were too active about deleting what they've downloaded that has "enough" copies and replacing it with content that doesn't ... okay, that's unlikely, but we still need more seeders in general, and those of us who keep on seeding that which we've already downloaded make the decision of what needs more copies seeded in the future easier to make for new archivists and/or those who have invested in more capacity.

[–] Appoxo@lemmy.dbzer0.com 4 points 10 months ago* (last edited 10 months ago) (2 children)

Answered already here: https://lemmy.dbzer0.com/comment/5155010

Already well enough seeded.

Also: Partial downloads on torrents are ~~evil~~not great^reason for the change. (Still) Don't do that.

Edit: Updated my stance on partial download.

[–] matey@lemmy.dbzer0.com 5 points 10 months ago (1 children)

Why are partial downloads evil?

[–] Appoxo@lemmy.dbzer0.com 7 points 10 months ago (2 children)

Being not a full seeder you are only giving what you have.
If another seeder quits, nobody can complete the torrent.
Not great.

[–] matey@lemmy.dbzer0.com 4 points 10 months ago (1 children)

Okay, but you're providing more to the swarm than if you weren't participating.

[–] Appoxo@lemmy.dbzer0.com 2 points 10 months ago

True. Can't argue with that logic because I use it as well

[–] Kissaki@feddit.de 4 points 10 months ago (1 children)

Not great isn't the same as evil. They're still sharing what they have.

[–] Appoxo@lemmy.dbzer0.com 2 points 10 months ago

I updated my comment. I kindly ask for feedback if possible

[–] interdimensionalmeme@lemmy.ml 2 points 10 months ago

This is a bad take, I want to auto seed the last 1% of every torrent which is the least available and automatically rotate it. Torrent infrastructure needs to stop sucking.

[–] Crotaro 1 points 10 months ago* (last edited 10 months ago)

How do I do this? When I open up the magnet link, it only seems to give me one checkbox for the entire 10 TB thing. Sure, I can check "download first and last parts before anything else" but it would still try to download all 10 TB, no?

Edit: Nevermind, I didn't grab one of the files that has aac in its name.

[–] jaykay@lemmy.zip 5 points 10 months ago (1 children)

Me with only 250GB ssd in an intel nuc lmao

[–] Appoxo@lemmy.dbzer0.com 2 points 10 months ago

That's my rented seedbox I sync my downloads from.
At home I have an intel nuc 11th gen with 8tb attached via USB.

[–] lixus98@sopuli.xyz 2 points 10 months ago (1 children)

There are smaller torrents < 80gb go take a look on their website

[–] Appoxo@lemmy.dbzer0.com 3 points 10 months ago

Those have enough seeds for now.

[–] matey@lemmy.dbzer0.com 5 points 10 months ago (1 children)

Can you partially seed some of a larger torrent?

[–] MachineFab812@discuss.tchncs.de 16 points 10 months ago* (last edited 7 months ago) (2 children)

Yes. When downloading the torrent, go to the files list for that torrent and un-check boxes. Resist the urge to leave only the first files in the list(as most people will do this leaving few-if-anyone seeding the rest), **and try instead to grab files from the middle or end, or just be random about it.

When the torrent finishes downloading the files you've selected, it will automatically seed those portions of the torrent which you have downloaded.

EDIT: I just remembered, some torrent programs will actually show you the seed ratio per file in the torrent. There are reasons hardly anyone is (sincerely) trying to reinvent this wheel.

[–] interdimensionalmeme@lemmy.ml 3 points 10 months ago* (last edited 10 months ago)

This is too much work, someone automate this with the smartest algorithm and I will preserve with the power of 10x 2tb 10gbe seedbox.

Automatically auto seed on a rotation the 10% least available file of each torrent Percentage should be adjustable globally and per torrent.

[–] spencer@lemmy.ca 1 points 10 months ago

This is true, but I don’t know if you’d be counted as a seeder on that list though if you don’t have the full torrent.

[–] onlinepersona@programming.dev 37 points 10 months ago (1 children)

Bruh, this is a terrible way to share this. Why not torrents of the raw material in predefined categories that won't change? Like "1984 - Sci-Fi - English - A-N", "1984 - Sci-Fi - English - O-Z", "1990 - Biology", "2012 - Physics". Then people would actually even download this to use it themselves, instead of some archive that has to be extracted and will take a multitude of the space again.

The hell am I going to do with a 300GB archive file that I cannot even look into? I might as well be storing an encrypted blob 300GB large or just reducing the size of my partition by 300GB.

It's great that people want to preserve human knowledge, but there surely are better ways to do this.

[–] c0mmando@links.hackliberty.org 5 points 10 months ago (3 children)

If you can do better let's see it. This post is for altruists and archivists... clearly you're neither.

[–] WallEx@feddit.de 31 points 10 months ago

This is just bad communication, beating down on people that are delivering constructive criticism.

[–] onlinepersona@programming.dev 10 points 10 months ago (1 children)

Way to gatekeep. Don't you think it would be better if more people could contribute bandwidth and storage with what they have instead of buy a new hardrive? Wouldn't you want more redundancy, instead of less?

[–] fatboy93@lemm.ee 6 points 10 months ago

I don't think they use an indexable compression as well, right? That essentially kills stuff for me.

The easiest way to host is not TB/PB sized archives but indices and slices for those.

It easier for a lot of us to download a few gigs and share that, rather than download TB/PB sized archives.

[–] noctisatrae 9 points 10 months ago

WTF he’s raising a good point

[–] unknowing8343@discuss.tchncs.de 36 points 10 months ago

Who thought it was a good idea to have single torrents of multiple TB??

[–] DengueDucky@lemmy.ml 31 points 10 months ago (1 children)

It's unclear to me how these torrents are used. If individual books are not downloaded from them, is this only to make it possible to create similar sites in the future, in case this one is taken down?

[–] empireOfLove@lemmy.one 42 points 10 months ago* (last edited 10 months ago)

They are meant for long-term preservation.

This is basically a "distributed backup" of the entire database. The torrents are not actively serving files- they're there to store multiple copies of the main database across the globe so that the entire database can be recovered (by anyone with the requisite knowledge, mind you) in the event that something happens to the original Anna's Archive team or the main database is lost/seized by "law enforcement".

It's equivalent to how backup managers in ye olden days would make broken up piece files of a certain size that could fit onto a CD or DVD, so you could fit the entire contents of a large 20+GB hard drive onto multiple smaller media. The backup itself is not accessed unless your main hard drive crashes, in which case you reassemble all the individual pieces back into your complete OS environment after replacing the hard drive.

[–] TheImpressiveX@lemmy.ml 18 points 10 months ago (2 children)

Unfortunately I don't have enough storage space to seed. Is there any other way to help?

[–] yote_zip@pawb.social 22 points 10 months ago

The torrents are broken up into smaller pieces - don't be intimidated by the big TB numbers from the sum total. Otherwise donations are always useful.

[–] empireOfLove@lemmy.one 12 points 10 months ago (1 children)

Id happily seed a tb or so of the most in-danger torrents. My internet aint much but my old pc is almost always on.
How do I know which of the piece torrents are high or low on seeders? Maybe I'm just being special or can't see it on mobile but is there no way to check each torrent's health without actually downloading every piece and putting it in my torrent client?

[–] yote_zip@pawb.social 14 points 10 months ago (1 children)

The health is listed next to each piece at this URL: https://annas-archive.org/torrents

[–] empireOfLove@lemmy.one 7 points 10 months ago

Ah perfect. I'll throw some of the 300gb archives on my rig when I get home.

[–] lixus98@sopuli.xyz 8 points 10 months ago

Just got a 300gb torrent to seed for a while. It won't be on 24/7 but most of the day it will.

[–] xtremeownage@lemmyonline.com 6 points 10 months ago

I'd gladly donate a few TB, but Not about to fill my entire array for books i'll never read...

[–] Amends1782@lemmy.ca 6 points 10 months ago (1 children)

I'll set this up this weekend, thanks for the heads up (salute emoji)

[–] chromeo@leminal.space 3 points 10 months ago (1 children)

Is a seedbox necessary or will qbittorrent with a VPN work?

[–] c0mmando@links.hackliberty.org 2 points 10 months ago

that works!

[–] vildis@lemmy.dbzer0.com 1 points 10 months ago* (last edited 10 months ago)

Still seeding strong! worldcat metadata

Maybe i should format my windows drive i haven't touched in a year and throw 3 internet archive torrents on there.