this post was submitted on 15 Jun 2023
1 points (100.0% liked)

NZ Off topic

4 readers
1 users here now

This community is for NZ discussion about random non-NZ things, or whatever you want! Shitposts, circlejerks, memes, something you found funny, anything goes!*

*except for:

If you want to have a serious political discussion, take it to !politics@lemmy.nz.

founded 1 year ago
MODERATORS
Dave@lemmy.nz
cloventt@lemmy.nz
1
Found this Reddit dump (lemmy.nz)
submitted 1 year ago by ThatBlokeFromNZ@lemmy.nz to c/offtopic@lemmy.nz
0 comments fedilink hide all child comments
 

I made a comment about how there's such a wealth of knowledge that was available on Reddit that makes it so useful and whilst the cached pages of Google and Waybackmachine (though I've found it doesn't have a copy of a lot of pages I want to view), I have some fear of these disappearing eventually along with people going back and scrubbing their old comments and posts in an effort to remove their content from Reddit and I suppose devaluing the platform as the information stored is pretty useful.

I came across this dump of Reddit submissions and comments from 2005-2022 for the top 20K subs: https://academictorrents.com/details/c398a571976c78d346c325bd75c47b82edf6124e

It says it's about 1.66TB. I haven't downloaded it to have a look at it because I have no space (lol) but I plan to to hopefully preserve and make use of it. When I have time I might write something to index the data so I can search it for what I need.

Just thought I'd share the dump anyway for anyone with similar concerns.

no comments (yet)
sorted by: hot top controversial new old
there doesn't seem to be anything here