this post was submitted on 27 Jan 2023
17 points (100.0% liked)
Fediverse
757 readers
2 users here now
A community dedicated to fediverse news and discussion.
Fediverse is a portmanteau of "federation" and "universe".
Getting started on Fediverse;
- What is the fediverse?
- Fediverse Platforms
- How to run your own community
founded 5 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
The web worked this way before there was a large corporate presence. Scraping was common during the blogosphere period and
robots.txt
was the solution everyone at the time agreed on and that's been the standard ever since.We're not intruding on this space. We've been in the fediverse for just as long or longer; the fediverse has been scrapable since 2008.
Totally. And while it was scrapable, and scraped a lot, I wish there had been a lot more systematic public scraping of the "federated social web" (as it was called before the terrible name "fediverse" was adopted) back then - I had a lot of public conversations on identi.ca and StatusNet which I wish I could still see, but they now exist only in a bunch of private databases I don't have access to. 😢