this post was submitted on 08 Jul 2023
11 points (100.0% liked)

Programming.dev Meta

59 readers
1 users here now

Welcome to the Programming.Dev meta community!

This is a community for discussing things about programming.dev itself. Things like announcements, site help posts, site questions, etc. are all welcome here.

Links

Credits

founded 2 years ago
MODERATORS
snowe@programming.dev
Ategon@programming.dev
11
what about data scrapers? (programming.dev)
submitted 1 year ago by lucoso@programming.dev to c/meta@programming.dev
7 comments fedilink hide all child comments
 

reddit and twitter (suposedly) jacked up their API prices because of data scrapers, what could lemmy to do try to stop them?

i dont think we can do anything

you are viewing a single comment's thread
view the rest of the comments
[โ€“] Die4Ever@programming.dev 2 points 1 year ago (1 children)

I wonder how stuff like this would affect the scalability of the fediverse, I think having 1 instance like you describe would be good, but having many of them could become an issue maybe

[โ€“] philm@programming.dev 3 points 1 year ago

Yeah but this is a general problem that ActivityPub has, it builds on the goodwill of the people/instances.

But I don't think it will be a really big issue, if there are really just a few of these instances (that is the premise though) But it's a good point, when something like this is open source, and anyone could spin it up to kinda DDOS the fediverse...

But when looking at it in more positive light/good will, it could probably also be used as an intermediate cache/index instance for other instances, which may save requests to the original instances.