this post was submitted on 07 Apr 2024
265 points (100.0% liked)

Security

113 readers
1 users here now

Confidentiality Integrity Availability

founded 4 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] goferking0@lemmy.sdf.org 3 points 7 months ago

There's also the question of what happens if they just ignore the robots.txt file