lemmyreader@lemmy.ml to Security@lemmy.ml • 9 months agoAmazon storing classified US government documents improperlyimagemessage-square23 fedilinkarrow-up1163file-text
arrow-up1163imageAmazon storing classified US government documents improperlylemmyreader@lemmy.ml to Security@lemmy.ml • 9 months agomessage-square23 Commentsfedilinkfile-text
minus-squareAmbiguousProps@lemmy.todayhexbear3·9 months agorobots.txt doesn't have to be followed. It doesn't block crawling. linkfedilink
robots.txt doesn't have to be followed. It doesn't block crawling.