shellsharks@infosec.pubM to cybersecurity@infosec.pub • 7 months agoWhat are You Working on Wednesdaymessage-squaremessage-square2 fedilinkarrow-up13file-text
arrow-up13message-squareWhat are You Working on Wednesdayshellsharks@infosec.pubM to cybersecurity@infosec.pub • 7 months agomessage-square2 Commentsfedilinkfile-text
minus-squaredubbel@discuss.tchncs.dehexbear2·7 months agoPrivate project, not really security related: Crawling robots.txts to gather some statistics on which bots people are most often excluding - weirdly I couldn't find any recent/regularly updated stats on this. linkfedilink
Private project, not really security related: Crawling robots.txts to gather some statistics on which bots people are most often excluding - weirdly I couldn't find any recent/regularly updated stats on this.