Track_Shovel@slrpnk.net to Lemmy Shitpost@lemmy.worldEnglish · 1 month agoRISE UPslrpnk.netimagemessage-square14fedilinkarrow-up1626arrow-down18
arrow-up1618arrow-down1imageRISE UPslrpnk.netTrack_Shovel@slrpnk.net to Lemmy Shitpost@lemmy.worldEnglish · 1 month agomessage-square14fedilink
minus-squareTheTechnician27@lemmy.worldlinkfedilinkEnglisharrow-up30·1 month agoThe inverse of robots.txt: crawling robots without their consent.
The inverse of robots.txt: crawling robots without their consent.