Appoxo@lemmy.dbzer0.com to Technology@lemmy.worldEnglish · 5 days agoCloudflare plans marketplace to sell permission to scrape websitestechcrunch.comexternal-linkmessage-square9fedilinkarrow-up1156arrow-down14cross-posted to: technology@lemmy.ml
arrow-up1152arrow-down1external-linkCloudflare plans marketplace to sell permission to scrape websitestechcrunch.comAppoxo@lemmy.dbzer0.com to Technology@lemmy.worldEnglish · 5 days agomessage-square9fedilinkcross-posted to: technology@lemmy.ml
minus-squareRikudou_Sage@lemmings.worldlinkfedilinkEnglisharrow-up22·5 days agoPut a page on your website saying that scrapping your website costs [insert amount] and block the bots otherwise.
minus-squaregravitas_deficiency@sh.itjust.workslinkfedilinkEnglisharrow-up14·5 days agoThe hard part is reliably detecting the bots
Put a page on your website saying that scrapping your website costs [insert amount] and block the bots otherwise.
The hard part is reliably detecting the bots