Appoxo@lemmy.dbzer0.com to Technology@lemmy.worldEnglish · 1 month agoCloudflare plans marketplace to sell permission to scrape websitestechcrunch.comexternal-linkmessage-square9fedilinkarrow-up1157arrow-down14cross-posted to: technology@lemmy.ml
arrow-up1153arrow-down1external-linkCloudflare plans marketplace to sell permission to scrape websitestechcrunch.comAppoxo@lemmy.dbzer0.com to Technology@lemmy.worldEnglish · 1 month agomessage-square9fedilinkcross-posted to: technology@lemmy.ml
minus-squareumami_wasabi@lemmy.mllinkfedilinkEnglisharrow-up18·1 month agoHow can I do this without Cloudflare?
minus-squareRikudou_Sage@lemmings.worldlinkfedilinkEnglisharrow-up22·1 month agoPut a page on your website saying that scrapping your website costs [insert amount] and block the bots otherwise.
minus-squaregravitas_deficiency@sh.itjust.workslinkfedilinkEnglisharrow-up14·1 month agoThe hard part is reliably detecting the bots
How can I do this without Cloudflare?
Put a page on your website saying that scrapping your website costs [insert amount] and block the bots otherwise.
The hard part is reliably detecting the bots