Tea@programming.dev to Technology@lemmy.worldEnglish · 7 days agoWikipedia is giving AI developers its data to fend off bot scrapersenterprise.wikimedia.comexternal-linkmessage-square8linkfedilinkarrow-up18arrow-down11
arrow-up17arrow-down1external-linkWikipedia is giving AI developers its data to fend off bot scrapersenterprise.wikimedia.comTea@programming.dev to Technology@lemmy.worldEnglish · 7 days agomessage-square8linkfedilink
minus-squareMonument@lemmy.sdf.orglinkfedilinkEnglisharrow-up1·7 days agoNo, because there isn’t a single IP range or user agent, and many developers are going to lengths to defeat anti-scraping measures, which include user agent spoofing as well as vpns and the like to mask the source of the traffic.
No, because there isn’t a single IP range or user agent, and many developers are going to lengths to defeat anti-scraping measures, which include user agent spoofing as well as vpns and the like to mask the source of the traffic.