AI crawlers run up a website's hosting bill

system Closed August 3, 2024, 4:59pm 21

This topic was automatically closed after 5 days. New replies are no longer allowed.

Topic		Replies	Views
Internet Archive to ignore robots.txt directives boing	23	4677	April 27, 2017
NYT vs wget: technologically illiterate Snowden coverage boing	22	3791	February 15, 2014
Verizon wants to slow down your favorite websites unless they pay bribes boing	54	5752	October 1, 2013
Porn companies carpetbomb Google with sloppy takedowns, remove tons of Github projects boing	18	3319	January 13, 2015
Verizon support rep admits anti-Netflix throttling boing	66	5459	February 12, 2014