AI companies' bots are making my server slow, what do you do?

Question

Do you reject them or put them in lower priority?So far the AI bots are honest on the user agent. But my low budget server is significantly slower than it should be when I'm using it as a human.

wangxin199 · Accepted Answer

good

mmarian · Answer

Put it behind Cloudflare and try out the various firewall rules. Wrote this blog post covering some examples of rules and trade-offs https://developerwithacat.com/blog/202603/block-bots-scrapin...Also post in r/Cloudflare subreddit. People are very helpful.

JoshTriplett · Answer

https://anubis.techaro.lol/ or https://github.com/dgl/haphash/ .

AI companies' bots are making my server slow, what do you do?

Do you reject them or put them in lower priority?
So far the AI bots are honest on the user agent. But my low budget server is significantly slower than it should be when I'm using it as a human.

good

Put it behind Cloudflare and try out the various firewall rules. Wrote this blog post covering some examples of rules and trade-offs https://developerwithacat.com/blog/202603/block-bots-scrapin...
Also post in r/Cloudflare subreddit. People are very helpful.

https://anubis.techaro.lol/ or https://github.com/dgl/haphash/ .