AI Bots Keep Overloading Servers. Should Website Owners Keep Paying? via @sejournal, @martinibuster
- AI bots reportedly account for 80% of traffic on some sites, leading to increased server costs and performance issues.
- Website owners face a dilemma between blocking these crawlers to save money and allowing them to ensure presence in AI search models.
- Blocking AI crawlers generally does not impact a site's visibility in traditional Google search results.
Marketers should use robots.txt or Cloudflare to block non-essential AI bots if server performance or hosting costs are becoming a significant burden.