• VonReposti@feddit.dk
    link
    fedilink
    arrow-up
    30
    ·
    1 year ago

    Plus how do you spot the difference between a good bot and a bad bot? Web crawlers from search engines are for example inherently good, so they should still be able to operate, but if it is easy to register a good bot in WEI, it is also easy to register a bad bot. If it is hard to register a good bot, then you’re effectively gatekeeping the automated part of the internet (something that actually might be Google’s intention).

    • Bakersfield@lemmy.world
      link
      fedilink
      arrow-up
      12
      ·
      1 year ago

      I was thinking the same thing about Google wanting their bots to be the only ones allowed to crawl and index the internet.